Jun 11 19:51:00.300442 ip-10-0-142-46 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 19:51:00.300457 ip-10-0-142-46 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 19:51:00.300466 ip-10-0-142-46 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 19:51:00.300788 ip-10-0-142-46 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 19:51:10.549658 ip-10-0-142-46 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 19:51:10.549675 ip-10-0-142-46 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d2819a7e82024094883a5fdc91b984e1 -- Jun 11 19:53:56.872065 ip-10-0-142-46 systemd[1]: Starting Kubernetes Kubelet... Jun 11 19:53:57.185438 ip-10-0-142-46 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:53:57.185438 ip-10-0-142-46 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 19:53:57.185438 ip-10-0-142-46 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:53:57.185438 ip-10-0-142-46 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 19:53:57.185438 ip-10-0-142-46 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:53:57.187362 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.187278 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 19:53:57.193972 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.193950 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:53:57.194015 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.193974 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:53:57.194015 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.193978 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:53:57.194015 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.193981 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:53:57.194015 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.193984 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:53:57.194015 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.193988 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:53:57.194015 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.193991 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:53:57.194015 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.193993 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:53:57.194015 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.193996 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:53:57.194015 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.193999 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:53:57.194015 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194002 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:53:57.194015 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194004 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:53:57.194015 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194007 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:53:57.194015 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194010 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:53:57.194015 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194013 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:53:57.194015 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194015 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:53:57.194015 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194018 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:53:57.194015 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194020 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:53:57.194015 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194023 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:53:57.194537 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194026 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:53:57.194537 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194035 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:53:57.194537 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194037 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:53:57.194537 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194040 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:53:57.194537 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194043 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:53:57.194537 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194045 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:53:57.194537 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194048 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:53:57.194537 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194050 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:53:57.194537 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194053 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:53:57.194537 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194056 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:53:57.194537 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194060 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:53:57.194537 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194064 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:53:57.194537 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194068 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:53:57.194537 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194072 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:53:57.194537 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194078 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:53:57.194537 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194084 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:53:57.194537 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194086 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:53:57.194537 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194089 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:53:57.194537 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194093 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:53:57.194537 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194096 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:53:57.195046 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194099 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:53:57.195046 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194101 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:53:57.195046 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194103 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:53:57.195046 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194106 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:53:57.195046 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194108 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:53:57.195046 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194111 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:53:57.195046 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194113 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:53:57.195046 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194116 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:53:57.195046 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194118 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:53:57.195046 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194121 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:53:57.195046 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194124 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:53:57.195046 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194127 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:53:57.195046 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194129 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:53:57.195046 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194133 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:53:57.195046 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194137 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:53:57.195046 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194141 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:53:57.195046 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194148 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:53:57.195046 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194166 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:53:57.195046 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194171 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:53:57.195507 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194174 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:53:57.195507 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194177 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:53:57.195507 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194180 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:53:57.195507 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194183 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:53:57.195507 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194186 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:53:57.195507 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194188 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:53:57.195507 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194191 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:53:57.195507 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194194 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:53:57.195507 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194196 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:53:57.195507 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194199 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:53:57.195507 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194201 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:53:57.195507 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194204 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:53:57.195507 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194206 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:53:57.195507 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194209 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:53:57.195507 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194212 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:53:57.195507 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194214 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:53:57.195507 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194217 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:53:57.195507 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194219 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:53:57.195507 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194221 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:53:57.195993 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194224 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:53:57.195993 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194226 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:53:57.195993 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194229 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:53:57.195993 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194234 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:53:57.195993 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194238 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:53:57.195993 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194243 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:53:57.195993 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194247 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:53:57.195993 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194250 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:53:57.195993 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194252 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:53:57.195993 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194255 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:53:57.195993 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194258 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:53:57.195993 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194260 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:53:57.195993 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194262 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:53:57.195993 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194265 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:53:57.195993 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194267 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:53:57.195993 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194269 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:53:57.195993 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194272 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:53:57.195993 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194275 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:53:57.195993 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194277 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:53:57.195993 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194279 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:53:57.196504 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194282 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:53:57.196504 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.194285 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:53:57.196504 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195093 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:53:57.196504 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195101 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:53:57.196504 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195105 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:53:57.196504 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195108 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:53:57.196504 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195112 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:53:57.196504 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195117 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:53:57.196504 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195121 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:53:57.196504 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195126 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:53:57.196504 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195130 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:53:57.196504 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195132 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:53:57.196504 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195135 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:53:57.196504 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195138 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:53:57.196504 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195140 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:53:57.196504 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195146 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:53:57.196504 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195149 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:53:57.196504 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195152 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:53:57.196504 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195154 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:53:57.196504 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195157 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:53:57.197060 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195159 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:53:57.197060 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195162 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:53:57.197060 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195166 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:53:57.197060 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195168 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:53:57.197060 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195171 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:53:57.197060 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195173 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:53:57.197060 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195177 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:53:57.197060 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195181 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:53:57.197060 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195185 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:53:57.197060 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195188 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:53:57.197060 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195191 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:53:57.197060 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195195 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:53:57.197060 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195200 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:53:57.197060 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195205 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:53:57.197060 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195209 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:53:57.197060 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195212 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:53:57.197060 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195215 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:53:57.197060 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195217 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:53:57.197060 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195220 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:53:57.197529 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195222 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:53:57.197529 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195225 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:53:57.197529 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195227 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:53:57.197529 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195229 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:53:57.197529 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195232 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:53:57.197529 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195234 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:53:57.197529 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195237 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:53:57.197529 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195239 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:53:57.197529 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195244 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:53:57.197529 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195246 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:53:57.197529 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195249 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:53:57.197529 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195252 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:53:57.197529 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195254 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:53:57.197529 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195258 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:53:57.197529 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195260 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:53:57.197529 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195263 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:53:57.197529 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195266 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:53:57.197529 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195269 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:53:57.197529 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195274 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:53:57.197529 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195279 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:53:57.198045 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195284 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:53:57.198045 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195289 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:53:57.198045 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195292 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:53:57.198045 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195295 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:53:57.198045 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195297 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:53:57.198045 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195300 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:53:57.198045 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195303 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:53:57.198045 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195305 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:53:57.198045 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195308 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:53:57.198045 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195311 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:53:57.198045 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195314 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:53:57.198045 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195317 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:53:57.198045 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195320 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:53:57.198045 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195322 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:53:57.198045 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195325 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:53:57.198045 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195327 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:53:57.198045 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195330 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:53:57.198045 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195332 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:53:57.198045 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195334 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:53:57.198045 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195337 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:53:57.198535 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195341 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:53:57.198535 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195343 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:53:57.198535 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195346 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:53:57.198535 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195348 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:53:57.198535 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195351 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:53:57.198535 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195355 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:53:57.198535 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195359 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:53:57.198535 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195363 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:53:57.198535 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195367 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:53:57.198535 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195372 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:53:57.198535 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195374 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:53:57.198535 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195376 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:53:57.198535 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195379 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:53:57.198535 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195382 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:53:57.198535 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195384 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:53:57.198535 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195387 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:53:57.198535 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195389 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:53:57.198535 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195392 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:53:57.198535 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195394 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:53:57.198535 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195396 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:53:57.199038 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195399 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:53:57.199038 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195401 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:53:57.199038 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195795 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:53:57.199038 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195801 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:53:57.199038 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195805 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:53:57.199038 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195808 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:53:57.199038 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195811 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:53:57.199038 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195814 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:53:57.199038 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195817 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:53:57.199038 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195819 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:53:57.199038 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195822 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:53:57.199038 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195824 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:53:57.199038 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195830 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:53:57.199038 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195833 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:53:57.199038 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195837 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:53:57.199038 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195842 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:53:57.199038 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195846 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:53:57.199038 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195851 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:53:57.199038 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195854 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:53:57.199495 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195857 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:53:57.199495 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195859 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:53:57.199495 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195863 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:53:57.199495 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195865 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:53:57.199495 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195868 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:53:57.199495 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195870 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:53:57.199495 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195873 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:53:57.199495 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195875 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:53:57.199495 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195878 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:53:57.199495 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195880 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:53:57.199495 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195883 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:53:57.199495 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195885 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:53:57.199495 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195887 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:53:57.199495 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195891 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:53:57.199495 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195895 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:53:57.199495 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195898 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:53:57.199495 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195900 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:53:57.199495 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195903 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:53:57.199495 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195905 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:53:57.199495 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195908 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:53:57.199990 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195911 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:53:57.199990 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195916 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:53:57.199990 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195920 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:53:57.199990 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195925 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:53:57.199990 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195929 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:53:57.199990 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195933 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:53:57.199990 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195935 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:53:57.199990 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195938 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:53:57.199990 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195941 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:53:57.199990 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195943 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:53:57.199990 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195946 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:53:57.199990 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195948 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:53:57.199990 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195951 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:53:57.199990 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195953 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:53:57.199990 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195956 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:53:57.199990 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195960 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:53:57.199990 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195962 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:53:57.199990 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195965 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:53:57.199990 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195967 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:53:57.200455 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195970 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:53:57.200455 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195972 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:53:57.200455 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195974 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:53:57.200455 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195977 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:53:57.200455 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195979 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:53:57.200455 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195981 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:53:57.200455 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195984 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:53:57.200455 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195986 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:53:57.200455 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195989 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:53:57.200455 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195992 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:53:57.200455 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.195998 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:53:57.200455 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196002 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:53:57.200455 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196006 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:53:57.200455 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196011 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:53:57.200455 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196015 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:53:57.200455 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196018 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:53:57.200455 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196020 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:53:57.200455 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196023 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:53:57.200455 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196026 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:53:57.200455 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196028 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:53:57.200982 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196031 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:53:57.200982 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196033 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:53:57.200982 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196036 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:53:57.200982 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196038 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:53:57.200982 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196041 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:53:57.200982 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196044 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:53:57.200982 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196046 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:53:57.200982 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196049 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:53:57.200982 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196051 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:53:57.200982 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196054 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:53:57.200982 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196056 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:53:57.200982 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196059 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:53:57.200982 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196061 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:53:57.200982 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196064 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:53:57.200982 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196066 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:53:57.200982 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196069 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:53:57.200982 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196072 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:53:57.200982 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196076 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:53:57.200982 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196081 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:53:57.200982 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196084 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196088 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196091 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196093 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196172 2564 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196184 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196189 2564 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196194 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196198 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196201 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196205 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196209 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196212 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196215 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196219 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196222 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196227 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196230 2564 flags.go:64] FLAG: --cgroup-root="" Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196234 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196240 2564 flags.go:64] FLAG: --client-ca-file="" Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196245 2564 flags.go:64] FLAG: --cloud-provider="external" Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196249 2564 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196255 2564 flags.go:64] FLAG: --cluster-domain="" Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196259 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 19:53:57.201465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196262 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196265 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196268 2564 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196272 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196274 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196277 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196280 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196283 2564 flags.go:64] FLAG: --contention-profiling="false" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196286 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196289 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196292 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196295 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196299 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196302 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196304 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196307 2564 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196310 2564 flags.go:64] FLAG: --enable-server="true" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196313 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196319 2564 flags.go:64] FLAG: --event-burst="100" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196324 2564 flags.go:64] FLAG: --event-qps="50" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196329 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196333 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196337 2564 flags.go:64] FLAG: --eviction-hard="" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196340 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 19:53:57.202100 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196344 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196347 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196350 2564 flags.go:64] FLAG: --eviction-soft="" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196353 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196355 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196358 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196361 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196363 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196367 2564 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196370 2564 flags.go:64] FLAG: --feature-gates="" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196373 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196376 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196379 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196382 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196385 2564 flags.go:64] FLAG: --healthz-port="10248" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196388 2564 flags.go:64] FLAG: --help="false" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196391 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-142-46.ec2.internal" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196394 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196399 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196404 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196410 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196414 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196416 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 19:53:57.202701 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196419 2564 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196422 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196424 2564 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196427 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196430 2564 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196433 2564 flags.go:64] FLAG: --kube-reserved="" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196435 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196438 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196441 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196447 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196450 2564 flags.go:64] FLAG: --lock-file="" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196454 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196456 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196459 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196464 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196468 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196470 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196473 2564 flags.go:64] FLAG: --logging-format="text" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196479 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196485 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196489 2564 flags.go:64] FLAG: --manifest-url="" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196493 2564 flags.go:64] FLAG: --manifest-url-header="" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196498 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196501 2564 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196505 2564 flags.go:64] FLAG: --max-pods="110" Jun 11 19:53:57.203361 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196508 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196511 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196514 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196516 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196519 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196522 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196525 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196531 2564 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196534 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196537 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196540 2564 flags.go:64] FLAG: --pod-cidr="" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196542 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196547 2564 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196550 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196553 2564 flags.go:64] FLAG: --pods-per-core="0" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196557 2564 flags.go:64] FLAG: --port="10250" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196564 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196569 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0634a744dbb2baebc" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196573 2564 flags.go:64] FLAG: --qos-reserved="" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196576 2564 flags.go:64] FLAG: --read-only-port="10255" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196579 2564 flags.go:64] FLAG: --register-node="true" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196582 2564 flags.go:64] FLAG: --register-with-taints="" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196586 2564 flags.go:64] FLAG: --registry-burst="10" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196588 2564 flags.go:64] FLAG: --registry-qps="5" Jun 11 19:53:57.204263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196591 2564 flags.go:64] FLAG: --reserved-cpus="" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196594 2564 flags.go:64] FLAG: --reserved-memory="" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196598 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196601 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196604 2564 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196606 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196610 2564 flags.go:64] FLAG: --runonce="false" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196613 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196616 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196618 2564 flags.go:64] FLAG: --seccomp-default="false" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196621 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196624 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196627 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196630 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196632 2564 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196636 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196641 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196646 2564 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196650 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196654 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196657 2564 flags.go:64] FLAG: --system-cgroups="" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196659 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196665 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196667 2564 flags.go:64] FLAG: --tls-cert-file="" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196671 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 19:53:57.204904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196675 2564 flags.go:64] FLAG: --tls-min-version="" Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196678 2564 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196680 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196684 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196687 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196689 2564 flags.go:64] FLAG: --v="2" Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196693 2564 flags.go:64] FLAG: --version="false" Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196702 2564 flags.go:64] FLAG: --vmodule="" Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196705 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.196709 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196850 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196854 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196857 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196862 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196865 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196868 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196871 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196873 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196877 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196882 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196886 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196890 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:53:57.205521 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196894 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:53:57.206165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196896 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:53:57.206165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196899 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:53:57.206165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196901 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:53:57.206165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196904 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:53:57.206165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196906 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:53:57.206165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196909 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:53:57.206165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196911 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:53:57.206165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196913 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:53:57.206165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196918 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:53:57.206165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196920 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:53:57.206165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196923 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:53:57.206165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196925 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:53:57.206165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196927 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:53:57.206165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196930 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:53:57.206165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196932 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:53:57.206165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196934 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:53:57.206165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196938 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:53:57.206165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196940 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:53:57.206165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196942 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:53:57.206165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196945 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:53:57.206645 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196948 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:53:57.206645 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196950 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:53:57.206645 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196955 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:53:57.206645 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196959 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:53:57.206645 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196963 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:53:57.206645 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196968 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:53:57.206645 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196972 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:53:57.206645 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196974 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:53:57.206645 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196977 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:53:57.206645 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196979 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:53:57.206645 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196982 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:53:57.206645 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196985 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:53:57.206645 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196987 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:53:57.206645 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196990 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:53:57.206645 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196992 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:53:57.206645 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196995 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:53:57.206645 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.196997 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:53:57.206645 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197000 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:53:57.206645 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197002 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:53:57.206645 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197005 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:53:57.207156 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197008 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:53:57.207156 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197011 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:53:57.207156 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197013 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:53:57.207156 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197016 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:53:57.207156 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197018 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:53:57.207156 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197021 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:53:57.207156 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197023 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:53:57.207156 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197025 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:53:57.207156 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197028 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:53:57.207156 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197030 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:53:57.207156 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197032 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:53:57.207156 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197036 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:53:57.207156 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197040 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:53:57.207156 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197045 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:53:57.207156 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197051 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:53:57.207156 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197054 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:53:57.207156 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197056 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:53:57.207156 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197058 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:53:57.207156 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197061 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:53:57.207156 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197064 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:53:57.207633 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197066 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:53:57.207633 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197069 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:53:57.207633 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197071 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:53:57.207633 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197074 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:53:57.207633 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197078 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:53:57.207633 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197081 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:53:57.207633 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197084 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:53:57.207633 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197087 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:53:57.207633 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197090 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:53:57.207633 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197092 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:53:57.207633 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197095 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:53:57.207633 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197098 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:53:57.207633 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197101 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:53:57.207633 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197104 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:53:57.207633 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197106 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:53:57.207633 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197109 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:53:57.207633 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197111 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:53:57.207633 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197114 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:53:57.207633 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197118 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:53:57.208107 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197122 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:53:57.208107 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197129 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:53:57.208107 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197134 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:53:57.208107 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197138 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:53:57.208107 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197141 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:53:57.208107 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197144 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:53:57.208107 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.197147 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:53:57.208107 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.197625 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:53:57.208107 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.205522 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 19:53:57.208107 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.205537 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 19:53:57.208107 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.205555 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 19:53:57.208107 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.205561 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 19:53:57.208107 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205615 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:53:57.208107 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205620 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:53:57.208464 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205624 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:53:57.208464 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205627 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:53:57.208464 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205630 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:53:57.208464 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205633 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:53:57.208464 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205636 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:53:57.208464 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205640 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:53:57.208464 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205643 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:53:57.208464 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205646 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:53:57.208464 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205649 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:53:57.208464 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205651 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:53:57.208464 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205654 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:53:57.208464 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205656 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:53:57.208464 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205660 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:53:57.208464 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205663 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:53:57.208464 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205666 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:53:57.208464 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205668 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:53:57.208464 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205671 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:53:57.208464 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205674 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:53:57.208464 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205676 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:53:57.208464 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205679 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:53:57.208965 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205682 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:53:57.208965 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205684 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:53:57.208965 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205686 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:53:57.208965 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205689 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:53:57.208965 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205691 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:53:57.208965 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205694 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:53:57.208965 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205696 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:53:57.208965 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205700 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:53:57.208965 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205702 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:53:57.208965 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205705 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:53:57.208965 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205707 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:53:57.208965 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205710 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:53:57.208965 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205713 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:53:57.208965 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205717 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:53:57.208965 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205720 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:53:57.208965 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205723 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:53:57.208965 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205726 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:53:57.208965 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205729 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:53:57.208965 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205731 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:53:57.209430 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205734 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:53:57.209430 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205738 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:53:57.209430 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205742 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:53:57.209430 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205745 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:53:57.209430 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205747 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:53:57.209430 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205751 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:53:57.209430 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205754 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:53:57.209430 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205756 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:53:57.209430 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205759 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:53:57.209430 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205762 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:53:57.209430 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205764 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:53:57.209430 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205767 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:53:57.209430 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205769 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:53:57.209430 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205772 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:53:57.209430 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205774 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:53:57.209430 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205777 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:53:57.209430 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205779 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:53:57.209430 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205801 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:53:57.209430 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205804 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:53:57.210018 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205807 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:53:57.210018 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205810 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:53:57.210018 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205813 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:53:57.210018 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205816 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:53:57.210018 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205818 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:53:57.210018 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205821 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:53:57.210018 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205824 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:53:57.210018 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205826 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:53:57.210018 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205829 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:53:57.210018 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205831 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:53:57.210018 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205834 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:53:57.210018 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205836 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:53:57.210018 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205839 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:53:57.210018 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205841 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:53:57.210018 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205844 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:53:57.210018 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205846 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:53:57.210018 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205849 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:53:57.210018 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205851 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:53:57.210018 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205853 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:53:57.210018 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205857 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:53:57.210540 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205859 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:53:57.210540 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205862 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:53:57.210540 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205864 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:53:57.210540 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205867 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:53:57.210540 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205870 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:53:57.210540 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205872 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:53:57.210540 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205875 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:53:57.210540 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205877 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:53:57.210540 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205879 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:53:57.210540 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205882 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:53:57.210540 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205884 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:53:57.210540 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205887 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:53:57.210540 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205889 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:53:57.210540 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205892 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:53:57.210540 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205895 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:53:57.210540 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205897 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:53:57.210540 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205900 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:53:57.210540 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205903 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:53:57.210540 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.205905 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:53:57.211040 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.205910 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:53:57.211040 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206026 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:53:57.211040 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206032 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:53:57.211040 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206035 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:53:57.211040 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206038 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:53:57.211040 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206041 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:53:57.211040 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206044 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:53:57.211040 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206046 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:53:57.211040 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206049 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:53:57.211040 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206051 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:53:57.211040 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206054 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:53:57.211040 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206056 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:53:57.211040 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206059 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:53:57.211040 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206062 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:53:57.211040 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206065 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:53:57.211532 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206067 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:53:57.211532 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206070 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:53:57.211532 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206072 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:53:57.211532 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206074 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:53:57.211532 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206077 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:53:57.211532 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206079 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:53:57.211532 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206082 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:53:57.211532 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206085 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:53:57.211532 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206087 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:53:57.211532 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206090 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:53:57.211532 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206092 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:53:57.211532 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206094 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:53:57.211532 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206097 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:53:57.211532 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206099 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:53:57.211532 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206102 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:53:57.211532 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206105 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:53:57.211532 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206107 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:53:57.211532 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206109 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:53:57.211532 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206112 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:53:57.211532 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206114 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:53:57.212089 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206117 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:53:57.212089 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206119 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:53:57.212089 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206121 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:53:57.212089 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206123 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:53:57.212089 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206126 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:53:57.212089 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206129 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:53:57.212089 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206131 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:53:57.212089 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206133 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:53:57.212089 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206136 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:53:57.212089 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206138 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:53:57.212089 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206141 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:53:57.212089 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206144 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:53:57.212089 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206146 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:53:57.212089 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206148 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:53:57.212089 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206152 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:53:57.212089 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206155 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:53:57.212089 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206158 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:53:57.212089 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206160 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:53:57.212089 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206163 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:53:57.212872 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206165 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:53:57.212872 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206168 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:53:57.212872 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206170 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:53:57.212872 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206173 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:53:57.212872 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206175 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:53:57.212872 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206178 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:53:57.212872 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206181 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:53:57.212872 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206183 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:53:57.212872 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206187 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:53:57.212872 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206190 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:53:57.212872 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206193 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:53:57.212872 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206195 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:53:57.212872 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206198 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:53:57.212872 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206201 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:53:57.212872 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206203 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:53:57.212872 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206205 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:53:57.212872 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206208 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:53:57.212872 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206210 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:53:57.212872 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206212 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:53:57.213456 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206215 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:53:57.213456 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206217 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:53:57.213456 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206220 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:53:57.213456 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206223 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:53:57.213456 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206225 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:53:57.213456 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206228 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:53:57.213456 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206231 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:53:57.213456 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206233 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:53:57.213456 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206236 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:53:57.213456 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206238 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:53:57.213456 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206240 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:53:57.213456 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206243 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:53:57.213456 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206245 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:53:57.213456 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206247 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:53:57.213456 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206250 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:53:57.213456 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206252 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:53:57.213456 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206255 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:53:57.213456 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206257 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:53:57.213456 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206260 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:53:57.213456 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206262 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:53:57.214091 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206265 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:53:57.214091 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206267 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:53:57.214091 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206270 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:53:57.214091 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206273 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:53:57.214091 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206275 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:53:57.214091 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206278 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:53:57.214091 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:57.206280 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:53:57.214091 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.206285 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:53:57.214091 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.206377 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 19:53:57.214091 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.210019 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 19:53:57.214091 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.211173 2564 server.go:1019] "Starting client certificate rotation" Jun 11 19:53:57.214091 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.211293 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 19:53:57.214091 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.211335 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 19:53:57.214519 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.213238 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 19:53:57.214519 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.214400 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 19:53:57.227868 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.227852 2564 log.go:25] "Validated CRI v1 runtime API" Jun 11 19:53:57.230536 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.230520 2564 log.go:25] "Validated CRI v1 image API" Jun 11 19:53:57.232291 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.232278 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 19:53:57.236516 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.236491 2564 fs.go:135] Filesystem UUIDs: map[52205cf7-272d-4a02-8ae5-09e764be864d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 99f4cc6e-3a83-4da8-81a1-2316b89e158f:/dev/nvme0n1p4] Jun 11 19:53:57.236572 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.236516 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 19:53:57.242136 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.241599 2564 manager.go:216] Machine: {Timestamp:2026-06-11 19:53:57.240581294 +0000 UTC m=+0.272297925 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099276 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22214f3b26542a79010e5e6c046fe2 SystemUUID:ec22214f-3b26-542a-7901-0e5e6c046fe2 BootID:d2819a7e-8202-4094-883a-5fdc91b984e1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4b:4c:da:9e:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4b:4c:da:9e:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:59:41:a7:2a:8c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 19:53:57.242136 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.241933 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 19:53:57.242136 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.242082 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 19:53:57.243557 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.243525 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 19:53:57.243715 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.243560 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-46.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 19:53:57.244801 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.244765 2564 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 19:53:57.244801 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.244800 2564 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 19:53:57.244929 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.244811 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 19:53:57.245461 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.245449 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 19:53:57.246520 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.246510 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 19:53:57.246869 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.246852 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 19:53:57.249718 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.249705 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 11 19:53:57.249846 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.249837 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 19:53:57.249888 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.249867 2564 kubelet.go:486] "Attempting to sync node with API server" Jun 11 19:53:57.249888 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.249876 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 19:53:57.249888 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.249886 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 19:53:57.249985 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.249894 2564 kubelet.go:398] "Adding apiserver pod source" Jun 11 19:53:57.249985 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.249903 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 19:53:57.250514 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.250260 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 19:53:57.250514 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.250298 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 19:53:57.255633 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.255616 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 19:53:57.256858 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.256845 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 19:53:57.256906 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.256875 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 19:53:57.257041 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.257029 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 19:53:57.257083 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.257051 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 19:53:57.257083 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.257058 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 19:53:57.257083 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.257063 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 19:53:57.257083 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.257071 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 19:53:57.257083 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.257076 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 19:53:57.257417 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.257405 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 19:53:57.257445 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.257420 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 19:53:57.257445 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.257431 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 19:53:57.257445 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.257440 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 19:53:57.257528 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.257453 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 19:53:57.257528 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.257464 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 19:53:57.258002 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.257990 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 19:53:57.258038 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.258003 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 19:53:57.261110 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.261098 2564 server.go:1268] "Started kubelet" Jun 11 19:53:57.261260 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.261229 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 19:53:57.261363 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.261239 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 19:53:57.261425 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.261410 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 19:53:57.262033 ip-10-0-142-46 systemd[1]: Started Kubernetes Kubelet. Jun 11 19:53:57.262710 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.262681 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-46.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 19:53:57.262804 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:57.262753 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 19:53:57.262904 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:57.262809 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-46.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 19:53:57.263148 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.263134 2564 server.go:310] "Adding debug handlers to kubelet server" Jun 11 19:53:57.263223 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.263139 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 19:53:57.265208 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:57.264433 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-46.ec2.internal.18b81ee8aa28994f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-46.ec2.internal,UID:ip-10-0-142-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-46.ec2.internal,},FirstTimestamp:2026-06-11 19:53:57.261064527 +0000 UTC m=+0.292781157,LastTimestamp:2026-06-11 19:53:57.261064527 +0000 UTC m=+0.292781157,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-46.ec2.internal,}" Jun 11 19:53:57.267293 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:57.267275 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 19:53:57.267914 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.267893 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cr2sr" Jun 11 19:53:57.267991 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.267913 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 19:53:57.268364 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.268343 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 19:53:57.268476 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:57.268457 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-46.ec2.internal\" not found" Jun 11 19:53:57.268955 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.268939 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 19:53:57.269043 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.268961 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 19:53:57.269043 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.268942 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 19:53:57.269139 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.269058 2564 reconstruct.go:97] "Volume reconstruction finished" Jun 11 19:53:57.269139 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.269068 2564 reconciler.go:29] "Reconciler: start to sync state" Jun 11 19:53:57.269437 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.269421 2564 factory.go:55] Registering systemd factory Jun 11 19:53:57.269525 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.269440 2564 factory.go:223] Registration of the systemd container factory successfully Jun 11 19:53:57.269649 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.269637 2564 factory.go:153] Registering CRI-O factory Jun 11 19:53:57.269689 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.269654 2564 factory.go:223] Registration of the crio container factory successfully Jun 11 19:53:57.269717 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.269699 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 19:53:57.269748 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.269720 2564 factory.go:103] Registering Raw factory Jun 11 19:53:57.269748 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.269734 2564 manager.go:1196] Started watching for new ooms in manager Jun 11 19:53:57.270187 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.270174 2564 manager.go:349] Starting recovery of all containers Jun 11 19:53:57.270628 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:57.270600 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-46.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 19:53:57.270923 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:57.270896 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 19:53:57.276015 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.275989 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cr2sr" Jun 11 19:53:57.282145 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.281991 2564 manager.go:354] Recovery completed Jun 11 19:53:57.286189 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.286176 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:53:57.289856 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.289837 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:53:57.289913 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.289872 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:53:57.289913 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.289883 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:53:57.290395 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.290381 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 19:53:57.290436 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.290399 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 19:53:57.290436 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.290417 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 11 19:53:57.290499 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.290386 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:53:57.291279 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.291269 2564 policy_none.go:49] "None policy: Start" Jun 11 19:53:57.291310 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.291283 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 19:53:57.291310 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.291293 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 19:53:57.292146 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.292137 2564 policy_none.go:47] "Start" Jun 11 19:53:57.293035 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.293022 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:53:57.293103 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.293051 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:53:57.293103 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.293067 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:53:57.332456 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.332427 2564 manager.go:337] "Starting Device Plugin manager" Jun 11 19:53:57.339474 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:57.332479 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 19:53:57.339474 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.332493 2564 server.go:87] "Starting device plugin registration server" Jun 11 19:53:57.339474 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.332751 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 19:53:57.339474 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.332761 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 19:53:57.339474 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.332846 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 19:53:57.339474 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.332926 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 19:53:57.339474 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.332935 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 19:53:57.339474 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:57.333547 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 19:53:57.339474 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:57.333600 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-46.ec2.internal\" not found" Jun 11 19:53:57.340807 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.340766 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 19:53:57.342028 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.342015 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 19:53:57.342071 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.342051 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 19:53:57.342071 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.342071 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 19:53:57.342143 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:57.342104 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 19:53:57.344293 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.344275 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:53:57.433523 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.433492 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:53:57.434666 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.434652 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:53:57.434744 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.434679 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:53:57.434744 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.434689 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:53:57.434744 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.434716 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-46.ec2.internal" Jun 11 19:53:57.442570 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.442530 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-46.ec2.internal"] Jun 11 19:53:57.442624 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.442584 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:53:57.443277 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.443263 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-46.ec2.internal" Jun 11 19:53:57.443316 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:57.443284 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-46.ec2.internal\": node \"ip-10-0-142-46.ec2.internal\" not found" Jun 11 19:53:57.444672 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.444653 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:53:57.444718 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.444683 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:53:57.444718 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.444693 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:53:57.445900 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.445889 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:53:57.446012 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.445994 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal" Jun 11 19:53:57.446101 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.446023 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:53:57.446707 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.446692 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:53:57.446807 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.446721 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:53:57.446807 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.446724 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:53:57.446807 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.446734 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:53:57.446807 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.446748 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:53:57.446807 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.446762 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:53:57.447969 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.447952 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-46.ec2.internal" Jun 11 19:53:57.448053 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.447982 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:53:57.448643 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.448628 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:53:57.448722 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.448654 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:53:57.448722 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.448664 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:53:57.460158 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:57.460143 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-46.ec2.internal\" not found" Jun 11 19:53:57.470337 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.470320 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e98357cd5167f030d353895971d64441-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal\" (UID: \"e98357cd5167f030d353895971d64441\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal" Jun 11 19:53:57.470393 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.470346 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e98357cd5167f030d353895971d64441-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal\" (UID: \"e98357cd5167f030d353895971d64441\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal" Jun 11 19:53:57.470393 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.470362 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8d2b0ae5364d0f6706b40cc63991a02-config\") pod \"kube-apiserver-proxy-ip-10-0-142-46.ec2.internal\" (UID: \"c8d2b0ae5364d0f6706b40cc63991a02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-46.ec2.internal" Jun 11 19:53:57.480355 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:57.480337 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-46.ec2.internal\" not found" node="ip-10-0-142-46.ec2.internal" Jun 11 19:53:57.484694 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:57.484679 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-46.ec2.internal\" not found" node="ip-10-0-142-46.ec2.internal" Jun 11 19:53:57.560819 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:57.560772 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-46.ec2.internal\" not found" Jun 11 19:53:57.571372 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.571349 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e98357cd5167f030d353895971d64441-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal\" (UID: \"e98357cd5167f030d353895971d64441\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal" Jun 11 19:53:57.571457 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.571372 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e98357cd5167f030d353895971d64441-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal\" (UID: \"e98357cd5167f030d353895971d64441\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal" Jun 11 19:53:57.571457 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.571395 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8d2b0ae5364d0f6706b40cc63991a02-config\") pod \"kube-apiserver-proxy-ip-10-0-142-46.ec2.internal\" (UID: \"c8d2b0ae5364d0f6706b40cc63991a02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-46.ec2.internal" Jun 11 19:53:57.571457 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.571426 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e98357cd5167f030d353895971d64441-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal\" (UID: \"e98357cd5167f030d353895971d64441\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal" Jun 11 19:53:57.571457 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.571433 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e98357cd5167f030d353895971d64441-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal\" (UID: \"e98357cd5167f030d353895971d64441\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal" Jun 11 19:53:57.571576 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.571458 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8d2b0ae5364d0f6706b40cc63991a02-config\") pod \"kube-apiserver-proxy-ip-10-0-142-46.ec2.internal\" (UID: \"c8d2b0ae5364d0f6706b40cc63991a02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-46.ec2.internal" Jun 11 19:53:57.661475 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:57.661447 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-46.ec2.internal\" not found" Jun 11 19:53:57.761912 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:57.761839 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-46.ec2.internal\" not found" Jun 11 19:53:57.783343 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.783316 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal" Jun 11 19:53:57.788273 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:57.788257 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-46.ec2.internal" Jun 11 19:53:57.862444 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:57.862415 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-46.ec2.internal\" not found" Jun 11 19:53:57.962913 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:57.962893 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-46.ec2.internal\" not found" Jun 11 19:53:58.063423 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:58.063351 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-46.ec2.internal\" not found" Jun 11 19:53:58.163878 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:58.163854 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-46.ec2.internal\" not found" Jun 11 19:53:58.210314 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:58.210291 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 19:53:58.210858 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:58.210432 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 19:53:58.218295 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:58.218269 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode98357cd5167f030d353895971d64441.slice/crio-a34941863ad7eca2503acff318a322deff5086aa3b3f87cd7bb1c8ed94757b5b WatchSource:0}: Error finding container a34941863ad7eca2503acff318a322deff5086aa3b3f87cd7bb1c8ed94757b5b: Status 404 returned error can't find the container with id a34941863ad7eca2503acff318a322deff5086aa3b3f87cd7bb1c8ed94757b5b Jun 11 19:53:58.218512 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:53:58.218491 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d2b0ae5364d0f6706b40cc63991a02.slice/crio-4f1120c3964c756d736001e791e09be6a1837fd74102d7304ee68c80b4c47041 WatchSource:0}: Error finding container 4f1120c3964c756d736001e791e09be6a1837fd74102d7304ee68c80b4c47041: Status 404 returned error can't find the container with id 4f1120c3964c756d736001e791e09be6a1837fd74102d7304ee68c80b4c47041 Jun 11 19:53:58.222826 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:58.222811 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 19:53:58.264245 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:58.264221 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-46.ec2.internal\" not found" Jun 11 19:53:58.282667 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:58.282630 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 19:48:57 +0000 UTC" deadline="2027-12-20 18:07:42.090954779 +0000 UTC" Jun 11 19:53:58.282667 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:58.282663 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13366h13m43.808294619s" Jun 11 19:53:58.286734 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:58.286713 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:53:58.287565 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:58.287533 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:53:58.345854 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:58.345762 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal" event={"ID":"e98357cd5167f030d353895971d64441","Type":"ContainerStarted","Data":"a34941863ad7eca2503acff318a322deff5086aa3b3f87cd7bb1c8ed94757b5b"} Jun 11 19:53:58.346768 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:58.346747 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-46.ec2.internal" event={"ID":"c8d2b0ae5364d0f6706b40cc63991a02","Type":"ContainerStarted","Data":"4f1120c3964c756d736001e791e09be6a1837fd74102d7304ee68c80b4c47041"} Jun 11 19:53:58.369655 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:58.369636 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal" Jun 11 19:53:58.372777 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:58.372764 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:53:58.381166 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:58.381151 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 19:53:58.381938 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:58.381927 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-46.ec2.internal" Jun 11 19:53:58.390029 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:58.390018 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 19:53:59.251488 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.251458 2564 apiserver.go:52] "Watching apiserver" Jun 11 19:53:59.258273 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.258247 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 19:53:59.258822 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.258773 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-znbfc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8","openshift-dns/node-resolver-rkxzl","openshift-image-registry/node-ca-bk68w","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal","openshift-multus/multus-additional-cni-plugins-qff5g","openshift-multus/multus-bd2tp","openshift-network-diagnostics/network-check-target-64f8l","kube-system/global-pull-secret-syncer-r6c8g","kube-system/kube-apiserver-proxy-ip-10-0-142-46.ec2.internal","openshift-cluster-node-tuning-operator/tuned-t9tsm","openshift-multus/network-metrics-daemon-z8x8n","openshift-network-operator/iptables-alerter-86vvn","openshift-ovn-kubernetes/ovnkube-node-2l9v4"] Jun 11 19:53:59.260343 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.260320 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.261376 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.261355 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.262697 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.262678 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 19:53:59.262958 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.262937 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 19:53:59.263042 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.262991 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 19:53:59.263180 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.263165 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rkxzl" Jun 11 19:53:59.263180 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.263176 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tsfrn\"" Jun 11 19:53:59.263318 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.263227 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 19:53:59.264210 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.263701 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xzcsh\"" Jun 11 19:53:59.264210 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.263741 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:53:59.264210 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.263877 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bk68w" Jun 11 19:53:59.264210 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.263903 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 19:53:59.265457 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.265438 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 19:53:59.265593 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.265568 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.266123 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.266077 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5r7vq\"" Jun 11 19:53:59.266215 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.266142 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 19:53:59.266215 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.266174 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 19:53:59.266351 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.266332 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 19:53:59.266404 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.266361 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 19:53:59.266693 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.266676 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-87thv\"" Jun 11 19:53:59.267860 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.267843 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.268170 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.268151 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 19:53:59.268496 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.268421 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 19:53:59.268603 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.268587 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 19:53:59.268681 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.268633 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 19:53:59.268839 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.268708 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kxchs\"" Jun 11 19:53:59.268839 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.268714 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 19:53:59.268953 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.268852 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 19:53:59.270114 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.269147 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:53:59.270114 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:59.269346 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6c8g" podUID="2380f825-9675-4295-989c-da0d39abef7f" Jun 11 19:53:59.270114 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.269772 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 19:53:59.270114 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.269869 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 19:53:59.270685 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.270653 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 19:53:59.273674 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.271408 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zjpp2\"" Jun 11 19:53:59.273674 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.271865 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-86vvn" Jun 11 19:53:59.273674 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.272904 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.274187 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.274145 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 19:53:59.274504 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.274280 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 19:53:59.274504 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.274304 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:53:59.274504 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.274360 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pr9jn\"" Jun 11 19:53:59.275036 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.275013 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 19:53:59.275171 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.275150 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 19:53:59.275516 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.275495 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 19:53:59.275604 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.275586 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-k4jkl\"" Jun 11 19:53:59.275800 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.275518 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:53:59.275895 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:59.275868 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64f8l" podUID="2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a" Jun 11 19:53:59.276544 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.276525 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-znbfc" Jun 11 19:53:59.277872 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.277854 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:53:59.277954 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:59.277920 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8x8n" podUID="66f02d7a-34af-41ed-b9d1-ebc61a648224" Jun 11 19:53:59.278596 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.278579 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 19:53:59.278726 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.278710 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xs6fk\"" Jun 11 19:53:59.278821 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.278760 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 19:53:59.280185 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280163 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret\") pod \"global-pull-secret-syncer-r6c8g\" (UID: \"2380f825-9675-4295-989c-da0d39abef7f\") " pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:53:59.280274 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280196 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-modprobe-d\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.280274 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280219 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-host\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.280274 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280257 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5156a24a-e2d9-46dd-b1c7-9c732abae909-env-overrides\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.280428 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280326 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tmqm\" (UniqueName: \"kubernetes.io/projected/5156a24a-e2d9-46dd-b1c7-9c732abae909-kube-api-access-6tmqm\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.280428 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280366 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6wg9\" (UniqueName: \"kubernetes.io/projected/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-kube-api-access-k6wg9\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.280428 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280395 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b7199ae-2384-40a9-ac35-f185dcce8701-tmp-dir\") pod \"node-resolver-rkxzl\" (UID: \"9b7199ae-2384-40a9-ac35-f185dcce8701\") " pod="openshift-dns/node-resolver-rkxzl" Jun 11 19:53:59.280559 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280416 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-kubernetes\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.280559 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280454 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-host-run-multus-certs\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.280559 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280477 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b7199ae-2384-40a9-ac35-f185dcce8701-hosts-file\") pod \"node-resolver-rkxzl\" (UID: \"9b7199ae-2384-40a9-ac35-f185dcce8701\") " pod="openshift-dns/node-resolver-rkxzl" Jun 11 19:53:59.280559 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280514 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-kubelet\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.280559 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280547 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-host-var-lib-cni-bin\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.280773 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280571 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-host-var-lib-cni-multus\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.280773 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-var-lib-kubelet\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.280773 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280637 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b90848b-570f-48f8-8d5a-fba8d9f7d967-tmp\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.280773 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280661 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-run-netns\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.280773 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280696 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-run-systemd\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.280773 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280728 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-multus-socket-dir-parent\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.280773 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280751 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ad4cb0c0-3045-4129-a116-d02b9e1dfd57-serviceca\") pod \"node-ca-bk68w\" (UID: \"ad4cb0c0-3045-4129-a116-d02b9e1dfd57\") " pod="openshift-image-registry/node-ca-bk68w" Jun 11 19:53:59.281163 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280773 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.281163 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280816 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-os-release\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.281163 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280839 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-cni-binary-copy\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.281163 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280871 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.281163 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280897 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-sysconfig\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.281163 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280918 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-hostroot\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.281163 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280940 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2380f825-9675-4295-989c-da0d39abef7f-kubelet-config\") pod \"global-pull-secret-syncer-r6c8g\" (UID: \"2380f825-9675-4295-989c-da0d39abef7f\") " pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:53:59.281163 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.280961 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2380f825-9675-4295-989c-da0d39abef7f-dbus\") pod \"global-pull-secret-syncer-r6c8g\" (UID: \"2380f825-9675-4295-989c-da0d39abef7f\") " pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:53:59.281163 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281020 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-systemd\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.281163 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281050 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-sys\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.281163 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281071 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-run-ovn\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.281163 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281110 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-host-var-lib-kubelet\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.281163 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281140 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-run\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.281730 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281170 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-run-ovn-kubernetes\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.281730 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281202 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-cni-netd\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.281730 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281224 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5156a24a-e2d9-46dd-b1c7-9c732abae909-ovn-node-metrics-cert\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.281730 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281247 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-system-cni-dir\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.281730 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281280 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-multus-cni-dir\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.281730 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281304 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d92509a-3188-4c30-a2ee-882a29775c92-cni-binary-copy\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.281730 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281281 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 19:53:59.281730 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281330 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d92509a-3188-4c30-a2ee-882a29775c92-multus-daemon-config\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.281730 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbngn\" (UniqueName: \"kubernetes.io/projected/2d92509a-3188-4c30-a2ee-882a29775c92-kube-api-access-rbngn\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.281730 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281405 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-cni-bin\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.281730 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281441 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.281730 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281465 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhxb7\" (UniqueName: \"kubernetes.io/projected/9b7199ae-2384-40a9-ac35-f185dcce8701-kube-api-access-mhxb7\") pod \"node-resolver-rkxzl\" (UID: \"9b7199ae-2384-40a9-ac35-f185dcce8701\") " pod="openshift-dns/node-resolver-rkxzl" Jun 11 19:53:59.281730 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-sysctl-conf\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.281730 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281558 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-node-log\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.281730 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281595 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-cnibin\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.281730 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281619 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-host-run-k8s-cni-cncf-io\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.281730 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281671 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-sysctl-d\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.282325 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281729 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-slash\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.282325 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281755 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5156a24a-e2d9-46dd-b1c7-9c732abae909-ovnkube-script-lib\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.282325 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281779 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-os-release\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.282325 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281816 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad4cb0c0-3045-4129-a116-d02b9e1dfd57-host\") pod \"node-ca-bk68w\" (UID: \"ad4cb0c0-3045-4129-a116-d02b9e1dfd57\") " pod="openshift-image-registry/node-ca-bk68w" Jun 11 19:53:59.282325 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281837 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-systemd-units\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.282325 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281859 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-etc-openvswitch\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.282325 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281880 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.282325 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281901 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-host-run-netns\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.282325 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281927 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7zh9\" (UniqueName: \"kubernetes.io/projected/8b90848b-570f-48f8-8d5a-fba8d9f7d967-kube-api-access-z7zh9\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.282325 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281956 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz88w\" (UniqueName: \"kubernetes.io/projected/ad4cb0c0-3045-4129-a116-d02b9e1dfd57-kube-api-access-mz88w\") pod \"node-ca-bk68w\" (UID: \"ad4cb0c0-3045-4129-a116-d02b9e1dfd57\") " pod="openshift-image-registry/node-ca-bk68w" Jun 11 19:53:59.282325 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.281982 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-lib-modules\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.282325 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.282003 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5156a24a-e2d9-46dd-b1c7-9c732abae909-ovnkube-config\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.282325 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.282024 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-tuned\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.282325 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.282047 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-var-lib-openvswitch\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.282325 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.282069 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-system-cni-dir\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.282325 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.282104 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-cnibin\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.282899 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.282136 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-multus-conf-dir\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.282899 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.282169 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-etc-kubernetes\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.282899 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.282195 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-run-openvswitch\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.282899 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.282216 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-log-socket\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.300778 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.300758 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xbgs9" Jun 11 19:53:59.307916 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.307898 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xbgs9" Jun 11 19:53:59.369698 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.369675 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 19:53:59.382779 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.382758 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-system-cni-dir\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.382897 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.382817 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-cnibin\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.382897 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.382844 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-multus-conf-dir\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.382897 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.382856 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-system-cni-dir\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.382897 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.382858 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-etc-kubernetes\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.382897 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.382897 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-etc-kubernetes\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.383086 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.382907 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-run-openvswitch\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.383086 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.382911 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-cnibin\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.383086 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.382924 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-multus-conf-dir\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.383086 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.382932 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-log-socket\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.383086 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.382966 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/69d115a5-e475-4cf9-a878-5eb234c91974-agent-certs\") pod \"konnectivity-agent-znbfc\" (UID: \"69d115a5-e475-4cf9-a878-5eb234c91974\") " pod="kube-system/konnectivity-agent-znbfc" Jun 11 19:53:59.383086 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.382971 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-log-socket\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.383086 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.382966 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-run-openvswitch\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.383086 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.382991 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrxqj\" (UniqueName: \"kubernetes.io/projected/66f02d7a-34af-41ed-b9d1-ebc61a648224-kube-api-access-jrxqj\") pod \"network-metrics-daemon-z8x8n\" (UID: \"66f02d7a-34af-41ed-b9d1-ebc61a648224\") " pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:53:59.383086 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383014 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret\") pod \"global-pull-secret-syncer-r6c8g\" (UID: \"2380f825-9675-4295-989c-da0d39abef7f\") " pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:53:59.383086 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383032 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-modprobe-d\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.383541 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:59.383115 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:53:59.383541 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383147 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-host\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.383541 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:59.383251 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret podName:2380f825-9675-4295-989c-da0d39abef7f nodeName:}" failed. No retries permitted until 2026-06-11 19:53:59.883222678 +0000 UTC m=+2.914939316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret") pod "global-pull-secret-syncer-r6c8g" (UID: "2380f825-9675-4295-989c-da0d39abef7f") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:53:59.383541 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383276 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-modprobe-d\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.383541 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383059 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-host\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.383541 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383495 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5156a24a-e2d9-46dd-b1c7-9c732abae909-env-overrides\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.383541 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383515 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tmqm\" (UniqueName: \"kubernetes.io/projected/5156a24a-e2d9-46dd-b1c7-9c732abae909-kube-api-access-6tmqm\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.383908 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383552 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6wg9\" (UniqueName: \"kubernetes.io/projected/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-kube-api-access-k6wg9\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.383908 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383568 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b7199ae-2384-40a9-ac35-f185dcce8701-tmp-dir\") pod \"node-resolver-rkxzl\" (UID: \"9b7199ae-2384-40a9-ac35-f185dcce8701\") " pod="openshift-dns/node-resolver-rkxzl" Jun 11 19:53:59.383908 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383631 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-kubernetes\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.383908 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383682 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-host-run-multus-certs\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.383908 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383708 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b7199ae-2384-40a9-ac35-f185dcce8701-hosts-file\") pod \"node-resolver-rkxzl\" (UID: \"9b7199ae-2384-40a9-ac35-f185dcce8701\") " pod="openshift-dns/node-resolver-rkxzl" Jun 11 19:53:59.383908 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383731 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-kubelet\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.383908 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383758 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dbfc964a-cea6-40c4-8fea-7e3965f24394-device-dir\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.383908 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383761 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-kubernetes\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.383908 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383801 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-host-var-lib-cni-bin\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.383908 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383839 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-host-var-lib-cni-multus\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.383908 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383846 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-host-var-lib-cni-bin\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.383908 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383867 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-var-lib-kubelet\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.383908 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383888 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-kubelet\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.383908 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383890 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b7199ae-2384-40a9-ac35-f185dcce8701-hosts-file\") pod \"node-resolver-rkxzl\" (UID: \"9b7199ae-2384-40a9-ac35-f185dcce8701\") " pod="openshift-dns/node-resolver-rkxzl" Jun 11 19:53:59.384557 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383925 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b90848b-570f-48f8-8d5a-fba8d9f7d967-tmp\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.384557 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383949 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-host-var-lib-cni-multus\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.384557 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383951 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-host-run-multus-certs\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.384557 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383905 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b7199ae-2384-40a9-ac35-f185dcce8701-tmp-dir\") pod \"node-resolver-rkxzl\" (UID: \"9b7199ae-2384-40a9-ac35-f185dcce8701\") " pod="openshift-dns/node-resolver-rkxzl" Jun 11 19:53:59.384557 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383965 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-var-lib-kubelet\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.384557 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383952 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-run-netns\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.384557 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383991 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-run-netns\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.384557 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.383999 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5156a24a-e2d9-46dd-b1c7-9c732abae909-env-overrides\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.384557 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384005 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-run-systemd\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.384557 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384033 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dbfc964a-cea6-40c4-8fea-7e3965f24394-socket-dir\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.384557 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384051 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-run-systemd\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.384557 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384078 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-multus-socket-dir-parent\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.384557 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384126 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-multus-socket-dir-parent\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.384557 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384122 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn7vw\" (UniqueName: \"kubernetes.io/projected/dbfc964a-cea6-40c4-8fea-7e3965f24394-kube-api-access-mn7vw\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.384557 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384167 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ad4cb0c0-3045-4129-a116-d02b9e1dfd57-serviceca\") pod \"node-ca-bk68w\" (UID: \"ad4cb0c0-3045-4129-a116-d02b9e1dfd57\") " pod="openshift-image-registry/node-ca-bk68w" Jun 11 19:53:59.384557 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384212 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 19:53:59.384557 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.384557 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384260 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-os-release\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.385446 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384310 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.385446 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384362 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-os-release\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.385446 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384383 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-cni-binary-copy\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.385446 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.385446 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-sysconfig\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.385446 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384505 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-hostroot\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.385446 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384555 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2380f825-9675-4295-989c-da0d39abef7f-kubelet-config\") pod \"global-pull-secret-syncer-r6c8g\" (UID: \"2380f825-9675-4295-989c-da0d39abef7f\") " pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:53:59.385446 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384564 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-sysconfig\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.385446 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384589 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ad4cb0c0-3045-4129-a116-d02b9e1dfd57-serviceca\") pod \"node-ca-bk68w\" (UID: \"ad4cb0c0-3045-4129-a116-d02b9e1dfd57\") " pod="openshift-image-registry/node-ca-bk68w" Jun 11 19:53:59.385446 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384594 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-hostroot\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.385446 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384621 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2380f825-9675-4295-989c-da0d39abef7f-dbus\") pod \"global-pull-secret-syncer-r6c8g\" (UID: \"2380f825-9675-4295-989c-da0d39abef7f\") " pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:53:59.385446 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384646 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-systemd\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.385446 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384667 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-sys\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.385446 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384623 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2380f825-9675-4295-989c-da0d39abef7f-kubelet-config\") pod \"global-pull-secret-syncer-r6c8g\" (UID: \"2380f825-9675-4295-989c-da0d39abef7f\") " pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:53:59.385446 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384722 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-systemd\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.385446 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384738 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2380f825-9675-4295-989c-da0d39abef7f-dbus\") pod \"global-pull-secret-syncer-r6c8g\" (UID: \"2380f825-9675-4295-989c-da0d39abef7f\") " pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:53:59.385446 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384718 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-run-ovn\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.385446 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384776 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-sys\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.386322 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384826 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-run-ovn\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.386322 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.384830 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e6c158ce-0ce1-45e7-b1c9-373ccaa23e19-iptables-alerter-script\") pod \"iptables-alerter-86vvn\" (UID: \"e6c158ce-0ce1-45e7-b1c9-373ccaa23e19\") " pod="openshift-network-operator/iptables-alerter-86vvn" Jun 11 19:53:59.386322 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385004 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-cni-binary-copy\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.386322 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385081 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.386322 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385100 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-host-var-lib-kubelet\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.386322 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385322 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-host-var-lib-kubelet\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.386322 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385344 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-run\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.386322 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385363 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-run-ovn-kubernetes\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.386322 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385378 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-cni-netd\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.386322 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385393 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5156a24a-e2d9-46dd-b1c7-9c732abae909-ovn-node-metrics-cert\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.386322 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385408 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd98k\" (UniqueName: \"kubernetes.io/projected/e6c158ce-0ce1-45e7-b1c9-373ccaa23e19-kube-api-access-zd98k\") pod \"iptables-alerter-86vvn\" (UID: \"e6c158ce-0ce1-45e7-b1c9-373ccaa23e19\") " pod="openshift-network-operator/iptables-alerter-86vvn" Jun 11 19:53:59.386322 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dbfc964a-cea6-40c4-8fea-7e3965f24394-sys-fs\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.386322 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385435 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/69d115a5-e475-4cf9-a878-5eb234c91974-konnectivity-ca\") pod \"konnectivity-agent-znbfc\" (UID: \"69d115a5-e475-4cf9-a878-5eb234c91974\") " pod="kube-system/konnectivity-agent-znbfc" Jun 11 19:53:59.386322 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-system-cni-dir\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.386322 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-multus-cni-dir\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.386322 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385484 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d92509a-3188-4c30-a2ee-882a29775c92-cni-binary-copy\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.386322 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385497 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d92509a-3188-4c30-a2ee-882a29775c92-multus-daemon-config\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.387127 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385511 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbngn\" (UniqueName: \"kubernetes.io/projected/2d92509a-3188-4c30-a2ee-882a29775c92-kube-api-access-rbngn\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.387127 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385526 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-cni-bin\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.387127 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385552 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.387127 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385568 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhxb7\" (UniqueName: \"kubernetes.io/projected/9b7199ae-2384-40a9-ac35-f185dcce8701-kube-api-access-mhxb7\") pod \"node-resolver-rkxzl\" (UID: \"9b7199ae-2384-40a9-ac35-f185dcce8701\") " pod="openshift-dns/node-resolver-rkxzl" Jun 11 19:53:59.387127 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385582 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-sysctl-conf\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.387127 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385596 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-node-log\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.387127 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385609 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e6c158ce-0ce1-45e7-b1c9-373ccaa23e19-host-slash\") pod \"iptables-alerter-86vvn\" (UID: \"e6c158ce-0ce1-45e7-b1c9-373ccaa23e19\") " pod="openshift-network-operator/iptables-alerter-86vvn" Jun 11 19:53:59.387127 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385624 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-cnibin\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.387127 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385636 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-host-run-k8s-cni-cncf-io\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.387127 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385649 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-sysctl-d\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.387127 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385664 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-slash\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.387127 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385678 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5156a24a-e2d9-46dd-b1c7-9c732abae909-ovnkube-script-lib\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.387127 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385692 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9ccx\" (UniqueName: \"kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx\") pod \"network-check-target-64f8l\" (UID: \"2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a\") " pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:53:59.387127 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385706 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-os-release\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.387127 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385718 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad4cb0c0-3045-4129-a116-d02b9e1dfd57-host\") pod \"node-ca-bk68w\" (UID: \"ad4cb0c0-3045-4129-a116-d02b9e1dfd57\") " pod="openshift-image-registry/node-ca-bk68w" Jun 11 19:53:59.387127 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385731 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-systemd-units\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.387127 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385745 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-etc-openvswitch\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.387974 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385759 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.387974 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385774 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs\") pod \"network-metrics-daemon-z8x8n\" (UID: \"66f02d7a-34af-41ed-b9d1-ebc61a648224\") " pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:53:59.387974 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-host-run-netns\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.387974 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385825 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7zh9\" (UniqueName: \"kubernetes.io/projected/8b90848b-570f-48f8-8d5a-fba8d9f7d967-kube-api-access-z7zh9\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.387974 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385840 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz88w\" (UniqueName: \"kubernetes.io/projected/ad4cb0c0-3045-4129-a116-d02b9e1dfd57-kube-api-access-mz88w\") pod \"node-ca-bk68w\" (UID: \"ad4cb0c0-3045-4129-a116-d02b9e1dfd57\") " pod="openshift-image-registry/node-ca-bk68w" Jun 11 19:53:59.387974 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385853 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dbfc964a-cea6-40c4-8fea-7e3965f24394-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.387974 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385866 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dbfc964a-cea6-40c4-8fea-7e3965f24394-registration-dir\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.387974 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385880 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-lib-modules\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.387974 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385894 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5156a24a-e2d9-46dd-b1c7-9c732abae909-ovnkube-config\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.387974 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385907 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dbfc964a-cea6-40c4-8fea-7e3965f24394-etc-selinux\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.387974 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385923 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-tuned\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.387974 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.385960 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-var-lib-openvswitch\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.387974 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.386010 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-var-lib-openvswitch\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.387974 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.386043 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-run\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.387974 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.386064 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-run-ovn-kubernetes\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.387974 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.386084 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-cni-netd\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.387974 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.387249 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-slash\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.388764 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.387423 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-system-cni-dir\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.388764 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.387462 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad4cb0c0-3045-4129-a116-d02b9e1dfd57-host\") pod \"node-ca-bk68w\" (UID: \"ad4cb0c0-3045-4129-a116-d02b9e1dfd57\") " pod="openshift-image-registry/node-ca-bk68w" Jun 11 19:53:59.388764 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.387700 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5156a24a-e2d9-46dd-b1c7-9c732abae909-ovnkube-config\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.388764 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.387917 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b90848b-570f-48f8-8d5a-fba8d9f7d967-tmp\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.388764 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.388140 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-sysctl-d\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.388764 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.388256 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-os-release\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.388764 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.388461 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5156a24a-e2d9-46dd-b1c7-9c732abae909-ovnkube-script-lib\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.388764 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.388462 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-multus-cni-dir\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.388764 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.388581 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-sysctl-conf\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.388764 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.388605 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-etc-openvswitch\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.389263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.388841 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b90848b-570f-48f8-8d5a-fba8d9f7d967-lib-modules\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.389263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.388870 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-systemd-units\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.389263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.388905 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-host-cni-bin\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.389263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.388960 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.389263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.388961 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-cnibin\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.389263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.389088 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5156a24a-e2d9-46dd-b1c7-9c732abae909-ovn-node-metrics-cert\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.389263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.389114 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d92509a-3188-4c30-a2ee-882a29775c92-cni-binary-copy\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.389263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.389112 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5156a24a-e2d9-46dd-b1c7-9c732abae909-node-log\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.389263 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.389185 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-host-run-netns\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.389674 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.389401 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d92509a-3188-4c30-a2ee-882a29775c92-multus-daemon-config\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.389674 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.389444 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d92509a-3188-4c30-a2ee-882a29775c92-host-run-k8s-cni-cncf-io\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.390025 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.389998 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.392868 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.392803 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b90848b-570f-48f8-8d5a-fba8d9f7d967-etc-tuned\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.393951 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.393922 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6wg9\" (UniqueName: \"kubernetes.io/projected/b93e7c70-5b9e-4e86-9bbc-9e26931413d8-kube-api-access-k6wg9\") pod \"multus-additional-cni-plugins-qff5g\" (UID: \"b93e7c70-5b9e-4e86-9bbc-9e26931413d8\") " pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.394381 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.394156 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tmqm\" (UniqueName: \"kubernetes.io/projected/5156a24a-e2d9-46dd-b1c7-9c732abae909-kube-api-access-6tmqm\") pod \"ovnkube-node-2l9v4\" (UID: \"5156a24a-e2d9-46dd-b1c7-9c732abae909\") " pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.397461 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.397439 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz88w\" (UniqueName: \"kubernetes.io/projected/ad4cb0c0-3045-4129-a116-d02b9e1dfd57-kube-api-access-mz88w\") pod \"node-ca-bk68w\" (UID: \"ad4cb0c0-3045-4129-a116-d02b9e1dfd57\") " pod="openshift-image-registry/node-ca-bk68w" Jun 11 19:53:59.397580 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.397558 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhxb7\" (UniqueName: \"kubernetes.io/projected/9b7199ae-2384-40a9-ac35-f185dcce8701-kube-api-access-mhxb7\") pod \"node-resolver-rkxzl\" (UID: \"9b7199ae-2384-40a9-ac35-f185dcce8701\") " pod="openshift-dns/node-resolver-rkxzl" Jun 11 19:53:59.397698 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.397679 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7zh9\" (UniqueName: \"kubernetes.io/projected/8b90848b-570f-48f8-8d5a-fba8d9f7d967-kube-api-access-z7zh9\") pod \"tuned-t9tsm\" (UID: \"8b90848b-570f-48f8-8d5a-fba8d9f7d967\") " pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.398597 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.398580 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbngn\" (UniqueName: \"kubernetes.io/projected/2d92509a-3188-4c30-a2ee-882a29775c92-kube-api-access-rbngn\") pod \"multus-bd2tp\" (UID: \"2d92509a-3188-4c30-a2ee-882a29775c92\") " pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.486927 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.486896 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/69d115a5-e475-4cf9-a878-5eb234c91974-agent-certs\") pod \"konnectivity-agent-znbfc\" (UID: \"69d115a5-e475-4cf9-a878-5eb234c91974\") " pod="kube-system/konnectivity-agent-znbfc" Jun 11 19:53:59.487091 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.486932 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrxqj\" (UniqueName: \"kubernetes.io/projected/66f02d7a-34af-41ed-b9d1-ebc61a648224-kube-api-access-jrxqj\") pod \"network-metrics-daemon-z8x8n\" (UID: \"66f02d7a-34af-41ed-b9d1-ebc61a648224\") " pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:53:59.487157 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487089 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dbfc964a-cea6-40c4-8fea-7e3965f24394-device-dir\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.487157 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487136 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dbfc964a-cea6-40c4-8fea-7e3965f24394-socket-dir\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.487157 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487153 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn7vw\" (UniqueName: \"kubernetes.io/projected/dbfc964a-cea6-40c4-8fea-7e3965f24394-kube-api-access-mn7vw\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.487307 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487174 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dbfc964a-cea6-40c4-8fea-7e3965f24394-device-dir\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.487307 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487186 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e6c158ce-0ce1-45e7-b1c9-373ccaa23e19-iptables-alerter-script\") pod \"iptables-alerter-86vvn\" (UID: \"e6c158ce-0ce1-45e7-b1c9-373ccaa23e19\") " pod="openshift-network-operator/iptables-alerter-86vvn" Jun 11 19:53:59.487307 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487236 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd98k\" (UniqueName: \"kubernetes.io/projected/e6c158ce-0ce1-45e7-b1c9-373ccaa23e19-kube-api-access-zd98k\") pod \"iptables-alerter-86vvn\" (UID: \"e6c158ce-0ce1-45e7-b1c9-373ccaa23e19\") " pod="openshift-network-operator/iptables-alerter-86vvn" Jun 11 19:53:59.487307 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487267 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dbfc964a-cea6-40c4-8fea-7e3965f24394-sys-fs\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.487307 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487287 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dbfc964a-cea6-40c4-8fea-7e3965f24394-socket-dir\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.487550 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/69d115a5-e475-4cf9-a878-5eb234c91974-konnectivity-ca\") pod \"konnectivity-agent-znbfc\" (UID: \"69d115a5-e475-4cf9-a878-5eb234c91974\") " pod="kube-system/konnectivity-agent-znbfc" Jun 11 19:53:59.487550 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487494 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e6c158ce-0ce1-45e7-b1c9-373ccaa23e19-host-slash\") pod \"iptables-alerter-86vvn\" (UID: \"e6c158ce-0ce1-45e7-b1c9-373ccaa23e19\") " pod="openshift-network-operator/iptables-alerter-86vvn" Jun 11 19:53:59.487550 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487531 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9ccx\" (UniqueName: \"kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx\") pod \"network-check-target-64f8l\" (UID: \"2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a\") " pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:53:59.487695 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487555 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dbfc964a-cea6-40c4-8fea-7e3965f24394-sys-fs\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.487695 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487563 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs\") pod \"network-metrics-daemon-z8x8n\" (UID: \"66f02d7a-34af-41ed-b9d1-ebc61a648224\") " pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:53:59.487695 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487593 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dbfc964a-cea6-40c4-8fea-7e3965f24394-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.487695 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487609 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dbfc964a-cea6-40c4-8fea-7e3965f24394-registration-dir\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.487695 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dbfc964a-cea6-40c4-8fea-7e3965f24394-etc-selinux\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.487695 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:59.487636 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:53:59.487695 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:59.487700 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs podName:66f02d7a-34af-41ed-b9d1-ebc61a648224 nodeName:}" failed. No retries permitted until 2026-06-11 19:53:59.9876809 +0000 UTC m=+3.019397524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs") pod "network-metrics-daemon-z8x8n" (UID: "66f02d7a-34af-41ed-b9d1-ebc61a648224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:53:59.488042 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487700 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dbfc964a-cea6-40c4-8fea-7e3965f24394-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.488042 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487707 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e6c158ce-0ce1-45e7-b1c9-373ccaa23e19-iptables-alerter-script\") pod \"iptables-alerter-86vvn\" (UID: \"e6c158ce-0ce1-45e7-b1c9-373ccaa23e19\") " pod="openshift-network-operator/iptables-alerter-86vvn" Jun 11 19:53:59.488042 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487762 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dbfc964a-cea6-40c4-8fea-7e3965f24394-etc-selinux\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.488042 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487770 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dbfc964a-cea6-40c4-8fea-7e3965f24394-registration-dir\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.488042 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487810 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/69d115a5-e475-4cf9-a878-5eb234c91974-konnectivity-ca\") pod \"konnectivity-agent-znbfc\" (UID: \"69d115a5-e475-4cf9-a878-5eb234c91974\") " pod="kube-system/konnectivity-agent-znbfc" Jun 11 19:53:59.488042 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.487831 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e6c158ce-0ce1-45e7-b1c9-373ccaa23e19-host-slash\") pod \"iptables-alerter-86vvn\" (UID: \"e6c158ce-0ce1-45e7-b1c9-373ccaa23e19\") " pod="openshift-network-operator/iptables-alerter-86vvn" Jun 11 19:53:59.489826 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.489806 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/69d115a5-e475-4cf9-a878-5eb234c91974-agent-certs\") pod \"konnectivity-agent-znbfc\" (UID: \"69d115a5-e475-4cf9-a878-5eb234c91974\") " pod="kube-system/konnectivity-agent-znbfc" Jun 11 19:53:59.495324 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:59.495301 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:53:59.495324 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:59.495324 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:53:59.495475 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:59.495333 2564 projected.go:196] Error preparing data for projected volume kube-api-access-j9ccx for pod openshift-network-diagnostics/network-check-target-64f8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:53:59.495475 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:59.495380 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx podName:2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a nodeName:}" failed. No retries permitted until 2026-06-11 19:53:59.995366843 +0000 UTC m=+3.027083474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j9ccx" (UniqueName: "kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx") pod "network-check-target-64f8l" (UID: "2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:53:59.497797 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.497757 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn7vw\" (UniqueName: \"kubernetes.io/projected/dbfc964a-cea6-40c4-8fea-7e3965f24394-kube-api-access-mn7vw\") pod \"aws-ebs-csi-driver-node-cwdm8\" (UID: \"dbfc964a-cea6-40c4-8fea-7e3965f24394\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.499266 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.499248 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd98k\" (UniqueName: \"kubernetes.io/projected/e6c158ce-0ce1-45e7-b1c9-373ccaa23e19-kube-api-access-zd98k\") pod \"iptables-alerter-86vvn\" (UID: \"e6c158ce-0ce1-45e7-b1c9-373ccaa23e19\") " pod="openshift-network-operator/iptables-alerter-86vvn" Jun 11 19:53:59.500217 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.500197 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrxqj\" (UniqueName: \"kubernetes.io/projected/66f02d7a-34af-41ed-b9d1-ebc61a648224-kube-api-access-jrxqj\") pod \"network-metrics-daemon-z8x8n\" (UID: \"66f02d7a-34af-41ed-b9d1-ebc61a648224\") " pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:53:59.573458 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.573391 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bd2tp" Jun 11 19:53:59.583273 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.583250 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" Jun 11 19:53:59.590648 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.590627 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rkxzl" Jun 11 19:53:59.596093 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.596061 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bk68w" Jun 11 19:53:59.602645 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.602627 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:53:59.609528 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.609507 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qff5g" Jun 11 19:53:59.617538 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.617519 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-86vvn" Jun 11 19:53:59.622230 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.622205 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:53:59.624221 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.624201 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" Jun 11 19:53:59.629931 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.629915 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-znbfc" Jun 11 19:53:59.890635 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.890552 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret\") pod \"global-pull-secret-syncer-r6c8g\" (UID: \"2380f825-9675-4295-989c-da0d39abef7f\") " pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:53:59.890779 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:59.890672 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:53:59.890779 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:59.890734 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret podName:2380f825-9675-4295-989c-da0d39abef7f nodeName:}" failed. No retries permitted until 2026-06-11 19:54:00.890718239 +0000 UTC m=+3.922434872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret") pod "global-pull-secret-syncer-r6c8g" (UID: "2380f825-9675-4295-989c-da0d39abef7f") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:53:59.990960 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:53:59.990927 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs\") pod \"network-metrics-daemon-z8x8n\" (UID: \"66f02d7a-34af-41ed-b9d1-ebc61a648224\") " pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:53:59.991105 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:59.991027 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:53:59.991105 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:53:59.991085 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs podName:66f02d7a-34af-41ed-b9d1-ebc61a648224 nodeName:}" failed. No retries permitted until 2026-06-11 19:54:00.991066872 +0000 UTC m=+4.022783507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs") pod "network-metrics-daemon-z8x8n" (UID: "66f02d7a-34af-41ed-b9d1-ebc61a648224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:54:00.023812 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:54:00.023715 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69d115a5_e475_4cf9_a878_5eb234c91974.slice/crio-bf103f91fb35c89cb536fa2dc8d1cd2bb6eefe8849d1750fb36793dc40c8e555 WatchSource:0}: Error finding container bf103f91fb35c89cb536fa2dc8d1cd2bb6eefe8849d1750fb36793dc40c8e555: Status 404 returned error can't find the container with id bf103f91fb35c89cb536fa2dc8d1cd2bb6eefe8849d1750fb36793dc40c8e555 Jun 11 19:54:00.024958 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:54:00.024926 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d92509a_3188_4c30_a2ee_882a29775c92.slice/crio-12438f9dc165e3277a050973d62ab49d382339812a5224d4018bbceaed5b6f7c WatchSource:0}: Error finding container 12438f9dc165e3277a050973d62ab49d382339812a5224d4018bbceaed5b6f7c: Status 404 returned error can't find the container with id 12438f9dc165e3277a050973d62ab49d382339812a5224d4018bbceaed5b6f7c Jun 11 19:54:00.026491 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:54:00.026329 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbfc964a_cea6_40c4_8fea_7e3965f24394.slice/crio-282958155a93bcf21d3ac556ed02dd623b48c182010e989061e59acc23b990d9 WatchSource:0}: Error finding container 282958155a93bcf21d3ac556ed02dd623b48c182010e989061e59acc23b990d9: Status 404 returned error can't find the container with id 282958155a93bcf21d3ac556ed02dd623b48c182010e989061e59acc23b990d9 Jun 11 19:54:00.029114 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:54:00.029075 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6c158ce_0ce1_45e7_b1c9_373ccaa23e19.slice/crio-2be97df5f31d126ecb5a1a397cd7e7fb4447d48001fa46af4e9f75537730259a WatchSource:0}: Error finding container 2be97df5f31d126ecb5a1a397cd7e7fb4447d48001fa46af4e9f75537730259a: Status 404 returned error can't find the container with id 2be97df5f31d126ecb5a1a397cd7e7fb4447d48001fa46af4e9f75537730259a Jun 11 19:54:00.029839 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:54:00.029811 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5156a24a_e2d9_46dd_b1c7_9c732abae909.slice/crio-1a74fd9b1e6827980bc0dd379a4615f0811e326ddccdc70ec7a810fc186d45a3 WatchSource:0}: Error finding container 1a74fd9b1e6827980bc0dd379a4615f0811e326ddccdc70ec7a810fc186d45a3: Status 404 returned error can't find the container with id 1a74fd9b1e6827980bc0dd379a4615f0811e326ddccdc70ec7a810fc186d45a3 Jun 11 19:54:00.031093 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:54:00.030973 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad4cb0c0_3045_4129_a116_d02b9e1dfd57.slice/crio-500cdd6145ee14420d67dbfb1821b63abf4190fe4c91cb70f398dc18e7788d9b WatchSource:0}: Error finding container 500cdd6145ee14420d67dbfb1821b63abf4190fe4c91cb70f398dc18e7788d9b: Status 404 returned error can't find the container with id 500cdd6145ee14420d67dbfb1821b63abf4190fe4c91cb70f398dc18e7788d9b Jun 11 19:54:00.031338 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:54:00.031256 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b7199ae_2384_40a9_ac35_f185dcce8701.slice/crio-4e786cc4ad23c3bf5130638f4e145dd0d36ab4db8b304c7c19f0a61849f090c9 WatchSource:0}: Error finding container 4e786cc4ad23c3bf5130638f4e145dd0d36ab4db8b304c7c19f0a61849f090c9: Status 404 returned error can't find the container with id 4e786cc4ad23c3bf5130638f4e145dd0d36ab4db8b304c7c19f0a61849f090c9 Jun 11 19:54:00.092328 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:00.092168 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9ccx\" (UniqueName: \"kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx\") pod \"network-check-target-64f8l\" (UID: \"2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a\") " pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:00.092434 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:00.092335 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:54:00.092434 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:00.092361 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:54:00.092434 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:00.092374 2564 projected.go:196] Error preparing data for projected volume kube-api-access-j9ccx for pod openshift-network-diagnostics/network-check-target-64f8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:54:00.092582 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:00.092433 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx podName:2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a nodeName:}" failed. No retries permitted until 2026-06-11 19:54:01.092415181 +0000 UTC m=+4.124131814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9ccx" (UniqueName: "kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx") pod "network-check-target-64f8l" (UID: "2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:54:00.309625 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:00.309584 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 19:48:59 +0000 UTC" deadline="2027-11-06 20:32:52.991875923 +0000 UTC" Jun 11 19:54:00.309625 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:00.309623 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12312h38m52.682255327s" Jun 11 19:54:00.342997 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:00.342973 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:00.343117 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:00.343093 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8x8n" podUID="66f02d7a-34af-41ed-b9d1-ebc61a648224" Jun 11 19:54:00.351950 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:00.351924 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-znbfc" event={"ID":"69d115a5-e475-4cf9-a878-5eb234c91974","Type":"ContainerStarted","Data":"bf103f91fb35c89cb536fa2dc8d1cd2bb6eefe8849d1750fb36793dc40c8e555"} Jun 11 19:54:00.355182 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:00.355006 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-46.ec2.internal" event={"ID":"c8d2b0ae5364d0f6706b40cc63991a02","Type":"ContainerStarted","Data":"b6559dbf7448cd524f72eef04596f8498749bed1767ab00ed19f93faf2dca82c"} Jun 11 19:54:00.360631 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:00.360581 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" event={"ID":"8b90848b-570f-48f8-8d5a-fba8d9f7d967","Type":"ContainerStarted","Data":"ebce632054f2c262442ab566b14b7ddca173f855d3a878a6b3f43357f95ba2ec"} Jun 11 19:54:00.362481 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:00.362242 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rkxzl" event={"ID":"9b7199ae-2384-40a9-ac35-f185dcce8701","Type":"ContainerStarted","Data":"4e786cc4ad23c3bf5130638f4e145dd0d36ab4db8b304c7c19f0a61849f090c9"} Jun 11 19:54:00.364649 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:00.364410 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" event={"ID":"dbfc964a-cea6-40c4-8fea-7e3965f24394","Type":"ContainerStarted","Data":"282958155a93bcf21d3ac556ed02dd623b48c182010e989061e59acc23b990d9"} Jun 11 19:54:00.366475 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:00.366422 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bd2tp" event={"ID":"2d92509a-3188-4c30-a2ee-882a29775c92","Type":"ContainerStarted","Data":"12438f9dc165e3277a050973d62ab49d382339812a5224d4018bbceaed5b6f7c"} Jun 11 19:54:00.368398 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:00.368377 2564 generic.go:356] "Generic (PLEG): container finished" podID="e98357cd5167f030d353895971d64441" containerID="bf90415060dee6c88f12ada1b5651ca535121d0dc604de283ae1f49370a856dd" exitCode=0 Jun 11 19:54:00.368491 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:00.368445 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal" event={"ID":"e98357cd5167f030d353895971d64441","Type":"ContainerDied","Data":"bf90415060dee6c88f12ada1b5651ca535121d0dc604de283ae1f49370a856dd"} Jun 11 19:54:00.369559 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:00.369507 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-46.ec2.internal" podStartSLOduration=2.369489311 podStartE2EDuration="2.369489311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:53:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:00.368061456 +0000 UTC m=+3.399778095" watchObservedRunningTime="2026-06-11 19:54:00.369489311 +0000 UTC m=+3.401205954" Jun 11 19:54:00.372859 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:00.372829 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qff5g" event={"ID":"b93e7c70-5b9e-4e86-9bbc-9e26931413d8","Type":"ContainerStarted","Data":"dcc41cd9e1832dd1151491f0416f5ad4c2f6677aa61e9018a20e6f7257c8b351"} Jun 11 19:54:00.376215 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:00.376139 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bk68w" event={"ID":"ad4cb0c0-3045-4129-a116-d02b9e1dfd57","Type":"ContainerStarted","Data":"500cdd6145ee14420d67dbfb1821b63abf4190fe4c91cb70f398dc18e7788d9b"} Jun 11 19:54:00.378776 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:00.378695 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" event={"ID":"5156a24a-e2d9-46dd-b1c7-9c732abae909","Type":"ContainerStarted","Data":"1a74fd9b1e6827980bc0dd379a4615f0811e326ddccdc70ec7a810fc186d45a3"} Jun 11 19:54:00.380577 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:00.380529 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-86vvn" event={"ID":"e6c158ce-0ce1-45e7-b1c9-373ccaa23e19","Type":"ContainerStarted","Data":"2be97df5f31d126ecb5a1a397cd7e7fb4447d48001fa46af4e9f75537730259a"} Jun 11 19:54:00.897896 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:00.897808 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret\") pod \"global-pull-secret-syncer-r6c8g\" (UID: \"2380f825-9675-4295-989c-da0d39abef7f\") " pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:00.898067 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:00.897996 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:54:00.898067 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:00.898060 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret podName:2380f825-9675-4295-989c-da0d39abef7f nodeName:}" failed. No retries permitted until 2026-06-11 19:54:02.898042484 +0000 UTC m=+5.929759108 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret") pod "global-pull-secret-syncer-r6c8g" (UID: "2380f825-9675-4295-989c-da0d39abef7f") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:54:00.998384 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:00.998345 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs\") pod \"network-metrics-daemon-z8x8n\" (UID: \"66f02d7a-34af-41ed-b9d1-ebc61a648224\") " pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:00.998572 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:00.998554 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:54:00.998675 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:00.998635 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs podName:66f02d7a-34af-41ed-b9d1-ebc61a648224 nodeName:}" failed. No retries permitted until 2026-06-11 19:54:02.998616646 +0000 UTC m=+6.030333265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs") pod "network-metrics-daemon-z8x8n" (UID: "66f02d7a-34af-41ed-b9d1-ebc61a648224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:54:01.098799 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:01.098749 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9ccx\" (UniqueName: \"kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx\") pod \"network-check-target-64f8l\" (UID: \"2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a\") " pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:01.098977 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:01.098964 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:54:01.099067 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:01.098987 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:54:01.099067 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:01.098999 2564 projected.go:196] Error preparing data for projected volume kube-api-access-j9ccx for pod openshift-network-diagnostics/network-check-target-64f8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:54:01.099067 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:01.099056 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx podName:2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a nodeName:}" failed. No retries permitted until 2026-06-11 19:54:03.099038593 +0000 UTC m=+6.130755231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9ccx" (UniqueName: "kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx") pod "network-check-target-64f8l" (UID: "2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:54:01.310794 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:01.310685 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 19:48:59 +0000 UTC" deadline="2027-12-17 06:19:07.709080925 +0000 UTC" Jun 11 19:54:01.310794 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:01.310727 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13282h25m6.398358655s" Jun 11 19:54:01.345420 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:01.345381 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:01.345580 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:01.345511 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6c8g" podUID="2380f825-9675-4295-989c-da0d39abef7f" Jun 11 19:54:01.346009 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:01.345867 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:01.346009 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:01.345975 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64f8l" podUID="2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a" Jun 11 19:54:01.396009 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:01.395941 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal" event={"ID":"e98357cd5167f030d353895971d64441","Type":"ContainerStarted","Data":"ae568672466ffd49634224ff3d16b13baba4dbf22f939f55706ea10799ce7e74"} Jun 11 19:54:02.342945 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:02.342914 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:02.343414 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:02.343212 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8x8n" podUID="66f02d7a-34af-41ed-b9d1-ebc61a648224" Jun 11 19:54:02.917973 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:02.917867 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret\") pod \"global-pull-secret-syncer-r6c8g\" (UID: \"2380f825-9675-4295-989c-da0d39abef7f\") " pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:02.918144 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:02.918027 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:54:02.918144 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:02.918096 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret podName:2380f825-9675-4295-989c-da0d39abef7f nodeName:}" failed. No retries permitted until 2026-06-11 19:54:06.91807908 +0000 UTC m=+9.949795716 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret") pod "global-pull-secret-syncer-r6c8g" (UID: "2380f825-9675-4295-989c-da0d39abef7f") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:54:03.018813 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:03.018763 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs\") pod \"network-metrics-daemon-z8x8n\" (UID: \"66f02d7a-34af-41ed-b9d1-ebc61a648224\") " pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:03.018983 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:03.018935 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:54:03.019054 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:03.018999 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs podName:66f02d7a-34af-41ed-b9d1-ebc61a648224 nodeName:}" failed. No retries permitted until 2026-06-11 19:54:07.018980985 +0000 UTC m=+10.050697609 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs") pod "network-metrics-daemon-z8x8n" (UID: "66f02d7a-34af-41ed-b9d1-ebc61a648224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:54:03.119921 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:03.119882 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9ccx\" (UniqueName: \"kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx\") pod \"network-check-target-64f8l\" (UID: \"2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a\") " pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:03.120094 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:03.120035 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:54:03.120094 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:03.120050 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:54:03.120094 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:03.120060 2564 projected.go:196] Error preparing data for projected volume kube-api-access-j9ccx for pod openshift-network-diagnostics/network-check-target-64f8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:54:03.120262 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:03.120104 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx podName:2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a nodeName:}" failed. No retries permitted until 2026-06-11 19:54:07.120091823 +0000 UTC m=+10.151808441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9ccx" (UniqueName: "kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx") pod "network-check-target-64f8l" (UID: "2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:54:03.343363 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:03.343281 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:03.345908 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:03.345877 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:03.346049 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:03.346016 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64f8l" podUID="2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a" Jun 11 19:54:03.346286 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:03.346261 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6c8g" podUID="2380f825-9675-4295-989c-da0d39abef7f" Jun 11 19:54:04.342797 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:04.342549 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:04.342797 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:04.342661 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8x8n" podUID="66f02d7a-34af-41ed-b9d1-ebc61a648224" Jun 11 19:54:05.345082 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:05.345052 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:05.345481 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:05.345183 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64f8l" podUID="2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a" Jun 11 19:54:05.345690 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:05.345538 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:05.345690 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:05.345636 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6c8g" podUID="2380f825-9675-4295-989c-da0d39abef7f" Jun 11 19:54:06.342657 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:06.342627 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:06.342868 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:06.342754 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8x8n" podUID="66f02d7a-34af-41ed-b9d1-ebc61a648224" Jun 11 19:54:06.954222 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:06.954187 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret\") pod \"global-pull-secret-syncer-r6c8g\" (UID: \"2380f825-9675-4295-989c-da0d39abef7f\") " pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:06.954663 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:06.954372 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:54:06.954663 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:06.954424 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret podName:2380f825-9675-4295-989c-da0d39abef7f nodeName:}" failed. No retries permitted until 2026-06-11 19:54:14.954411766 +0000 UTC m=+17.986128386 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret") pod "global-pull-secret-syncer-r6c8g" (UID: "2380f825-9675-4295-989c-da0d39abef7f") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:54:07.055438 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:07.055399 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs\") pod \"network-metrics-daemon-z8x8n\" (UID: \"66f02d7a-34af-41ed-b9d1-ebc61a648224\") " pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:07.055599 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:07.055576 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:54:07.055671 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:07.055649 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs podName:66f02d7a-34af-41ed-b9d1-ebc61a648224 nodeName:}" failed. No retries permitted until 2026-06-11 19:54:15.055628529 +0000 UTC m=+18.087345167 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs") pod "network-metrics-daemon-z8x8n" (UID: "66f02d7a-34af-41ed-b9d1-ebc61a648224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:54:07.156000 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:07.155964 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9ccx\" (UniqueName: \"kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx\") pod \"network-check-target-64f8l\" (UID: \"2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a\") " pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:07.156174 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:07.156153 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:54:07.156233 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:07.156183 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:54:07.156233 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:07.156197 2564 projected.go:196] Error preparing data for projected volume kube-api-access-j9ccx for pod openshift-network-diagnostics/network-check-target-64f8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:54:07.156344 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:07.156263 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx podName:2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a nodeName:}" failed. No retries permitted until 2026-06-11 19:54:15.156242335 +0000 UTC m=+18.187958970 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9ccx" (UniqueName: "kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx") pod "network-check-target-64f8l" (UID: "2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:54:07.344010 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:07.343934 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:07.344145 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:07.344058 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64f8l" podUID="2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a" Jun 11 19:54:07.344145 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:07.344119 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:07.344241 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:07.344212 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6c8g" podUID="2380f825-9675-4295-989c-da0d39abef7f" Jun 11 19:54:08.342519 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:08.342483 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:08.342970 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:08.342632 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8x8n" podUID="66f02d7a-34af-41ed-b9d1-ebc61a648224" Jun 11 19:54:09.343356 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:09.343322 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:09.343771 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:09.343334 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:09.343771 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:09.343456 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6c8g" podUID="2380f825-9675-4295-989c-da0d39abef7f" Jun 11 19:54:09.343771 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:09.343539 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64f8l" podUID="2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a" Jun 11 19:54:10.342317 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:10.342282 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:10.342479 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:10.342426 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8x8n" podUID="66f02d7a-34af-41ed-b9d1-ebc61a648224" Jun 11 19:54:11.342979 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:11.342951 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:11.343421 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:11.343078 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6c8g" podUID="2380f825-9675-4295-989c-da0d39abef7f" Jun 11 19:54:11.343421 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:11.343190 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:11.343747 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:11.343633 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64f8l" podUID="2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a" Jun 11 19:54:12.342952 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:12.342923 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:12.343124 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:12.343053 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8x8n" podUID="66f02d7a-34af-41ed-b9d1-ebc61a648224" Jun 11 19:54:13.342603 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:13.342569 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:13.342812 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:13.342675 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64f8l" podUID="2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a" Jun 11 19:54:13.342881 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:13.342830 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:13.342949 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:13.342924 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6c8g" podUID="2380f825-9675-4295-989c-da0d39abef7f" Jun 11 19:54:14.342742 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:14.342707 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:14.343183 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:14.342851 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8x8n" podUID="66f02d7a-34af-41ed-b9d1-ebc61a648224" Jun 11 19:54:15.019259 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:15.019218 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret\") pod \"global-pull-secret-syncer-r6c8g\" (UID: \"2380f825-9675-4295-989c-da0d39abef7f\") " pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:15.019452 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:15.019367 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:54:15.019452 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:15.019428 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret podName:2380f825-9675-4295-989c-da0d39abef7f nodeName:}" failed. No retries permitted until 2026-06-11 19:54:31.01941284 +0000 UTC m=+34.051129474 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret") pod "global-pull-secret-syncer-r6c8g" (UID: "2380f825-9675-4295-989c-da0d39abef7f") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:54:15.120187 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:15.120152 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs\") pod \"network-metrics-daemon-z8x8n\" (UID: \"66f02d7a-34af-41ed-b9d1-ebc61a648224\") " pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:15.120362 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:15.120319 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:54:15.120405 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:15.120395 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs podName:66f02d7a-34af-41ed-b9d1-ebc61a648224 nodeName:}" failed. No retries permitted until 2026-06-11 19:54:31.120373205 +0000 UTC m=+34.152089845 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs") pod "network-metrics-daemon-z8x8n" (UID: "66f02d7a-34af-41ed-b9d1-ebc61a648224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:54:15.220539 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:15.220502 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9ccx\" (UniqueName: \"kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx\") pod \"network-check-target-64f8l\" (UID: \"2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a\") " pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:15.220682 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:15.220640 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:54:15.220682 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:15.220656 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:54:15.220682 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:15.220665 2564 projected.go:196] Error preparing data for projected volume kube-api-access-j9ccx for pod openshift-network-diagnostics/network-check-target-64f8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:54:15.220819 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:15.220721 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx podName:2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a nodeName:}" failed. No retries permitted until 2026-06-11 19:54:31.22070345 +0000 UTC m=+34.252420083 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9ccx" (UniqueName: "kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx") pod "network-check-target-64f8l" (UID: "2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:54:15.343492 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:15.342978 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:15.343492 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:15.343116 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6c8g" podUID="2380f825-9675-4295-989c-da0d39abef7f" Jun 11 19:54:15.343492 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:15.343170 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:15.343492 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:15.343267 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64f8l" podUID="2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a" Jun 11 19:54:16.342825 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:16.342774 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:16.343011 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:16.342933 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8x8n" podUID="66f02d7a-34af-41ed-b9d1-ebc61a648224" Jun 11 19:54:17.345637 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:17.345608 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:17.346092 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:17.345729 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6c8g" podUID="2380f825-9675-4295-989c-da0d39abef7f" Jun 11 19:54:17.346092 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:17.345806 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:17.346092 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:17.345905 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64f8l" podUID="2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a" Jun 11 19:54:18.342816 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:18.342771 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:18.342968 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:18.342926 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8x8n" podUID="66f02d7a-34af-41ed-b9d1-ebc61a648224" Jun 11 19:54:19.346196 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.345884 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:19.346739 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.345900 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:19.346739 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:19.346274 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64f8l" podUID="2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a" Jun 11 19:54:19.346739 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:19.346339 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6c8g" podUID="2380f825-9675-4295-989c-da0d39abef7f" Jun 11 19:54:19.429158 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.429132 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" event={"ID":"dbfc964a-cea6-40c4-8fea-7e3965f24394","Type":"ContainerStarted","Data":"9bc367ca7b5e4fcca7a66c0bd2d829ee016a84654fa6c97603246c99dbc0b869"} Jun 11 19:54:19.430916 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.430891 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bd2tp" event={"ID":"2d92509a-3188-4c30-a2ee-882a29775c92","Type":"ContainerStarted","Data":"09425e9bd5e74a99cf78213052f4fa7b6555ffc38cbed1eb365edf6db5b0476b"} Jun 11 19:54:19.432334 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.432312 2564 generic.go:356] "Generic (PLEG): container finished" podID="b93e7c70-5b9e-4e86-9bbc-9e26931413d8" containerID="667cfd0f06479288ac627288b0d41e3d9e90af16fc31fb3aee162caf17e55f2b" exitCode=0 Jun 11 19:54:19.432427 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.432381 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qff5g" event={"ID":"b93e7c70-5b9e-4e86-9bbc-9e26931413d8","Type":"ContainerDied","Data":"667cfd0f06479288ac627288b0d41e3d9e90af16fc31fb3aee162caf17e55f2b"} Jun 11 19:54:19.433847 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.433751 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bk68w" event={"ID":"ad4cb0c0-3045-4129-a116-d02b9e1dfd57","Type":"ContainerStarted","Data":"ae477eb45fa3391cac9ad991d4a197a05ca7a1ee56cdb907e77f51f6b4e03b70"} Jun 11 19:54:19.436941 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.436920 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" event={"ID":"5156a24a-e2d9-46dd-b1c7-9c732abae909","Type":"ContainerStarted","Data":"48489b8d1ae16cac805ee6b2341d26ab130d8431059f1f657c4071246bd6b0b4"} Jun 11 19:54:19.437088 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.436990 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" event={"ID":"5156a24a-e2d9-46dd-b1c7-9c732abae909","Type":"ContainerStarted","Data":"5f70e3a8dfefe2b0ef3df3278c6d2ad8f10070164338c4c98513c78661ea885e"} Jun 11 19:54:19.437088 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.437038 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" event={"ID":"5156a24a-e2d9-46dd-b1c7-9c732abae909","Type":"ContainerStarted","Data":"0da74dbe701ba65952a6904e8dd0bf6d2c80dcf891682e1139cbf90f7e427150"} Jun 11 19:54:19.437202 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.437089 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" event={"ID":"5156a24a-e2d9-46dd-b1c7-9c732abae909","Type":"ContainerStarted","Data":"98624f8eb20f79f90ed9b8a7148dd6034ec7e37bb001c14c18a92c5882bbd3ab"} Jun 11 19:54:19.437202 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.437130 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" event={"ID":"5156a24a-e2d9-46dd-b1c7-9c732abae909","Type":"ContainerStarted","Data":"19756247e5ed0635a5883339ee091e8121779530a9fee372a6449116c823050f"} Jun 11 19:54:19.438408 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.438379 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-znbfc" event={"ID":"69d115a5-e475-4cf9-a878-5eb234c91974","Type":"ContainerStarted","Data":"1abe94272d78c9a9fd888c409e59303f4f7448c6da6aa517a7246a6f34725a84"} Jun 11 19:54:19.440141 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.440113 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" event={"ID":"8b90848b-570f-48f8-8d5a-fba8d9f7d967","Type":"ContainerStarted","Data":"049639dd0a93b7c3519b1b56a69f56c905d450226cd3b6e540707cb93c4e17f5"} Jun 11 19:54:19.441769 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.441748 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rkxzl" event={"ID":"9b7199ae-2384-40a9-ac35-f185dcce8701","Type":"ContainerStarted","Data":"63fde43376971e08ac0343dc57c6ff8729d68cdd5e9748bea265bf5841a26532"} Jun 11 19:54:19.447592 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.447549 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-46.ec2.internal" podStartSLOduration=21.44753453 podStartE2EDuration="21.44753453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:53:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:01.416125029 +0000 UTC m=+4.447841670" watchObservedRunningTime="2026-06-11 19:54:19.44753453 +0000 UTC m=+22.479251190" Jun 11 19:54:19.447722 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.447697 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bd2tp" podStartSLOduration=3.638616839 podStartE2EDuration="22.447691724s" totalImagesPullingTime="18.809074885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:19.447404444 +0000 UTC m=+22.479121088" watchObservedRunningTime="2026-06-11 19:54:19.447691724 +0000 UTC m=+22.479408364" Jun 11 19:54:19.479563 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.479513 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-znbfc" podStartSLOduration=12.016411714 podStartE2EDuration="22.479495264s" totalImagesPullingTime="10.46308355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:19.479491649 +0000 UTC m=+22.511208290" watchObservedRunningTime="2026-06-11 19:54:19.479495264 +0000 UTC m=+22.511211907" Jun 11 19:54:19.479696 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.479675 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rkxzl" podStartSLOduration=3.709279413 podStartE2EDuration="22.479667555s" totalImagesPullingTime="18.770388142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:19.461917843 +0000 UTC m=+22.493634465" watchObservedRunningTime="2026-06-11 19:54:19.479667555 +0000 UTC m=+22.511384194" Jun 11 19:54:19.495725 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.495685 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t9tsm" podStartSLOduration=3.724662247 podStartE2EDuration="22.495672402s" totalImagesPullingTime="18.771010155s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:19.495550448 +0000 UTC m=+22.527267091" watchObservedRunningTime="2026-06-11 19:54:19.495672402 +0000 UTC m=+22.527389051" Jun 11 19:54:19.510317 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.510253 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bk68w" podStartSLOduration=3.738979487 podStartE2EDuration="22.510236425s" totalImagesPullingTime="18.771256938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:19.50969191 +0000 UTC m=+22.541408551" watchObservedRunningTime="2026-06-11 19:54:19.510236425 +0000 UTC m=+22.541953066" Jun 11 19:54:19.916430 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:19.916404 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 19:54:20.342538 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:20.342514 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:20.342707 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:20.342638 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8x8n" podUID="66f02d7a-34af-41ed-b9d1-ebc61a648224" Jun 11 19:54:20.344329 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:20.344236 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T19:54:19.916424613Z","UUID":"14470960-ac9e-4db5-a947-4afad07f2273","Handler":null,"Name":"","Endpoint":""} Jun 11 19:54:20.345905 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:20.345887 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 19:54:20.345997 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:20.345929 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 19:54:20.446696 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:20.446660 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" event={"ID":"dbfc964a-cea6-40c4-8fea-7e3965f24394","Type":"ContainerStarted","Data":"f1db9e8818533c04531177d05c55baa3a3b815d1035ab36b701b8f7c259edefe"} Jun 11 19:54:20.450417 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:20.450388 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" event={"ID":"5156a24a-e2d9-46dd-b1c7-9c732abae909","Type":"ContainerStarted","Data":"f963edf2a062c6315ac953737a9dad2f49e86ef4b8fece14e50f440d663fddaa"} Jun 11 19:54:20.452287 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:20.452259 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-86vvn" event={"ID":"e6c158ce-0ce1-45e7-b1c9-373ccaa23e19","Type":"ContainerStarted","Data":"2fba2754e5b74b4cea665591411838163c7d2b8167c69e602da93cf2d04f1080"} Jun 11 19:54:20.467082 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:20.467039 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-86vvn" podStartSLOduration=4.694246807 podStartE2EDuration="23.467024285s" totalImagesPullingTime="18.772777478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:20.466568337 +0000 UTC m=+23.498284981" watchObservedRunningTime="2026-06-11 19:54:20.467024285 +0000 UTC m=+23.498740929" Jun 11 19:54:21.342992 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:21.342959 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:21.343178 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:21.343103 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6c8g" podUID="2380f825-9675-4295-989c-da0d39abef7f" Jun 11 19:54:21.343178 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:21.343162 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:21.343315 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:21.343292 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64f8l" podUID="2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a" Jun 11 19:54:21.456429 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:21.456398 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" event={"ID":"dbfc964a-cea6-40c4-8fea-7e3965f24394","Type":"ContainerStarted","Data":"4fd3f01b3e504ef3ca7ecaddc4928971191b9b52a1571398bfa521b6fd3ecf10"} Jun 11 19:54:21.475166 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:21.475122 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwdm8" podStartSLOduration=4.113942588 podStartE2EDuration="24.475108675s" totalImagesPullingTime="20.361166087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:53:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:21.47470386 +0000 UTC m=+24.506420500" watchObservedRunningTime="2026-06-11 19:54:21.475108675 +0000 UTC m=+24.506825314" Jun 11 19:54:22.342647 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:22.342457 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:22.342838 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:22.342742 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8x8n" podUID="66f02d7a-34af-41ed-b9d1-ebc61a648224" Jun 11 19:54:22.462237 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:22.462194 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" event={"ID":"5156a24a-e2d9-46dd-b1c7-9c732abae909","Type":"ContainerStarted","Data":"792e550d472feef94da9b8901f37cba23a47c0cafc8cd85f5d6831a5c28e41fa"} Jun 11 19:54:23.343002 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:23.342969 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:23.343209 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:23.342969 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:23.343209 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:23.343093 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64f8l" podUID="2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a" Jun 11 19:54:23.343209 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:23.343179 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6c8g" podUID="2380f825-9675-4295-989c-da0d39abef7f" Jun 11 19:54:24.300861 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:24.300644 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-znbfc" Jun 11 19:54:24.301545 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:24.301353 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-znbfc" Jun 11 19:54:24.343096 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:24.342989 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:24.343220 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:24.343145 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8x8n" podUID="66f02d7a-34af-41ed-b9d1-ebc61a648224" Jun 11 19:54:24.468549 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:24.468517 2564 generic.go:356] "Generic (PLEG): container finished" podID="b93e7c70-5b9e-4e86-9bbc-9e26931413d8" containerID="97aba8eff754407bcebc995620ef0b423f7843cd089f6f461f24db5ee991ffd4" exitCode=0 Jun 11 19:54:24.468664 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:24.468601 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qff5g" event={"ID":"b93e7c70-5b9e-4e86-9bbc-9e26931413d8","Type":"ContainerDied","Data":"97aba8eff754407bcebc995620ef0b423f7843cd089f6f461f24db5ee991ffd4"} Jun 11 19:54:24.472480 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:24.472454 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" event={"ID":"5156a24a-e2d9-46dd-b1c7-9c732abae909","Type":"ContainerStarted","Data":"089898aad9f1c9b211418dc1f0003279482ff44893aa0841a9e171c8c178863b"} Jun 11 19:54:24.473310 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:24.472694 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-znbfc" Jun 11 19:54:24.473310 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:24.472738 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:54:24.473310 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:24.472807 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:54:24.473310 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:24.472853 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:54:24.473310 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:24.473138 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-znbfc" Jun 11 19:54:24.487620 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:24.487596 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:54:24.487744 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:24.487731 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:54:24.522368 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:24.522303 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" podStartSLOduration=8.688466193 podStartE2EDuration="27.522290066s" totalImagesPullingTime="18.833823873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:24.521425293 +0000 UTC m=+27.553141932" watchObservedRunningTime="2026-06-11 19:54:24.522290066 +0000 UTC m=+27.554006706" Jun 11 19:54:25.343076 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:25.343034 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:25.343076 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:25.343071 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:25.343618 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:25.343177 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6c8g" podUID="2380f825-9675-4295-989c-da0d39abef7f" Jun 11 19:54:25.343618 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:25.343298 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64f8l" podUID="2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a" Jun 11 19:54:26.099573 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:26.099545 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r6c8g"] Jun 11 19:54:26.099722 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:26.099630 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:26.099722 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:26.099706 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6c8g" podUID="2380f825-9675-4295-989c-da0d39abef7f" Jun 11 19:54:26.102160 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:26.102135 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-64f8l"] Jun 11 19:54:26.102256 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:26.102214 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:26.102313 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:26.102297 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64f8l" podUID="2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a" Jun 11 19:54:26.102865 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:26.102840 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z8x8n"] Jun 11 19:54:26.102978 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:26.102951 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:26.103065 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:26.103047 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8x8n" podUID="66f02d7a-34af-41ed-b9d1-ebc61a648224" Jun 11 19:54:26.478418 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:26.478385 2564 generic.go:356] "Generic (PLEG): container finished" podID="b93e7c70-5b9e-4e86-9bbc-9e26931413d8" containerID="f42abb8f857b429f3d9a49b52edc919ce46e0267a5de77f70888ed2156a468b6" exitCode=0 Jun 11 19:54:26.478752 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:26.478472 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qff5g" event={"ID":"b93e7c70-5b9e-4e86-9bbc-9e26931413d8","Type":"ContainerDied","Data":"f42abb8f857b429f3d9a49b52edc919ce46e0267a5de77f70888ed2156a468b6"} Jun 11 19:54:27.343240 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:27.343050 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:27.343415 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:27.343112 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:27.343415 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:27.343330 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8x8n" podUID="66f02d7a-34af-41ed-b9d1-ebc61a648224" Jun 11 19:54:27.343537 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:27.343413 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64f8l" podUID="2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a" Jun 11 19:54:27.343537 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:27.343139 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:27.343537 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:27.343514 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6c8g" podUID="2380f825-9675-4295-989c-da0d39abef7f" Jun 11 19:54:28.484847 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:28.484755 2564 generic.go:356] "Generic (PLEG): container finished" podID="b93e7c70-5b9e-4e86-9bbc-9e26931413d8" containerID="a7f82b7e37f11d92686f1c766d8753fa9a1925c06c3608aa40b8bb7afae0329e" exitCode=0 Jun 11 19:54:28.484847 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:28.484821 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qff5g" event={"ID":"b93e7c70-5b9e-4e86-9bbc-9e26931413d8","Type":"ContainerDied","Data":"a7f82b7e37f11d92686f1c766d8753fa9a1925c06c3608aa40b8bb7afae0329e"} Jun 11 19:54:29.342419 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:29.342386 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:29.342569 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:29.342386 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:29.342569 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:29.342495 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6c8g" podUID="2380f825-9675-4295-989c-da0d39abef7f" Jun 11 19:54:29.342644 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:29.342389 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:29.342644 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:29.342587 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64f8l" podUID="2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a" Jun 11 19:54:29.342729 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:29.342674 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8x8n" podUID="66f02d7a-34af-41ed-b9d1-ebc61a648224" Jun 11 19:54:31.051131 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.051096 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret\") pod \"global-pull-secret-syncer-r6c8g\" (UID: \"2380f825-9675-4295-989c-da0d39abef7f\") " pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:31.051779 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:31.051217 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:54:31.051779 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:31.051272 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret podName:2380f825-9675-4295-989c-da0d39abef7f nodeName:}" failed. No retries permitted until 2026-06-11 19:55:03.051255739 +0000 UTC m=+66.082972374 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret") pod "global-pull-secret-syncer-r6c8g" (UID: "2380f825-9675-4295-989c-da0d39abef7f") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:54:31.151884 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.151849 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs\") pod \"network-metrics-daemon-z8x8n\" (UID: \"66f02d7a-34af-41ed-b9d1-ebc61a648224\") " pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:31.152060 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:31.151989 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:54:31.152123 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:31.152062 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs podName:66f02d7a-34af-41ed-b9d1-ebc61a648224 nodeName:}" failed. No retries permitted until 2026-06-11 19:55:03.152044671 +0000 UTC m=+66.183761299 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs") pod "network-metrics-daemon-z8x8n" (UID: "66f02d7a-34af-41ed-b9d1-ebc61a648224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:54:31.253017 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.252983 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9ccx\" (UniqueName: \"kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx\") pod \"network-check-target-64f8l\" (UID: \"2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a\") " pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:31.253199 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:31.253168 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:54:31.253199 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:31.253193 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:54:31.253300 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:31.253208 2564 projected.go:196] Error preparing data for projected volume kube-api-access-j9ccx for pod openshift-network-diagnostics/network-check-target-64f8l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:54:31.253300 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:31.253264 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx podName:2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a nodeName:}" failed. No retries permitted until 2026-06-11 19:55:03.253245648 +0000 UTC m=+66.284962286 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9ccx" (UniqueName: "kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx") pod "network-check-target-64f8l" (UID: "2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:54:31.342310 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.342281 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:31.342494 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.342292 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:31.342494 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:31.342394 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64f8l" podUID="2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a" Jun 11 19:54:31.342494 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.342402 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:31.342494 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:31.342484 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6c8g" podUID="2380f825-9675-4295-989c-da0d39abef7f" Jun 11 19:54:31.342704 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:31.342576 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z8x8n" podUID="66f02d7a-34af-41ed-b9d1-ebc61a648224" Jun 11 19:54:31.811465 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.811395 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-46.ec2.internal" event="NodeReady" Jun 11 19:54:31.811603 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.811516 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 19:54:31.856926 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.856889 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dlkxw"] Jun 11 19:54:31.880857 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.880831 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qfp6k"] Jun 11 19:54:31.881020 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.880967 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dlkxw" Jun 11 19:54:31.884207 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.884182 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 19:54:31.884881 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.884857 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 19:54:31.896804 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.896766 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qfp6k" Jun 11 19:54:31.896908 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.896809 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dlkxw"] Jun 11 19:54:31.896908 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.896859 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qfp6k"] Jun 11 19:54:31.899964 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.899942 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 19:54:31.900430 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.900405 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 19:54:31.900531 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.900457 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 19:54:31.900874 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.900857 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hfjmj\"" Jun 11 19:54:31.900960 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.900855 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-45ctb\"" Jun 11 19:54:31.957003 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.956968 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72b1d900-e2b3-4a23-989b-42e796f1c820-tmp-dir\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:54:31.957179 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.957015 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2959v\" (UniqueName: \"kubernetes.io/projected/72b1d900-e2b3-4a23-989b-42e796f1c820-kube-api-access-2959v\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:54:31.957179 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.957090 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cktjk\" (UniqueName: \"kubernetes.io/projected/d96c8cfe-b03a-40be-9956-8d0477442dac-kube-api-access-cktjk\") pod \"ingress-canary-qfp6k\" (UID: \"d96c8cfe-b03a-40be-9956-8d0477442dac\") " pod="openshift-ingress-canary/ingress-canary-qfp6k" Jun 11 19:54:31.957179 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.957125 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:54:31.957179 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.957168 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d96c8cfe-b03a-40be-9956-8d0477442dac-cert\") pod \"ingress-canary-qfp6k\" (UID: \"d96c8cfe-b03a-40be-9956-8d0477442dac\") " pod="openshift-ingress-canary/ingress-canary-qfp6k" Jun 11 19:54:31.957359 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:31.957216 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/72b1d900-e2b3-4a23-989b-42e796f1c820-config-volume\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:54:32.057622 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.057584 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72b1d900-e2b3-4a23-989b-42e796f1c820-tmp-dir\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:54:32.057622 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.057627 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2959v\" (UniqueName: \"kubernetes.io/projected/72b1d900-e2b3-4a23-989b-42e796f1c820-kube-api-access-2959v\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:54:32.058154 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.057684 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cktjk\" (UniqueName: \"kubernetes.io/projected/d96c8cfe-b03a-40be-9956-8d0477442dac-kube-api-access-cktjk\") pod \"ingress-canary-qfp6k\" (UID: \"d96c8cfe-b03a-40be-9956-8d0477442dac\") " pod="openshift-ingress-canary/ingress-canary-qfp6k" Jun 11 19:54:32.058154 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.057710 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:54:32.058154 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.057734 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d96c8cfe-b03a-40be-9956-8d0477442dac-cert\") pod \"ingress-canary-qfp6k\" (UID: \"d96c8cfe-b03a-40be-9956-8d0477442dac\") " pod="openshift-ingress-canary/ingress-canary-qfp6k" Jun 11 19:54:32.058154 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.057772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/72b1d900-e2b3-4a23-989b-42e796f1c820-config-volume\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:54:32.058154 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:32.057903 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:54:32.058154 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:32.057979 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls podName:72b1d900-e2b3-4a23-989b-42e796f1c820 nodeName:}" failed. No retries permitted until 2026-06-11 19:54:32.557958309 +0000 UTC m=+35.589674931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls") pod "dns-default-dlkxw" (UID: "72b1d900-e2b3-4a23-989b-42e796f1c820") : secret "dns-default-metrics-tls" not found Jun 11 19:54:32.058154 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.058068 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72b1d900-e2b3-4a23-989b-42e796f1c820-tmp-dir\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:54:32.058442 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.058342 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/72b1d900-e2b3-4a23-989b-42e796f1c820-config-volume\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:54:32.062949 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.062882 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d96c8cfe-b03a-40be-9956-8d0477442dac-cert\") pod \"ingress-canary-qfp6k\" (UID: \"d96c8cfe-b03a-40be-9956-8d0477442dac\") " pod="openshift-ingress-canary/ingress-canary-qfp6k" Jun 11 19:54:32.071045 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.071021 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2959v\" (UniqueName: \"kubernetes.io/projected/72b1d900-e2b3-4a23-989b-42e796f1c820-kube-api-access-2959v\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:54:32.071167 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.071078 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cktjk\" (UniqueName: \"kubernetes.io/projected/d96c8cfe-b03a-40be-9956-8d0477442dac-kube-api-access-cktjk\") pod \"ingress-canary-qfp6k\" (UID: \"d96c8cfe-b03a-40be-9956-8d0477442dac\") " pod="openshift-ingress-canary/ingress-canary-qfp6k" Jun 11 19:54:32.206408 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.206373 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qfp6k" Jun 11 19:54:32.361532 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.361309 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq"] Jun 11 19:54:32.385738 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.385710 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq"] Jun 11 19:54:32.385904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.385854 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:54:32.389540 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.389345 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 19:54:32.389540 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.389345 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 19:54:32.389540 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.389464 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 19:54:32.390071 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.390034 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 19:54:32.390153 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.390127 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 19:54:32.390300 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.390283 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 19:54:32.390380 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.390373 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 19:54:32.430724 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.430699 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qfp6k"] Jun 11 19:54:32.434610 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:54:32.434590 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd96c8cfe_b03a_40be_9956_8d0477442dac.slice/crio-b94cfd3d18d1dac360bf28e3d1b4021c18efa5499ea1e5eef39859b6f61e2544 WatchSource:0}: Error finding container b94cfd3d18d1dac360bf28e3d1b4021c18efa5499ea1e5eef39859b6f61e2544: Status 404 returned error can't find the container with id b94cfd3d18d1dac360bf28e3d1b4021c18efa5499ea1e5eef39859b6f61e2544 Jun 11 19:54:32.460121 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.460096 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f33948cf-ad2a-4d8d-b9b3-efc7123aed91-hub\") pod \"cluster-proxy-proxy-agent-6cbbd6f56d-w87hq\" (UID: \"f33948cf-ad2a-4d8d-b9b3-efc7123aed91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:54:32.460229 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.460135 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cprl5\" (UniqueName: \"kubernetes.io/projected/f33948cf-ad2a-4d8d-b9b3-efc7123aed91-kube-api-access-cprl5\") pod \"cluster-proxy-proxy-agent-6cbbd6f56d-w87hq\" (UID: \"f33948cf-ad2a-4d8d-b9b3-efc7123aed91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:54:32.460229 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.460208 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f33948cf-ad2a-4d8d-b9b3-efc7123aed91-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6cbbd6f56d-w87hq\" (UID: \"f33948cf-ad2a-4d8d-b9b3-efc7123aed91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:54:32.460338 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.460231 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f33948cf-ad2a-4d8d-b9b3-efc7123aed91-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6cbbd6f56d-w87hq\" (UID: \"f33948cf-ad2a-4d8d-b9b3-efc7123aed91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:54:32.460338 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.460290 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f33948cf-ad2a-4d8d-b9b3-efc7123aed91-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6cbbd6f56d-w87hq\" (UID: \"f33948cf-ad2a-4d8d-b9b3-efc7123aed91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:54:32.460421 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.460337 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f33948cf-ad2a-4d8d-b9b3-efc7123aed91-ca\") pod \"cluster-proxy-proxy-agent-6cbbd6f56d-w87hq\" (UID: \"f33948cf-ad2a-4d8d-b9b3-efc7123aed91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:54:32.494240 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.494210 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qfp6k" event={"ID":"d96c8cfe-b03a-40be-9956-8d0477442dac","Type":"ContainerStarted","Data":"b94cfd3d18d1dac360bf28e3d1b4021c18efa5499ea1e5eef39859b6f61e2544"} Jun 11 19:54:32.561362 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.561326 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f33948cf-ad2a-4d8d-b9b3-efc7123aed91-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6cbbd6f56d-w87hq\" (UID: \"f33948cf-ad2a-4d8d-b9b3-efc7123aed91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:54:32.561530 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.561368 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f33948cf-ad2a-4d8d-b9b3-efc7123aed91-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6cbbd6f56d-w87hq\" (UID: \"f33948cf-ad2a-4d8d-b9b3-efc7123aed91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:54:32.561530 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.561512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f33948cf-ad2a-4d8d-b9b3-efc7123aed91-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6cbbd6f56d-w87hq\" (UID: \"f33948cf-ad2a-4d8d-b9b3-efc7123aed91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:54:32.561638 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.561577 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f33948cf-ad2a-4d8d-b9b3-efc7123aed91-ca\") pod \"cluster-proxy-proxy-agent-6cbbd6f56d-w87hq\" (UID: \"f33948cf-ad2a-4d8d-b9b3-efc7123aed91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:54:32.561638 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.561606 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:54:32.561736 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.561670 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f33948cf-ad2a-4d8d-b9b3-efc7123aed91-hub\") pod \"cluster-proxy-proxy-agent-6cbbd6f56d-w87hq\" (UID: \"f33948cf-ad2a-4d8d-b9b3-efc7123aed91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:54:32.561736 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.561699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cprl5\" (UniqueName: \"kubernetes.io/projected/f33948cf-ad2a-4d8d-b9b3-efc7123aed91-kube-api-access-cprl5\") pod \"cluster-proxy-proxy-agent-6cbbd6f56d-w87hq\" (UID: \"f33948cf-ad2a-4d8d-b9b3-efc7123aed91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:54:32.562156 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.562129 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f33948cf-ad2a-4d8d-b9b3-efc7123aed91-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6cbbd6f56d-w87hq\" (UID: \"f33948cf-ad2a-4d8d-b9b3-efc7123aed91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:54:32.562280 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:32.562170 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:54:32.562280 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:32.562247 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls podName:72b1d900-e2b3-4a23-989b-42e796f1c820 nodeName:}" failed. No retries permitted until 2026-06-11 19:54:33.562228959 +0000 UTC m=+36.593945591 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls") pod "dns-default-dlkxw" (UID: "72b1d900-e2b3-4a23-989b-42e796f1c820") : secret "dns-default-metrics-tls" not found Jun 11 19:54:32.565722 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.565703 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f33948cf-ad2a-4d8d-b9b3-efc7123aed91-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6cbbd6f56d-w87hq\" (UID: \"f33948cf-ad2a-4d8d-b9b3-efc7123aed91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:54:32.565722 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.565714 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f33948cf-ad2a-4d8d-b9b3-efc7123aed91-ca\") pod \"cluster-proxy-proxy-agent-6cbbd6f56d-w87hq\" (UID: \"f33948cf-ad2a-4d8d-b9b3-efc7123aed91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:54:32.565898 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.565804 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f33948cf-ad2a-4d8d-b9b3-efc7123aed91-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6cbbd6f56d-w87hq\" (UID: \"f33948cf-ad2a-4d8d-b9b3-efc7123aed91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:54:32.565898 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.565837 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f33948cf-ad2a-4d8d-b9b3-efc7123aed91-hub\") pod \"cluster-proxy-proxy-agent-6cbbd6f56d-w87hq\" (UID: \"f33948cf-ad2a-4d8d-b9b3-efc7123aed91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:54:32.570913 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.570895 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cprl5\" (UniqueName: \"kubernetes.io/projected/f33948cf-ad2a-4d8d-b9b3-efc7123aed91-kube-api-access-cprl5\") pod \"cluster-proxy-proxy-agent-6cbbd6f56d-w87hq\" (UID: \"f33948cf-ad2a-4d8d-b9b3-efc7123aed91\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:54:32.707247 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.707155 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:54:32.866652 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:32.866617 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq"] Jun 11 19:54:32.879984 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:54:32.879958 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf33948cf_ad2a_4d8d_b9b3_efc7123aed91.slice/crio-b5023f86715126eb71853e0dff0007a5b305102ca2b9c2c6e9ead953614269ef WatchSource:0}: Error finding container b5023f86715126eb71853e0dff0007a5b305102ca2b9c2c6e9ead953614269ef: Status 404 returned error can't find the container with id b5023f86715126eb71853e0dff0007a5b305102ca2b9c2c6e9ead953614269ef Jun 11 19:54:33.347162 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:33.347133 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:54:33.347601 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:33.347522 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:54:33.347965 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:33.347950 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:54:33.349879 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:33.349853 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 19:54:33.350953 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:33.350933 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xlfzf\"" Jun 11 19:54:33.351060 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:33.350977 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 19:54:33.351152 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:33.351133 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 19:54:33.351215 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:33.351133 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 19:54:33.351293 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:33.351274 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2x98l\"" Jun 11 19:54:33.498803 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:33.498750 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" event={"ID":"f33948cf-ad2a-4d8d-b9b3-efc7123aed91","Type":"ContainerStarted","Data":"b5023f86715126eb71853e0dff0007a5b305102ca2b9c2c6e9ead953614269ef"} Jun 11 19:54:33.569401 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:33.569360 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:54:33.569563 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:33.569536 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:54:33.569635 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:33.569597 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls podName:72b1d900-e2b3-4a23-989b-42e796f1c820 nodeName:}" failed. No retries permitted until 2026-06-11 19:54:35.569579407 +0000 UTC m=+38.601296042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls") pod "dns-default-dlkxw" (UID: "72b1d900-e2b3-4a23-989b-42e796f1c820") : secret "dns-default-metrics-tls" not found Jun 11 19:54:35.587454 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:35.587412 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:54:35.587884 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:35.587554 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:54:35.587884 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:35.587615 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls podName:72b1d900-e2b3-4a23-989b-42e796f1c820 nodeName:}" failed. No retries permitted until 2026-06-11 19:54:39.587596126 +0000 UTC m=+42.619312760 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls") pod "dns-default-dlkxw" (UID: "72b1d900-e2b3-4a23-989b-42e796f1c820") : secret "dns-default-metrics-tls" not found Jun 11 19:54:38.514703 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:38.514671 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qfp6k" event={"ID":"d96c8cfe-b03a-40be-9956-8d0477442dac","Type":"ContainerStarted","Data":"aa26cd57e2392bdd88be5421bc0a68543c6a253ac8bff16faedb1976e86444b6"} Jun 11 19:54:38.517603 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:38.517562 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" event={"ID":"f33948cf-ad2a-4d8d-b9b3-efc7123aed91","Type":"ContainerStarted","Data":"0d9d5e4c356a843421862671a8dc911f08dff7f31f71fb085d5875355be27f75"} Jun 11 19:54:38.517745 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:38.517617 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" event={"ID":"f33948cf-ad2a-4d8d-b9b3-efc7123aed91","Type":"ContainerStarted","Data":"7d35caa36f1eaf00ec97b5329ac3832de6fe4c8a41787eb4fb9bb8b4c39b7acb"} Jun 11 19:54:38.517745 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:38.517640 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" event={"ID":"f33948cf-ad2a-4d8d-b9b3-efc7123aed91","Type":"ContainerStarted","Data":"65777486f4278d6b65523a1c07467935cd112647ee133cf604cb1ef397bfed4c"} Jun 11 19:54:38.521108 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:38.521085 2564 generic.go:356] "Generic (PLEG): container finished" podID="b93e7c70-5b9e-4e86-9bbc-9e26931413d8" containerID="8817156d863e75a65775fe99170c7d966ea0b0765bb81031033d07a4ada26b8f" exitCode=0 Jun 11 19:54:38.521230 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:38.521134 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qff5g" event={"ID":"b93e7c70-5b9e-4e86-9bbc-9e26931413d8","Type":"ContainerDied","Data":"8817156d863e75a65775fe99170c7d966ea0b0765bb81031033d07a4ada26b8f"} Jun 11 19:54:38.533201 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:38.533164 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qfp6k" podStartSLOduration=1.865132707 podStartE2EDuration="7.533150905s" totalImagesPullingTime="5.668018198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:54:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:38.532518274 +0000 UTC m=+41.564234913" watchObservedRunningTime="2026-06-11 19:54:38.533150905 +0000 UTC m=+41.564867537" Jun 11 19:54:38.551466 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:38.551419 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" podStartSLOduration=1.258226522 podStartE2EDuration="6.551403987s" totalImagesPullingTime="5.293177465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:54:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:38.550355538 +0000 UTC m=+41.582072169" watchObservedRunningTime="2026-06-11 19:54:38.551403987 +0000 UTC m=+41.583120627" Jun 11 19:54:39.528742 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:39.528670 2564 generic.go:356] "Generic (PLEG): container finished" podID="b93e7c70-5b9e-4e86-9bbc-9e26931413d8" containerID="6b6477c580ae5d26d03342535e8c272390ed1017b62a1c246ab28830152bc049" exitCode=0 Jun 11 19:54:39.529090 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:39.528758 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qff5g" event={"ID":"b93e7c70-5b9e-4e86-9bbc-9e26931413d8","Type":"ContainerDied","Data":"6b6477c580ae5d26d03342535e8c272390ed1017b62a1c246ab28830152bc049"} Jun 11 19:54:39.613973 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:39.613943 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:54:39.614091 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:39.614045 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:54:39.614159 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:39.614115 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls podName:72b1d900-e2b3-4a23-989b-42e796f1c820 nodeName:}" failed. No retries permitted until 2026-06-11 19:54:47.614091231 +0000 UTC m=+50.645807865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls") pod "dns-default-dlkxw" (UID: "72b1d900-e2b3-4a23-989b-42e796f1c820") : secret "dns-default-metrics-tls" not found Jun 11 19:54:40.534504 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:40.534465 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qff5g" event={"ID":"b93e7c70-5b9e-4e86-9bbc-9e26931413d8","Type":"ContainerStarted","Data":"5fb459790cff7ed92ba057c94f4eb76bc7123d389c6f42a380851f8f2f92705c"} Jun 11 19:54:40.577156 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:40.577103 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qff5g" podStartSLOduration=8.20564215 podStartE2EDuration="43.577087848s" totalImagesPullingTime="35.371445698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:53:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:40.574999236 +0000 UTC m=+43.606715875" watchObservedRunningTime="2026-06-11 19:54:40.577087848 +0000 UTC m=+43.608804488" Jun 11 19:54:47.667199 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:47.667164 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:54:47.667643 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:47.667291 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:54:47.667643 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:54:47.667358 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls podName:72b1d900-e2b3-4a23-989b-42e796f1c820 nodeName:}" failed. No retries permitted until 2026-06-11 19:55:03.667341052 +0000 UTC m=+66.699057671 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls") pod "dns-default-dlkxw" (UID: "72b1d900-e2b3-4a23-989b-42e796f1c820") : secret "dns-default-metrics-tls" not found Jun 11 19:54:56.497304 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:54:56.497275 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2l9v4" Jun 11 19:55:03.073124 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:03.073085 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret\") pod \"global-pull-secret-syncer-r6c8g\" (UID: \"2380f825-9675-4295-989c-da0d39abef7f\") " pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:55:03.075756 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:03.075734 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 19:55:03.087212 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:03.087184 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2380f825-9675-4295-989c-da0d39abef7f-original-pull-secret\") pod \"global-pull-secret-syncer-r6c8g\" (UID: \"2380f825-9675-4295-989c-da0d39abef7f\") " pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:55:03.173599 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:03.173569 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs\") pod \"network-metrics-daemon-z8x8n\" (UID: \"66f02d7a-34af-41ed-b9d1-ebc61a648224\") " pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:55:03.176162 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:03.176145 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 19:55:03.184341 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:55:03.184313 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 19:55:03.184426 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:55:03.184408 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs podName:66f02d7a-34af-41ed-b9d1-ebc61a648224 nodeName:}" failed. No retries permitted until 2026-06-11 19:56:07.184385895 +0000 UTC m=+130.216102528 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs") pod "network-metrics-daemon-z8x8n" (UID: "66f02d7a-34af-41ed-b9d1-ebc61a648224") : secret "metrics-daemon-secret" not found Jun 11 19:55:03.274199 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:03.274174 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9ccx\" (UniqueName: \"kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx\") pod \"network-check-target-64f8l\" (UID: \"2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a\") " pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:55:03.276844 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:03.276828 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 19:55:03.286843 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:03.286824 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 19:55:03.298289 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:03.298266 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9ccx\" (UniqueName: \"kubernetes.io/projected/2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a-kube-api-access-j9ccx\") pod \"network-check-target-64f8l\" (UID: \"2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a\") " pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:55:03.363032 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:03.362974 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6c8g" Jun 11 19:55:03.379184 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:03.379165 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2x98l\"" Jun 11 19:55:03.387435 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:03.387407 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:55:03.496894 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:03.496873 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r6c8g"] Jun 11 19:55:03.500039 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:55:03.500011 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2380f825_9675_4295_989c_da0d39abef7f.slice/crio-d9ee8c776fdfd8b29940414d598623384f0d425800d0b53756a100736542802e WatchSource:0}: Error finding container d9ee8c776fdfd8b29940414d598623384f0d425800d0b53756a100736542802e: Status 404 returned error can't find the container with id d9ee8c776fdfd8b29940414d598623384f0d425800d0b53756a100736542802e Jun 11 19:55:03.514624 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:03.514540 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-64f8l"] Jun 11 19:55:03.516984 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:55:03.516959 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ab37c78_bb7b_4967_a5f5_5b3ddf72af1a.slice/crio-f14185140d58f998d34f16a2d8bae386c5b051cdcfbb51b9c6e069346262e400 WatchSource:0}: Error finding container f14185140d58f998d34f16a2d8bae386c5b051cdcfbb51b9c6e069346262e400: Status 404 returned error can't find the container with id f14185140d58f998d34f16a2d8bae386c5b051cdcfbb51b9c6e069346262e400 Jun 11 19:55:03.589338 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:03.589301 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-64f8l" event={"ID":"2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a","Type":"ContainerStarted","Data":"f14185140d58f998d34f16a2d8bae386c5b051cdcfbb51b9c6e069346262e400"} Jun 11 19:55:03.590342 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:03.590321 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r6c8g" event={"ID":"2380f825-9675-4295-989c-da0d39abef7f","Type":"ContainerStarted","Data":"d9ee8c776fdfd8b29940414d598623384f0d425800d0b53756a100736542802e"} Jun 11 19:55:03.677072 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:03.676999 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:55:03.677179 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:55:03.677102 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:55:03.677179 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:55:03.677150 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls podName:72b1d900-e2b3-4a23-989b-42e796f1c820 nodeName:}" failed. No retries permitted until 2026-06-11 19:55:35.677137896 +0000 UTC m=+98.708854515 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls") pod "dns-default-dlkxw" (UID: "72b1d900-e2b3-4a23-989b-42e796f1c820") : secret "dns-default-metrics-tls" not found Jun 11 19:55:06.600799 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:06.600753 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-64f8l" event={"ID":"2ab37c78-bb7b-4967-a5f5-5b3ddf72af1a","Type":"ContainerStarted","Data":"5488d69c9b9b4972e88896b499e8e501f59d791e2769849cf094c114985003d3"} Jun 11 19:55:06.601123 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:06.600903 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:55:06.616884 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:06.616831 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-64f8l" podStartSLOduration=66.701218102 podStartE2EDuration="1m9.616817174s" totalImagesPullingTime="2.915599072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:55:06.61572219 +0000 UTC m=+69.647438829" watchObservedRunningTime="2026-06-11 19:55:06.616817174 +0000 UTC m=+69.648533814" Jun 11 19:55:08.608908 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:08.608868 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r6c8g" event={"ID":"2380f825-9675-4295-989c-da0d39abef7f","Type":"ContainerStarted","Data":"431a960ad1c782aaaa5f525d605c925ac08f1a4197067b17e8349b78c2c62f11"} Jun 11 19:55:08.624157 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:08.624107 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r6c8g" podStartSLOduration=67.072494292 podStartE2EDuration="1m11.624092281s" totalImagesPullingTime="4.551597989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:55:08.623426085 +0000 UTC m=+71.655142724" watchObservedRunningTime="2026-06-11 19:55:08.624092281 +0000 UTC m=+71.655808921" Jun 11 19:55:35.687101 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:35.687069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:55:35.687457 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:55:35.687186 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:55:35.687457 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:55:35.687243 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls podName:72b1d900-e2b3-4a23-989b-42e796f1c820 nodeName:}" failed. No retries permitted until 2026-06-11 19:56:39.687230729 +0000 UTC m=+162.718947346 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls") pod "dns-default-dlkxw" (UID: "72b1d900-e2b3-4a23-989b-42e796f1c820") : secret "dns-default-metrics-tls" not found Jun 11 19:55:37.606922 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:55:37.606891 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-64f8l" Jun 11 19:56:07.185502 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:07.185466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs\") pod \"network-metrics-daemon-z8x8n\" (UID: \"66f02d7a-34af-41ed-b9d1-ebc61a648224\") " pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:56:07.185982 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:07.185588 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 19:56:07.185982 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:07.185652 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs podName:66f02d7a-34af-41ed-b9d1-ebc61a648224 nodeName:}" failed. No retries permitted until 2026-06-11 19:58:09.185637662 +0000 UTC m=+252.217354283 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs") pod "network-metrics-daemon-z8x8n" (UID: "66f02d7a-34af-41ed-b9d1-ebc61a648224") : secret "metrics-daemon-secret" not found Jun 11 19:56:34.892154 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:34.892114 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dlkxw" podUID="72b1d900-e2b3-4a23-989b-42e796f1c820" Jun 11 19:56:35.842593 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:35.842554 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dlkxw" Jun 11 19:56:36.370833 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:36.370762 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-z8x8n" podUID="66f02d7a-34af-41ed-b9d1-ebc61a648224" Jun 11 19:56:39.689497 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:39.689462 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:56:39.689934 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:39.689570 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:56:39.689934 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:39.689634 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls podName:72b1d900-e2b3-4a23-989b-42e796f1c820 nodeName:}" failed. No retries permitted until 2026-06-11 19:58:41.689616556 +0000 UTC m=+284.721333175 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls") pod "dns-default-dlkxw" (UID: "72b1d900-e2b3-4a23-989b-42e796f1c820") : secret "dns-default-metrics-tls" not found Jun 11 19:56:47.344444 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:47.344405 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:56:53.001355 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.001320 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l4cvq"] Jun 11 19:56:53.004302 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.004282 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:56:53.006721 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.006700 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 19:56:53.006871 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.006737 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 19:56:53.006871 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.006758 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l8fvt\"" Jun 11 19:56:53.007027 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.007012 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 19:56:53.007735 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.007721 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 19:56:53.016865 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.016844 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l4cvq"] Jun 11 19:56:53.067543 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.067520 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/351d8b60-ae26-4785-9900-5f29d126e407-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:56:53.067657 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.067561 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/351d8b60-ae26-4785-9900-5f29d126e407-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:56:53.067657 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.067589 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/351d8b60-ae26-4785-9900-5f29d126e407-data-volume\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:56:53.067657 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.067626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbczz\" (UniqueName: \"kubernetes.io/projected/351d8b60-ae26-4785-9900-5f29d126e407-kube-api-access-fbczz\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:56:53.067765 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.067710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/351d8b60-ae26-4785-9900-5f29d126e407-crio-socket\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:56:53.168851 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.168825 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/351d8b60-ae26-4785-9900-5f29d126e407-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:56:53.168942 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.168868 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/351d8b60-ae26-4785-9900-5f29d126e407-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:56:53.168985 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:53.168955 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:56:53.168985 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:53.168971 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:56:53.169073 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.168955 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/351d8b60-ae26-4785-9900-5f29d126e407-data-volume\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:56:53.169073 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:53.169017 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/351d8b60-ae26-4785-9900-5f29d126e407-kube-rbac-proxy-cm podName:351d8b60-ae26-4785-9900-5f29d126e407 nodeName:}" failed. No retries permitted until 2026-06-11 19:56:53.669000888 +0000 UTC m=+176.700717507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/351d8b60-ae26-4785-9900-5f29d126e407-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l4cvq" (UID: "351d8b60-ae26-4785-9900-5f29d126e407") : configmap "kube-rbac-proxy" not found Jun 11 19:56:53.169073 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.169034 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbczz\" (UniqueName: \"kubernetes.io/projected/351d8b60-ae26-4785-9900-5f29d126e407-kube-api-access-fbczz\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:56:53.169073 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:53.169064 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/351d8b60-ae26-4785-9900-5f29d126e407-insights-runtime-extractor-tls podName:351d8b60-ae26-4785-9900-5f29d126e407 nodeName:}" failed. No retries permitted until 2026-06-11 19:56:53.669034934 +0000 UTC m=+176.700751568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/351d8b60-ae26-4785-9900-5f29d126e407-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l4cvq" (UID: "351d8b60-ae26-4785-9900-5f29d126e407") : secret "insights-runtime-extractor-tls" not found Jun 11 19:56:53.169272 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.169146 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/351d8b60-ae26-4785-9900-5f29d126e407-crio-socket\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:56:53.169272 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.169217 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/351d8b60-ae26-4785-9900-5f29d126e407-data-volume\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:56:53.169272 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.169245 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/351d8b60-ae26-4785-9900-5f29d126e407-crio-socket\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:56:53.177179 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.177156 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbczz\" (UniqueName: \"kubernetes.io/projected/351d8b60-ae26-4785-9900-5f29d126e407-kube-api-access-fbczz\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:56:53.673206 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.673166 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/351d8b60-ae26-4785-9900-5f29d126e407-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:56:53.673412 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:53.673243 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/351d8b60-ae26-4785-9900-5f29d126e407-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:56:53.673412 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:53.673304 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:56:53.673412 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:53.673325 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:56:53.673412 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:53.673373 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/351d8b60-ae26-4785-9900-5f29d126e407-insights-runtime-extractor-tls podName:351d8b60-ae26-4785-9900-5f29d126e407 nodeName:}" failed. No retries permitted until 2026-06-11 19:56:54.673359362 +0000 UTC m=+177.705075980 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/351d8b60-ae26-4785-9900-5f29d126e407-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l4cvq" (UID: "351d8b60-ae26-4785-9900-5f29d126e407") : secret "insights-runtime-extractor-tls" not found Jun 11 19:56:53.673412 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:53.673386 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/351d8b60-ae26-4785-9900-5f29d126e407-kube-rbac-proxy-cm podName:351d8b60-ae26-4785-9900-5f29d126e407 nodeName:}" failed. No retries permitted until 2026-06-11 19:56:54.67337969 +0000 UTC m=+177.705096307 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/351d8b60-ae26-4785-9900-5f29d126e407-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l4cvq" (UID: "351d8b60-ae26-4785-9900-5f29d126e407") : configmap "kube-rbac-proxy" not found Jun 11 19:56:54.681817 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:54.681768 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/351d8b60-ae26-4785-9900-5f29d126e407-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:56:54.682192 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:54.681854 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/351d8b60-ae26-4785-9900-5f29d126e407-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:56:54.682192 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:54.681892 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:56:54.682192 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:54.681936 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:56:54.682192 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:54.681961 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/351d8b60-ae26-4785-9900-5f29d126e407-kube-rbac-proxy-cm podName:351d8b60-ae26-4785-9900-5f29d126e407 nodeName:}" failed. No retries permitted until 2026-06-11 19:56:56.681944207 +0000 UTC m=+179.713660832 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/351d8b60-ae26-4785-9900-5f29d126e407-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l4cvq" (UID: "351d8b60-ae26-4785-9900-5f29d126e407") : configmap "kube-rbac-proxy" not found Jun 11 19:56:54.682192 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:54.681979 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/351d8b60-ae26-4785-9900-5f29d126e407-insights-runtime-extractor-tls podName:351d8b60-ae26-4785-9900-5f29d126e407 nodeName:}" failed. No retries permitted until 2026-06-11 19:56:56.681967985 +0000 UTC m=+179.713684602 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/351d8b60-ae26-4785-9900-5f29d126e407-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l4cvq" (UID: "351d8b60-ae26-4785-9900-5f29d126e407") : secret "insights-runtime-extractor-tls" not found Jun 11 19:56:55.139666 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.139635 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-jrx7d"] Jun 11 19:56:55.142522 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.142507 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-jrx7d" Jun 11 19:56:55.145055 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.145032 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-s6q68\"" Jun 11 19:56:55.145168 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.145072 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 19:56:55.145168 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.145072 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 19:56:55.145973 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.145956 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 19:56:55.146071 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.145978 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 19:56:55.150136 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.150115 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-jrx7d"] Jun 11 19:56:55.179674 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.179650 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rkxzl_9b7199ae-2384-40a9-ac35-f185dcce8701/dns-node-resolver/0.log" Jun 11 19:56:55.185943 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.185910 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/333ade1e-e5fc-4699-9f4a-4091bc0065aa-signing-key\") pod \"service-ca-7b994bc59-jrx7d\" (UID: \"333ade1e-e5fc-4699-9f4a-4091bc0065aa\") " pod="openshift-service-ca/service-ca-7b994bc59-jrx7d" Jun 11 19:56:55.186042 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.185962 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlfcf\" (UniqueName: \"kubernetes.io/projected/333ade1e-e5fc-4699-9f4a-4091bc0065aa-kube-api-access-tlfcf\") pod \"service-ca-7b994bc59-jrx7d\" (UID: \"333ade1e-e5fc-4699-9f4a-4091bc0065aa\") " pod="openshift-service-ca/service-ca-7b994bc59-jrx7d" Jun 11 19:56:55.186042 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.186012 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/333ade1e-e5fc-4699-9f4a-4091bc0065aa-signing-cabundle\") pod \"service-ca-7b994bc59-jrx7d\" (UID: \"333ade1e-e5fc-4699-9f4a-4091bc0065aa\") " pod="openshift-service-ca/service-ca-7b994bc59-jrx7d" Jun 11 19:56:55.287004 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.286976 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/333ade1e-e5fc-4699-9f4a-4091bc0065aa-signing-cabundle\") pod \"service-ca-7b994bc59-jrx7d\" (UID: \"333ade1e-e5fc-4699-9f4a-4091bc0065aa\") " pod="openshift-service-ca/service-ca-7b994bc59-jrx7d" Jun 11 19:56:55.287109 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.287066 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/333ade1e-e5fc-4699-9f4a-4091bc0065aa-signing-key\") pod \"service-ca-7b994bc59-jrx7d\" (UID: \"333ade1e-e5fc-4699-9f4a-4091bc0065aa\") " pod="openshift-service-ca/service-ca-7b994bc59-jrx7d" Jun 11 19:56:55.287109 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.287098 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlfcf\" (UniqueName: \"kubernetes.io/projected/333ade1e-e5fc-4699-9f4a-4091bc0065aa-kube-api-access-tlfcf\") pod \"service-ca-7b994bc59-jrx7d\" (UID: \"333ade1e-e5fc-4699-9f4a-4091bc0065aa\") " pod="openshift-service-ca/service-ca-7b994bc59-jrx7d" Jun 11 19:56:55.287572 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.287552 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/333ade1e-e5fc-4699-9f4a-4091bc0065aa-signing-cabundle\") pod \"service-ca-7b994bc59-jrx7d\" (UID: \"333ade1e-e5fc-4699-9f4a-4091bc0065aa\") " pod="openshift-service-ca/service-ca-7b994bc59-jrx7d" Jun 11 19:56:55.289530 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.289508 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/333ade1e-e5fc-4699-9f4a-4091bc0065aa-signing-key\") pod \"service-ca-7b994bc59-jrx7d\" (UID: \"333ade1e-e5fc-4699-9f4a-4091bc0065aa\") " pod="openshift-service-ca/service-ca-7b994bc59-jrx7d" Jun 11 19:56:55.297156 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.297136 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlfcf\" (UniqueName: \"kubernetes.io/projected/333ade1e-e5fc-4699-9f4a-4091bc0065aa-kube-api-access-tlfcf\") pod \"service-ca-7b994bc59-jrx7d\" (UID: \"333ade1e-e5fc-4699-9f4a-4091bc0065aa\") " pod="openshift-service-ca/service-ca-7b994bc59-jrx7d" Jun 11 19:56:55.451695 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.451623 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-jrx7d" Jun 11 19:56:55.570842 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.570815 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-jrx7d"] Jun 11 19:56:55.574140 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:56:55.574114 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod333ade1e_e5fc_4699_9f4a_4091bc0065aa.slice/crio-5c4ca2dfcfccf4f83bc7bc28b6a479fda7ca9acb3fdf1758319ce4e6857dc4ee WatchSource:0}: Error finding container 5c4ca2dfcfccf4f83bc7bc28b6a479fda7ca9acb3fdf1758319ce4e6857dc4ee: Status 404 returned error can't find the container with id 5c4ca2dfcfccf4f83bc7bc28b6a479fda7ca9acb3fdf1758319ce4e6857dc4ee Jun 11 19:56:55.896113 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.896082 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-jrx7d" event={"ID":"333ade1e-e5fc-4699-9f4a-4091bc0065aa","Type":"ContainerStarted","Data":"5c4ca2dfcfccf4f83bc7bc28b6a479fda7ca9acb3fdf1758319ce4e6857dc4ee"} Jun 11 19:56:55.981042 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:55.981015 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bk68w_ad4cb0c0-3045-4129-a116-d02b9e1dfd57/node-ca/0.log" Jun 11 19:56:56.580390 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:56.580344 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qfp6k_d96c8cfe-b03a-40be-9956-8d0477442dac/serve-healthcheck-canary/0.log" Jun 11 19:56:56.697389 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:56.697350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/351d8b60-ae26-4785-9900-5f29d126e407-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:56:56.697569 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:56.697413 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/351d8b60-ae26-4785-9900-5f29d126e407-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:56:56.697569 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:56.697517 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:56:56.697569 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:56.697527 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:56:56.697714 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:56.697604 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/351d8b60-ae26-4785-9900-5f29d126e407-insights-runtime-extractor-tls podName:351d8b60-ae26-4785-9900-5f29d126e407 nodeName:}" failed. No retries permitted until 2026-06-11 19:57:00.697587911 +0000 UTC m=+183.729304529 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/351d8b60-ae26-4785-9900-5f29d126e407-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l4cvq" (UID: "351d8b60-ae26-4785-9900-5f29d126e407") : secret "insights-runtime-extractor-tls" not found Jun 11 19:56:56.697714 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:56:56.697625 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/351d8b60-ae26-4785-9900-5f29d126e407-kube-rbac-proxy-cm podName:351d8b60-ae26-4785-9900-5f29d126e407 nodeName:}" failed. No retries permitted until 2026-06-11 19:57:00.697614388 +0000 UTC m=+183.729331006 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/351d8b60-ae26-4785-9900-5f29d126e407-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l4cvq" (UID: "351d8b60-ae26-4785-9900-5f29d126e407") : configmap "kube-rbac-proxy" not found Jun 11 19:56:57.903311 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:57.903276 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-jrx7d" event={"ID":"333ade1e-e5fc-4699-9f4a-4091bc0065aa","Type":"ContainerStarted","Data":"669977ae8ecdf1144a7ea12ffbd315a29f2f90d1d5af3b3a5b406392c76e46c8"} Jun 11 19:56:57.917953 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:56:57.917909 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-jrx7d" podStartSLOduration=1.349118713 podStartE2EDuration="2.917892883s" totalImagesPullingTime="1.56877417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:56:57.917326103 +0000 UTC m=+180.949042742" watchObservedRunningTime="2026-06-11 19:56:57.917892883 +0000 UTC m=+180.949609559" Jun 11 19:57:00.730174 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:00.730143 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/351d8b60-ae26-4785-9900-5f29d126e407-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:57:00.730535 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:00.730185 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/351d8b60-ae26-4785-9900-5f29d126e407-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:57:00.730535 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:57:00.730250 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:57:00.730535 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:57:00.730284 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:57:00.730535 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:57:00.730290 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/351d8b60-ae26-4785-9900-5f29d126e407-kube-rbac-proxy-cm podName:351d8b60-ae26-4785-9900-5f29d126e407 nodeName:}" failed. No retries permitted until 2026-06-11 19:57:08.730277067 +0000 UTC m=+191.761993697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/351d8b60-ae26-4785-9900-5f29d126e407-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l4cvq" (UID: "351d8b60-ae26-4785-9900-5f29d126e407") : configmap "kube-rbac-proxy" not found Jun 11 19:57:00.730535 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:57:00.730422 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/351d8b60-ae26-4785-9900-5f29d126e407-insights-runtime-extractor-tls podName:351d8b60-ae26-4785-9900-5f29d126e407 nodeName:}" failed. No retries permitted until 2026-06-11 19:57:08.730407073 +0000 UTC m=+191.762123691 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/351d8b60-ae26-4785-9900-5f29d126e407-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l4cvq" (UID: "351d8b60-ae26-4785-9900-5f29d126e407") : secret "insights-runtime-extractor-tls" not found Jun 11 19:57:02.708392 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:02.708348 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" podUID="f33948cf-ad2a-4d8d-b9b3-efc7123aed91" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 19:57:08.790536 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:08.790500 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/351d8b60-ae26-4785-9900-5f29d126e407-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:57:08.790993 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:08.790547 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/351d8b60-ae26-4785-9900-5f29d126e407-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:57:08.791035 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:08.791003 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/351d8b60-ae26-4785-9900-5f29d126e407-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:57:08.792907 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:08.792884 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/351d8b60-ae26-4785-9900-5f29d126e407-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l4cvq\" (UID: \"351d8b60-ae26-4785-9900-5f29d126e407\") " pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:57:08.915383 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:08.915354 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l8fvt\"" Jun 11 19:57:08.923762 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:08.923744 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l4cvq" Jun 11 19:57:09.049466 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:09.049394 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l4cvq"] Jun 11 19:57:09.052358 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:57:09.052326 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod351d8b60_ae26_4785_9900_5f29d126e407.slice/crio-7d15a382c8611665855963cb16c2512c6a2a8ff25eb6fed6574e07fb2731329a WatchSource:0}: Error finding container 7d15a382c8611665855963cb16c2512c6a2a8ff25eb6fed6574e07fb2731329a: Status 404 returned error can't find the container with id 7d15a382c8611665855963cb16c2512c6a2a8ff25eb6fed6574e07fb2731329a Jun 11 19:57:09.938656 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:09.938613 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l4cvq" event={"ID":"351d8b60-ae26-4785-9900-5f29d126e407","Type":"ContainerStarted","Data":"7d15a382c8611665855963cb16c2512c6a2a8ff25eb6fed6574e07fb2731329a"} Jun 11 19:57:12.708383 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:12.708351 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" podUID="f33948cf-ad2a-4d8d-b9b3-efc7123aed91" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 19:57:12.949977 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:12.949896 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l4cvq" event={"ID":"351d8b60-ae26-4785-9900-5f29d126e407","Type":"ContainerStarted","Data":"075c5affbefd7d0f87580ced794160d4c243b9ed2164e95f43688e53373ce218"} Jun 11 19:57:13.954930 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:13.954891 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l4cvq" event={"ID":"351d8b60-ae26-4785-9900-5f29d126e407","Type":"ContainerStarted","Data":"3abdd384bdeff2e4e4b0e77ce4fd7299662e0808c7ad2b4e938394d35395d6f1"} Jun 11 19:57:14.959666 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:14.959638 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l4cvq" event={"ID":"351d8b60-ae26-4785-9900-5f29d126e407","Type":"ContainerStarted","Data":"f2cac3012e18a21e2f051ec9859dc616576aeb6eedc8fcf90779deba60beb33d"} Jun 11 19:57:14.990266 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:14.990220 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l4cvq" podStartSLOduration=17.29506649 podStartE2EDuration="22.990205042s" totalImagesPullingTime="5.695138552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:56:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:57:14.98924437 +0000 UTC m=+198.020961011" watchObservedRunningTime="2026-06-11 19:57:14.990205042 +0000 UTC m=+198.021921660" Jun 11 19:57:22.309802 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:22.309751 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-thd84"] Jun 11 19:57:22.312792 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:22.312768 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-thd84" Jun 11 19:57:22.315230 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:22.315202 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 19:57:22.315230 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:22.315219 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-8wxcd\"" Jun 11 19:57:22.320219 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:22.320198 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-thd84"] Jun 11 19:57:22.387965 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:22.387930 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8493dedb-4a7d-4f91-86ae-0e9818d1b3b2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-thd84\" (UID: \"8493dedb-4a7d-4f91-86ae-0e9818d1b3b2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-thd84" Jun 11 19:57:22.489155 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:22.489119 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8493dedb-4a7d-4f91-86ae-0e9818d1b3b2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-thd84\" (UID: \"8493dedb-4a7d-4f91-86ae-0e9818d1b3b2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-thd84" Jun 11 19:57:22.489293 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:57:22.489268 2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 11 19:57:22.489340 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:57:22.489329 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8493dedb-4a7d-4f91-86ae-0e9818d1b3b2-tls-certificates podName:8493dedb-4a7d-4f91-86ae-0e9818d1b3b2 nodeName:}" failed. No retries permitted until 2026-06-11 19:57:22.989314306 +0000 UTC m=+206.021030924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/8493dedb-4a7d-4f91-86ae-0e9818d1b3b2-tls-certificates") pod "prometheus-operator-admission-webhook-5cf667749c-thd84" (UID: "8493dedb-4a7d-4f91-86ae-0e9818d1b3b2") : secret "prometheus-operator-admission-webhook-tls" not found Jun 11 19:57:22.709163 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:22.709129 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" podUID="f33948cf-ad2a-4d8d-b9b3-efc7123aed91" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 19:57:22.709340 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:22.709210 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" Jun 11 19:57:22.709722 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:22.709688 2564 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"0d9d5e4c356a843421862671a8dc911f08dff7f31f71fb085d5875355be27f75"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 11 19:57:22.709861 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:22.709745 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" podUID="f33948cf-ad2a-4d8d-b9b3-efc7123aed91" containerName="service-proxy" containerID="cri-o://0d9d5e4c356a843421862671a8dc911f08dff7f31f71fb085d5875355be27f75" gracePeriod=30 Jun 11 19:57:22.984760 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:22.984669 2564 generic.go:356] "Generic (PLEG): container finished" podID="f33948cf-ad2a-4d8d-b9b3-efc7123aed91" containerID="0d9d5e4c356a843421862671a8dc911f08dff7f31f71fb085d5875355be27f75" exitCode=2 Jun 11 19:57:22.984760 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:22.984720 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" event={"ID":"f33948cf-ad2a-4d8d-b9b3-efc7123aed91","Type":"ContainerDied","Data":"0d9d5e4c356a843421862671a8dc911f08dff7f31f71fb085d5875355be27f75"} Jun 11 19:57:22.984947 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:22.984763 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cbbd6f56d-w87hq" event={"ID":"f33948cf-ad2a-4d8d-b9b3-efc7123aed91","Type":"ContainerStarted","Data":"02df331348214c11476a758a0756887dccd3b38fdb2a8675610ea3dc2518b799"} Jun 11 19:57:22.993281 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:22.993262 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8493dedb-4a7d-4f91-86ae-0e9818d1b3b2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-thd84\" (UID: \"8493dedb-4a7d-4f91-86ae-0e9818d1b3b2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-thd84" Jun 11 19:57:22.995703 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:22.995675 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8493dedb-4a7d-4f91-86ae-0e9818d1b3b2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-thd84\" (UID: \"8493dedb-4a7d-4f91-86ae-0e9818d1b3b2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-thd84" Jun 11 19:57:23.221446 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:23.221407 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-thd84" Jun 11 19:57:23.344934 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:57:23.344908 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8493dedb_4a7d_4f91_86ae_0e9818d1b3b2.slice/crio-92feafdcd8406526b71c6c7a80432d70645afdc73442d7c6ea0657a8bdf3b82c WatchSource:0}: Error finding container 92feafdcd8406526b71c6c7a80432d70645afdc73442d7c6ea0657a8bdf3b82c: Status 404 returned error can't find the container with id 92feafdcd8406526b71c6c7a80432d70645afdc73442d7c6ea0657a8bdf3b82c Jun 11 19:57:23.346097 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:23.346066 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-thd84"] Jun 11 19:57:23.989308 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:23.989275 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-thd84" event={"ID":"8493dedb-4a7d-4f91-86ae-0e9818d1b3b2","Type":"ContainerStarted","Data":"92feafdcd8406526b71c6c7a80432d70645afdc73442d7c6ea0657a8bdf3b82c"} Jun 11 19:57:24.993102 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:24.993072 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-thd84" event={"ID":"8493dedb-4a7d-4f91-86ae-0e9818d1b3b2","Type":"ContainerStarted","Data":"85904b65369f6213ee99435657f1b245bc668eb77677b5463484997d6881be7d"} Jun 11 19:57:24.993548 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:24.993282 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-thd84" Jun 11 19:57:24.997894 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:24.997869 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-thd84" Jun 11 19:57:25.011638 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:25.011497 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-thd84" podStartSLOduration=1.991339168 podStartE2EDuration="3.011482494s" totalImagesPullingTime="1.020143326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:57:25.011157468 +0000 UTC m=+208.042874108" watchObservedRunningTime="2026-06-11 19:57:25.011482494 +0000 UTC m=+208.043199135" Jun 11 19:57:27.010475 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.010437 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fbdd5559c-xcqmq"] Jun 11 19:57:27.013315 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.013300 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:27.016120 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.016094 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 19:57:27.017925 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.016528 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 19:57:27.017925 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.017329 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 19:57:27.017925 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.017601 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vm97n\"" Jun 11 19:57:27.017925 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.017614 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 19:57:27.017925 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.017717 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 19:57:27.017925 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.017845 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 19:57:27.018248 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.017950 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 19:57:27.029351 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.029230 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fbdd5559c-xcqmq"] Jun 11 19:57:27.121301 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.121264 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/162c4db6-84d1-4f08-ab7e-d11f5960401b-service-ca\") pod \"console-7fbdd5559c-xcqmq\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:27.121301 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.121303 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/162c4db6-84d1-4f08-ab7e-d11f5960401b-console-config\") pod \"console-7fbdd5559c-xcqmq\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:27.121484 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.121381 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/162c4db6-84d1-4f08-ab7e-d11f5960401b-console-serving-cert\") pod \"console-7fbdd5559c-xcqmq\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:27.121484 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.121412 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22w2k\" (UniqueName: \"kubernetes.io/projected/162c4db6-84d1-4f08-ab7e-d11f5960401b-kube-api-access-22w2k\") pod \"console-7fbdd5559c-xcqmq\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:27.121484 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.121464 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/162c4db6-84d1-4f08-ab7e-d11f5960401b-console-oauth-config\") pod \"console-7fbdd5559c-xcqmq\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:27.121576 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.121483 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/162c4db6-84d1-4f08-ab7e-d11f5960401b-oauth-serving-cert\") pod \"console-7fbdd5559c-xcqmq\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:27.222284 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.222238 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/162c4db6-84d1-4f08-ab7e-d11f5960401b-service-ca\") pod \"console-7fbdd5559c-xcqmq\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:27.222284 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.222284 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/162c4db6-84d1-4f08-ab7e-d11f5960401b-console-config\") pod \"console-7fbdd5559c-xcqmq\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:27.222482 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.222317 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/162c4db6-84d1-4f08-ab7e-d11f5960401b-console-serving-cert\") pod \"console-7fbdd5559c-xcqmq\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:27.222482 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.222337 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22w2k\" (UniqueName: \"kubernetes.io/projected/162c4db6-84d1-4f08-ab7e-d11f5960401b-kube-api-access-22w2k\") pod \"console-7fbdd5559c-xcqmq\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:27.222482 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.222360 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/162c4db6-84d1-4f08-ab7e-d11f5960401b-console-oauth-config\") pod \"console-7fbdd5559c-xcqmq\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:27.222482 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.222374 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/162c4db6-84d1-4f08-ab7e-d11f5960401b-oauth-serving-cert\") pod \"console-7fbdd5559c-xcqmq\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:27.223061 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.223023 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/162c4db6-84d1-4f08-ab7e-d11f5960401b-console-config\") pod \"console-7fbdd5559c-xcqmq\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:27.223061 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.223054 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/162c4db6-84d1-4f08-ab7e-d11f5960401b-oauth-serving-cert\") pod \"console-7fbdd5559c-xcqmq\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:27.223255 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.223236 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/162c4db6-84d1-4f08-ab7e-d11f5960401b-service-ca\") pod \"console-7fbdd5559c-xcqmq\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:27.224746 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.224722 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/162c4db6-84d1-4f08-ab7e-d11f5960401b-console-oauth-config\") pod \"console-7fbdd5559c-xcqmq\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:27.224860 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.224803 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/162c4db6-84d1-4f08-ab7e-d11f5960401b-console-serving-cert\") pod \"console-7fbdd5559c-xcqmq\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:27.232311 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.232293 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22w2k\" (UniqueName: \"kubernetes.io/projected/162c4db6-84d1-4f08-ab7e-d11f5960401b-kube-api-access-22w2k\") pod \"console-7fbdd5559c-xcqmq\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:27.323576 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.323546 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:27.448305 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:27.448276 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fbdd5559c-xcqmq"] Jun 11 19:57:27.450400 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:57:27.450368 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod162c4db6_84d1_4f08_ab7e_d11f5960401b.slice/crio-8694fbe8b2317235d82ec29ca085131d6a904f841250c81dbb19e05a3dc794f7 WatchSource:0}: Error finding container 8694fbe8b2317235d82ec29ca085131d6a904f841250c81dbb19e05a3dc794f7: Status 404 returned error can't find the container with id 8694fbe8b2317235d82ec29ca085131d6a904f841250c81dbb19e05a3dc794f7 Jun 11 19:57:28.003212 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:28.003180 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fbdd5559c-xcqmq" event={"ID":"162c4db6-84d1-4f08-ab7e-d11f5960401b","Type":"ContainerStarted","Data":"8694fbe8b2317235d82ec29ca085131d6a904f841250c81dbb19e05a3dc794f7"} Jun 11 19:57:29.725301 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.725263 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l5pjk"] Jun 11 19:57:29.729109 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.729083 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.732333 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.732114 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 19:57:29.732333 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.732217 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 19:57:29.732670 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.732647 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 19:57:29.732799 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.732716 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fp2kf\"" Jun 11 19:57:29.732995 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.732906 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 19:57:29.732995 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.732979 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 19:57:29.733332 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.733309 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 19:57:29.841354 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.841317 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wswvp\" (UniqueName: \"kubernetes.io/projected/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-kube-api-access-wswvp\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.841555 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.841411 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.841555 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.841442 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-node-exporter-wtmp\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.841555 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.841471 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-node-exporter-textfile\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.841555 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.841513 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-root\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.841555 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.841551 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-metrics-client-ca\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.841857 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.841641 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-sys\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.841857 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.841682 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-node-exporter-tls\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.841857 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.841716 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-node-exporter-accelerators-collector-config\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.942824 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.942767 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wswvp\" (UniqueName: \"kubernetes.io/projected/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-kube-api-access-wswvp\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.942957 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.942837 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.942957 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.942864 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-node-exporter-wtmp\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.942957 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.942883 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-node-exporter-textfile\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.942957 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.942910 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-root\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.942957 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.942927 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-metrics-client-ca\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.942957 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.942942 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-sys\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.942957 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.942958 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-node-exporter-tls\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.943184 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.942998 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-node-exporter-accelerators-collector-config\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.943843 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.943448 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-node-exporter-wtmp\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.943843 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.943528 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-sys\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.943843 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.943548 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-node-exporter-textfile\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.943843 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.943592 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-node-exporter-accelerators-collector-config\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.943843 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.943608 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-root\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.943843 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.943700 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-metrics-client-ca\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.945969 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.945950 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.946943 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.946924 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-node-exporter-tls\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:29.952658 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:29.952613 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wswvp\" (UniqueName: \"kubernetes.io/projected/9615928b-9884-4a2e-8b27-3d2ca7f4b59d-kube-api-access-wswvp\") pod \"node-exporter-l5pjk\" (UID: \"9615928b-9884-4a2e-8b27-3d2ca7f4b59d\") " pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:30.041815 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.041720 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l5pjk" Jun 11 19:57:30.792092 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.792055 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:57:30.801016 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.800986 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:30.803380 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.803352 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 19:57:30.803511 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.803392 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 19:57:30.803845 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.803639 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 19:57:30.803845 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.803678 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 19:57:30.803845 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.803704 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 19:57:30.804083 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.803991 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 19:57:30.804083 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.804046 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6t2lb\"" Jun 11 19:57:30.804185 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.804081 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 19:57:30.804185 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.804165 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 19:57:30.804257 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.804048 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 19:57:30.811330 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.811048 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:57:30.952740 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.952699 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:30.952938 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.952751 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:30.952938 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.952779 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:30.953050 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.952933 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:30.953050 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.952990 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sht6c\" (UniqueName: \"kubernetes.io/projected/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-kube-api-access-sht6c\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:30.953050 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.953027 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:30.953176 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.953058 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:30.953176 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.953113 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-web-config\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:30.953176 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.953160 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:30.953314 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.953220 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:30.953314 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.953250 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:30.953314 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.953280 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-config-out\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:30.953314 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:30.953301 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-config-volume\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.004296 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:57:31.004267 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9615928b_9884_4a2e_8b27_3d2ca7f4b59d.slice/crio-dce4a64ac15a81f8cc325f4dea74b2836e5cd58fa67743a2df88caa8eb17f36d WatchSource:0}: Error finding container dce4a64ac15a81f8cc325f4dea74b2836e5cd58fa67743a2df88caa8eb17f36d: Status 404 returned error can't find the container with id dce4a64ac15a81f8cc325f4dea74b2836e5cd58fa67743a2df88caa8eb17f36d Jun 11 19:57:31.015694 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.015669 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l5pjk" event={"ID":"9615928b-9884-4a2e-8b27-3d2ca7f4b59d","Type":"ContainerStarted","Data":"dce4a64ac15a81f8cc325f4dea74b2836e5cd58fa67743a2df88caa8eb17f36d"} Jun 11 19:57:31.054345 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.054322 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-config-volume\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.054443 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.054358 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.054543 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.054519 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.054601 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.054562 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.054657 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.054645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.054712 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.054686 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sht6c\" (UniqueName: \"kubernetes.io/projected/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-kube-api-access-sht6c\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.054768 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.054723 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.055059 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.055021 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.055170 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.055060 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-web-config\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.055170 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.055088 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.055170 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.055121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.055170 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.055148 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.055369 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.055185 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-config-out\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.055369 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.055218 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.056253 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.055772 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.057017 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.056991 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.057610 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.057582 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.057767 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.057698 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-config-out\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.058146 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.058117 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.058146 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.058131 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.058521 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.058504 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.059285 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.059254 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-config-volume\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.059379 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.059272 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.059484 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.059461 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-web-config\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.060138 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.060112 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.062158 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.062139 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sht6c\" (UniqueName: \"kubernetes.io/projected/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-kube-api-access-sht6c\") pod \"alertmanager-main-0\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.119622 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.119604 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:57:31.256591 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.256561 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:57:31.259360 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:57:31.259332 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbf1d70d_c722_4dcd_bb9b_542ddd61e1b4.slice/crio-47ae763da6350e3a11cfb777c46c3330e0b2446062afb1bc83ba143885c20cc7 WatchSource:0}: Error finding container 47ae763da6350e3a11cfb777c46c3330e0b2446062afb1bc83ba143885c20cc7: Status 404 returned error can't find the container with id 47ae763da6350e3a11cfb777c46c3330e0b2446062afb1bc83ba143885c20cc7 Jun 11 19:57:31.698276 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.698242 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-864bb64949-bjgkg"] Jun 11 19:57:31.706255 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.706220 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.709266 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.708877 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 19:57:31.709266 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.708943 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 19:57:31.709266 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.708964 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 19:57:31.709499 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.709411 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qwxfx\"" Jun 11 19:57:31.709499 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.709482 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 19:57:31.709849 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.709828 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 19:57:31.709849 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.709845 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-40ne6i180ln9h\"" Jun 11 19:57:31.715773 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.714467 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-864bb64949-bjgkg"] Jun 11 19:57:31.863528 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.863495 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1fb80569-82a4-40ba-a2eb-c82860d4b05b-secret-grpc-tls\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.863953 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.863552 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1fb80569-82a4-40ba-a2eb-c82860d4b05b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.863953 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.863623 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxbs4\" (UniqueName: \"kubernetes.io/projected/1fb80569-82a4-40ba-a2eb-c82860d4b05b-kube-api-access-fxbs4\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.863953 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.863674 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1fb80569-82a4-40ba-a2eb-c82860d4b05b-secret-thanos-querier-tls\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.863953 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.863700 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fb80569-82a4-40ba-a2eb-c82860d4b05b-metrics-client-ca\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.863953 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.863723 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1fb80569-82a4-40ba-a2eb-c82860d4b05b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.863953 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.863747 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1fb80569-82a4-40ba-a2eb-c82860d4b05b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.863953 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.863842 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1fb80569-82a4-40ba-a2eb-c82860d4b05b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.964448 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.964423 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1fb80569-82a4-40ba-a2eb-c82860d4b05b-secret-grpc-tls\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.964560 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.964470 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1fb80569-82a4-40ba-a2eb-c82860d4b05b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.964744 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.964722 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxbs4\" (UniqueName: \"kubernetes.io/projected/1fb80569-82a4-40ba-a2eb-c82860d4b05b-kube-api-access-fxbs4\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.964876 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.964761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1fb80569-82a4-40ba-a2eb-c82860d4b05b-secret-thanos-querier-tls\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.964876 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.964808 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fb80569-82a4-40ba-a2eb-c82860d4b05b-metrics-client-ca\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.964876 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.964845 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1fb80569-82a4-40ba-a2eb-c82860d4b05b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.965039 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.964876 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1fb80569-82a4-40ba-a2eb-c82860d4b05b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.965039 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.964918 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1fb80569-82a4-40ba-a2eb-c82860d4b05b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.966152 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.966123 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fb80569-82a4-40ba-a2eb-c82860d4b05b-metrics-client-ca\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.967381 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.967358 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1fb80569-82a4-40ba-a2eb-c82860d4b05b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.967869 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.967843 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1fb80569-82a4-40ba-a2eb-c82860d4b05b-secret-grpc-tls\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.968042 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.968025 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1fb80569-82a4-40ba-a2eb-c82860d4b05b-secret-thanos-querier-tls\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.968112 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.968088 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1fb80569-82a4-40ba-a2eb-c82860d4b05b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.968194 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.968170 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1fb80569-82a4-40ba-a2eb-c82860d4b05b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.968750 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.968730 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1fb80569-82a4-40ba-a2eb-c82860d4b05b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:31.973390 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:31.973366 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxbs4\" (UniqueName: \"kubernetes.io/projected/1fb80569-82a4-40ba-a2eb-c82860d4b05b-kube-api-access-fxbs4\") pod \"thanos-querier-864bb64949-bjgkg\" (UID: \"1fb80569-82a4-40ba-a2eb-c82860d4b05b\") " pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:32.019282 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:32.019053 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:32.021947 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:32.021914 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4","Type":"ContainerStarted","Data":"47ae763da6350e3a11cfb777c46c3330e0b2446062afb1bc83ba143885c20cc7"} Jun 11 19:57:32.023773 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:32.023749 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fbdd5559c-xcqmq" event={"ID":"162c4db6-84d1-4f08-ab7e-d11f5960401b","Type":"ContainerStarted","Data":"894b8b5c610984eea0cbfa9583272d0197685891724490465fee420c2436678a"} Jun 11 19:57:32.025505 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:32.025483 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l5pjk" event={"ID":"9615928b-9884-4a2e-8b27-3d2ca7f4b59d","Type":"ContainerStarted","Data":"f878e18a66ce482bbb7d9c0b9cffe466cf0a501750579cf02b1fe21960b45c2b"} Jun 11 19:57:32.042203 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:32.042156 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fbdd5559c-xcqmq" podStartSLOduration=2.443416231 podStartE2EDuration="6.042142402s" totalImagesPullingTime="3.598726171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:57:32.041172623 +0000 UTC m=+215.072889278" watchObservedRunningTime="2026-06-11 19:57:32.042142402 +0000 UTC m=+215.073859111" Jun 11 19:57:32.318813 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:32.318757 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-864bb64949-bjgkg"] Jun 11 19:57:32.321410 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:57:32.321385 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb80569_82a4_40ba_a2eb_c82860d4b05b.slice/crio-5cd53ba7c27c16b8ca2d64e1f3a0745b5961de18e2b9c2dc7623463bb33cd074 WatchSource:0}: Error finding container 5cd53ba7c27c16b8ca2d64e1f3a0745b5961de18e2b9c2dc7623463bb33cd074: Status 404 returned error can't find the container with id 5cd53ba7c27c16b8ca2d64e1f3a0745b5961de18e2b9c2dc7623463bb33cd074 Jun 11 19:57:33.031135 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:33.031093 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" event={"ID":"1fb80569-82a4-40ba-a2eb-c82860d4b05b","Type":"ContainerStarted","Data":"5cd53ba7c27c16b8ca2d64e1f3a0745b5961de18e2b9c2dc7623463bb33cd074"} Jun 11 19:57:33.032863 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:33.032828 2564 generic.go:356] "Generic (PLEG): container finished" podID="9615928b-9884-4a2e-8b27-3d2ca7f4b59d" containerID="f878e18a66ce482bbb7d9c0b9cffe466cf0a501750579cf02b1fe21960b45c2b" exitCode=0 Jun 11 19:57:33.032994 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:33.032928 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l5pjk" event={"ID":"9615928b-9884-4a2e-8b27-3d2ca7f4b59d","Type":"ContainerDied","Data":"f878e18a66ce482bbb7d9c0b9cffe466cf0a501750579cf02b1fe21960b45c2b"} Jun 11 19:57:33.034722 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:33.034620 2564 generic.go:356] "Generic (PLEG): container finished" podID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerID="be0aa950c1f9b0df185760f4bc0d6da44429c707f9cf74493f9cded1cda502e6" exitCode=0 Jun 11 19:57:33.034722 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:33.034708 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4","Type":"ContainerDied","Data":"be0aa950c1f9b0df185760f4bc0d6da44429c707f9cf74493f9cded1cda502e6"} Jun 11 19:57:34.041761 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.041725 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l5pjk" event={"ID":"9615928b-9884-4a2e-8b27-3d2ca7f4b59d","Type":"ContainerStarted","Data":"df8a313e180a16be5d18e93e29a8f62c9e8a03d21140523a70682e0fb310b34d"} Jun 11 19:57:34.042248 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.041810 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l5pjk" event={"ID":"9615928b-9884-4a2e-8b27-3d2ca7f4b59d","Type":"ContainerStarted","Data":"fe226ad6249c998cdb9c3732908d60f2f1dc0ef36904634354de819101d1632e"} Jun 11 19:57:34.061504 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.061460 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l5pjk" podStartSLOduration=4.107589514 podStartE2EDuration="5.061445007s" totalImagesPullingTime="875.227382ms" totalInitContainerRuntime="78.628111ms" isStatefulPod=true podCreationTimestamp="2026-06-11 19:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:57:34.060118131 +0000 UTC m=+217.091834785" watchObservedRunningTime="2026-06-11 19:57:34.061445007 +0000 UTC m=+217.093161692" Jun 11 19:57:34.120462 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.120433 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-759f689cdb-zx4xv"] Jun 11 19:57:34.123287 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.123263 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.125887 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.125865 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 11 19:57:34.126026 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.125933 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 19:57:34.126026 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.125868 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 11 19:57:34.126026 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.125958 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nnk2g\"" Jun 11 19:57:34.126026 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.126022 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-b85jtmpoi94hr\"" Jun 11 19:57:34.126246 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.126093 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 11 19:57:34.134307 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.134284 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-759f689cdb-zx4xv"] Jun 11 19:57:34.286413 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.286380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbf05462-3c11-403c-bee4-dc50d82ab05d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.286569 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.286506 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fbf05462-3c11-403c-bee4-dc50d82ab05d-metrics-server-audit-profiles\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.286569 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.286535 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fbf05462-3c11-403c-bee4-dc50d82ab05d-client-ca-bundle\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.286658 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.286568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fbf05462-3c11-403c-bee4-dc50d82ab05d-secret-metrics-server-client-certs\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.286658 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.286597 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fbf05462-3c11-403c-bee4-dc50d82ab05d-audit-log\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.286774 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.286666 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq2qn\" (UniqueName: \"kubernetes.io/projected/fbf05462-3c11-403c-bee4-dc50d82ab05d-kube-api-access-kq2qn\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.286774 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.286741 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fbf05462-3c11-403c-bee4-dc50d82ab05d-secret-metrics-server-tls\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.388166 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.388119 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fbf05462-3c11-403c-bee4-dc50d82ab05d-metrics-server-audit-profiles\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.388166 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.388167 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fbf05462-3c11-403c-bee4-dc50d82ab05d-client-ca-bundle\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.388423 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.388206 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fbf05462-3c11-403c-bee4-dc50d82ab05d-secret-metrics-server-client-certs\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.388423 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.388377 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fbf05462-3c11-403c-bee4-dc50d82ab05d-audit-log\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.388533 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.388421 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq2qn\" (UniqueName: \"kubernetes.io/projected/fbf05462-3c11-403c-bee4-dc50d82ab05d-kube-api-access-kq2qn\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.388533 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.388463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fbf05462-3c11-403c-bee4-dc50d82ab05d-secret-metrics-server-tls\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.388533 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.388498 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbf05462-3c11-403c-bee4-dc50d82ab05d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.388732 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.388707 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fbf05462-3c11-403c-bee4-dc50d82ab05d-audit-log\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.389321 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.389292 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fbf05462-3c11-403c-bee4-dc50d82ab05d-metrics-server-audit-profiles\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.389490 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.389472 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbf05462-3c11-403c-bee4-dc50d82ab05d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.391228 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.391200 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fbf05462-3c11-403c-bee4-dc50d82ab05d-secret-metrics-server-client-certs\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.391228 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.391213 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fbf05462-3c11-403c-bee4-dc50d82ab05d-client-ca-bundle\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.391403 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.391391 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fbf05462-3c11-403c-bee4-dc50d82ab05d-secret-metrics-server-tls\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.396829 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.396801 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq2qn\" (UniqueName: \"kubernetes.io/projected/fbf05462-3c11-403c-bee4-dc50d82ab05d-kube-api-access-kq2qn\") pod \"metrics-server-759f689cdb-zx4xv\" (UID: \"fbf05462-3c11-403c-bee4-dc50d82ab05d\") " pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.433859 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.433832 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:34.764242 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:34.764216 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-759f689cdb-zx4xv"] Jun 11 19:57:34.765819 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:57:34.765754 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbf05462_3c11_403c_bee4_dc50d82ab05d.slice/crio-5f616a792bd8266c89ea8970d9af9181ae66a7ff90eee2aed507fbde9e08e6ea WatchSource:0}: Error finding container 5f616a792bd8266c89ea8970d9af9181ae66a7ff90eee2aed507fbde9e08e6ea: Status 404 returned error can't find the container with id 5f616a792bd8266c89ea8970d9af9181ae66a7ff90eee2aed507fbde9e08e6ea Jun 11 19:57:35.046533 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.046503 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" event={"ID":"fbf05462-3c11-403c-bee4-dc50d82ab05d","Type":"ContainerStarted","Data":"5f616a792bd8266c89ea8970d9af9181ae66a7ff90eee2aed507fbde9e08e6ea"} Jun 11 19:57:35.049666 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.049642 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4","Type":"ContainerStarted","Data":"4ab2c9043e10e365f982c327160caf05ef92d0c4ca6abf52a3ccb4633117d74a"} Jun 11 19:57:35.049778 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.049713 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4","Type":"ContainerStarted","Data":"c9908ac188e6e88c4842555388850dfc1d3e57336b5b01abf639be18d8ad7a38"} Jun 11 19:57:35.049778 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.049754 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4","Type":"ContainerStarted","Data":"dcfe25dbb035a5efb73b9cc8523048e384d83a62f8a4dd0d696e1a707bf3c6d2"} Jun 11 19:57:35.049911 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.049808 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4","Type":"ContainerStarted","Data":"ef23cf884025bc6d1dcdeff4d61cbe5d7c7b3c67393892b72d64e442e9d9e589"} Jun 11 19:57:35.049911 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.049850 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4","Type":"ContainerStarted","Data":"075f0456527ab7f6e612a25de58b772b6363f5f00205e2372022f5866620fe76"} Jun 11 19:57:35.051740 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.051720 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" event={"ID":"1fb80569-82a4-40ba-a2eb-c82860d4b05b","Type":"ContainerStarted","Data":"d83fb1943c8787c44454f02aadb72db764cf8f67c8a37dd7a9d56782fc883c75"} Jun 11 19:57:35.051863 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.051771 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" event={"ID":"1fb80569-82a4-40ba-a2eb-c82860d4b05b","Type":"ContainerStarted","Data":"3af7c40da6fed2b04908f8338cab93e0958fb188f1ce9f723b22fee0c534fc64"} Jun 11 19:57:35.051863 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.051812 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" event={"ID":"1fb80569-82a4-40ba-a2eb-c82860d4b05b","Type":"ContainerStarted","Data":"e3ef7b82b4d6b83075abe57234a86f83815ad1382fa1bd725fdfbca0d55ecf6d"} Jun 11 19:57:35.933339 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.933258 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:57:35.937381 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.937358 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:35.940011 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.939987 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x6qdb\"" Jun 11 19:57:35.940126 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.940039 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-33tugpkjnj8vd\"" Jun 11 19:57:35.940126 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.940038 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 19:57:35.940126 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.939989 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 19:57:35.940295 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.940280 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 19:57:35.940375 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.940355 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 19:57:35.940442 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.940362 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 19:57:35.941173 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.941152 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 19:57:35.941288 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.941217 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 19:57:35.941357 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.941340 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 19:57:35.941504 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.941449 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 19:57:35.941678 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.941657 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 19:57:35.941772 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.941699 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 19:57:35.941855 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.941663 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 19:57:35.942086 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.942053 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 19:57:35.943308 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.943288 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 19:57:35.953661 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:35.953641 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:57:36.059589 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.059549 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4","Type":"ContainerStarted","Data":"b03ebdf91160a1c1312b800f387325e4045ef10b9988b0fc1a3a6e28b6f06182"} Jun 11 19:57:36.063172 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.063141 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" event={"ID":"1fb80569-82a4-40ba-a2eb-c82860d4b05b","Type":"ContainerStarted","Data":"a3105712fa4077b487f148f0da461267e04e8c134daf3c34a95a69c31e375a1d"} Jun 11 19:57:36.063305 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.063217 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" event={"ID":"1fb80569-82a4-40ba-a2eb-c82860d4b05b","Type":"ContainerStarted","Data":"918ffe30e60e9645889dbe96020e1dc7826c5bb99d843c8abac5ccfc42f49b78"} Jun 11 19:57:36.063305 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.063261 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" event={"ID":"1fb80569-82a4-40ba-a2eb-c82860d4b05b","Type":"ContainerStarted","Data":"383d43469e1ccc6863eb54870bd2f75fca480426038c270b69d9640b67540323"} Jun 11 19:57:36.063405 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.063333 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:36.094904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.094847 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.8116234540000002 podStartE2EDuration="6.09482952s" totalImagesPullingTime="3.267411859s" totalInitContainerRuntime="15.794207ms" isStatefulPod=false podCreationTimestamp="2026-06-11 19:57:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:57:36.093447967 +0000 UTC m=+219.125164615" watchObservedRunningTime="2026-06-11 19:57:36.09482952 +0000 UTC m=+219.126546161" Jun 11 19:57:36.108824 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.108772 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.109011 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.108835 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.109011 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.108858 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.109011 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.108873 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.109011 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.108891 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-web-config\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.109011 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.108937 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88289a5e-5acf-47af-8e57-ba71345fa447-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.109011 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.108963 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.109011 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.108988 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-config\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.109314 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.109036 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.109314 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.109085 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.109314 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.109115 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.109314 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.109133 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.109314 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.109181 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88289a5e-5acf-47af-8e57-ba71345fa447-config-out\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.109314 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.109201 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.109314 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.109247 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.109314 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.109295 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.109721 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.109320 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.109721 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.109343 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h76rd\" (UniqueName: \"kubernetes.io/projected/88289a5e-5acf-47af-8e57-ba71345fa447-kube-api-access-h76rd\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.109721 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.109411 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.109721 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.109440 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.118050 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.118008 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" podStartSLOduration=2.002454805 podStartE2EDuration="5.117994586s" totalImagesPullingTime="3.115539781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:57:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:57:36.116701768 +0000 UTC m=+219.148418408" watchObservedRunningTime="2026-06-11 19:57:36.117994586 +0000 UTC m=+219.149711226" Jun 11 19:57:36.210591 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.210515 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.210591 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.210555 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.210591 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.210581 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h76rd\" (UniqueName: \"kubernetes.io/projected/88289a5e-5acf-47af-8e57-ba71345fa447-kube-api-access-h76rd\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.210968 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.210945 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.211057 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.211007 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.211057 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.211036 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.211156 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.211083 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.211156 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.211124 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.211156 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.211148 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.211294 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.211178 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-web-config\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.211294 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.211256 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88289a5e-5acf-47af-8e57-ba71345fa447-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.211294 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.211280 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.211426 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.211320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-config\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.211426 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.211348 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.211426 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.211358 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.211426 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.211398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.211602 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.211420 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.211602 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.211472 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.211602 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.211518 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.211602 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.211546 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.211814 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.211648 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88289a5e-5acf-47af-8e57-ba71345fa447-config-out\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.211814 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.211676 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.211935 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.211820 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.213919 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.212385 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.213919 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.213111 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.213919 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.213235 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.213919 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.213730 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.215275 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.214630 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88289a5e-5acf-47af-8e57-ba71345fa447-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.215275 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.215003 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88289a5e-5acf-47af-8e57-ba71345fa447-config-out\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.215275 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.215216 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.216455 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.216396 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.216865 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.216833 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.217371 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.217349 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.217464 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.217448 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-config\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.217575 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.217528 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.217988 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.217950 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.218398 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.218376 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-web-config\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.218490 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.218436 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.219299 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.219280 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.219747 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.219725 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h76rd\" (UniqueName: \"kubernetes.io/projected/88289a5e-5acf-47af-8e57-ba71345fa447-kube-api-access-h76rd\") pod \"prometheus-k8s-0\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.249424 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.249399 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:36.592521 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:36.592486 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:57:36.596842 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:57:36.596814 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88289a5e_5acf_47af_8e57_ba71345fa447.slice/crio-fe9880d4aa01d50a0cda06bba8c9e51511f3d9b9051826d123de6248527fcae7 WatchSource:0}: Error finding container fe9880d4aa01d50a0cda06bba8c9e51511f3d9b9051826d123de6248527fcae7: Status 404 returned error can't find the container with id fe9880d4aa01d50a0cda06bba8c9e51511f3d9b9051826d123de6248527fcae7 Jun 11 19:57:37.067561 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:37.067529 2564 generic.go:356] "Generic (PLEG): container finished" podID="88289a5e-5acf-47af-8e57-ba71345fa447" containerID="1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11" exitCode=0 Jun 11 19:57:37.067980 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:37.067624 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88289a5e-5acf-47af-8e57-ba71345fa447","Type":"ContainerDied","Data":"1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11"} Jun 11 19:57:37.067980 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:37.067713 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88289a5e-5acf-47af-8e57-ba71345fa447","Type":"ContainerStarted","Data":"fe9880d4aa01d50a0cda06bba8c9e51511f3d9b9051826d123de6248527fcae7"} Jun 11 19:57:37.069151 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:37.069120 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" event={"ID":"fbf05462-3c11-403c-bee4-dc50d82ab05d","Type":"ContainerStarted","Data":"ccf687516e79759f5d9c701d57d5fd2b8c950d1f5cc1dbc4c6b1d4b7d1a2ae23"} Jun 11 19:57:37.132949 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:37.132893 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" podStartSLOduration=1.397943318 podStartE2EDuration="3.132872785s" totalImagesPullingTime="1.734929467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:57:37.13201355 +0000 UTC m=+220.163730210" watchObservedRunningTime="2026-06-11 19:57:37.132872785 +0000 UTC m=+220.164589426" Jun 11 19:57:37.324068 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:37.323970 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:37.324068 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:37.324041 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:57:37.325560 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:37.325518 2564 patch_prober.go:28] interesting pod/console-7fbdd5559c-xcqmq container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body= Jun 11 19:57:37.325698 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:37.325576 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7fbdd5559c-xcqmq" podUID="162c4db6-84d1-4f08-ab7e-d11f5960401b" containerName="console" probeResult="failure" output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" Jun 11 19:57:37.974617 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:37.974588 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fbdd5559c-xcqmq"] Jun 11 19:57:41.087690 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:41.087662 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88289a5e-5acf-47af-8e57-ba71345fa447","Type":"ContainerStarted","Data":"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2"} Jun 11 19:57:41.088078 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:41.087730 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88289a5e-5acf-47af-8e57-ba71345fa447","Type":"ContainerStarted","Data":"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7"} Jun 11 19:57:41.088078 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:41.087764 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88289a5e-5acf-47af-8e57-ba71345fa447","Type":"ContainerStarted","Data":"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951"} Jun 11 19:57:41.088078 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:41.087823 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88289a5e-5acf-47af-8e57-ba71345fa447","Type":"ContainerStarted","Data":"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707"} Jun 11 19:57:41.088078 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:41.087852 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88289a5e-5acf-47af-8e57-ba71345fa447","Type":"ContainerStarted","Data":"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325"} Jun 11 19:57:41.088078 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:41.087874 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88289a5e-5acf-47af-8e57-ba71345fa447","Type":"ContainerStarted","Data":"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767"} Jun 11 19:57:41.114999 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:41.114915 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.74180688 podStartE2EDuration="6.114894127s" totalImagesPullingTime="3.352037915s" totalInitContainerRuntime="21.049332ms" isStatefulPod=false podCreationTimestamp="2026-06-11 19:57:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:57:41.114135295 +0000 UTC m=+224.145852130" watchObservedRunningTime="2026-06-11 19:57:41.114894127 +0000 UTC m=+224.146610769" Jun 11 19:57:41.249694 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:41.249667 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:57:42.074662 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:42.074633 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-864bb64949-bjgkg" Jun 11 19:57:54.434585 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:54.434555 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:57:54.434962 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:57:54.434607 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:58:00.790644 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:00.790606 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4/init-config-reloader/0.log" Jun 11 19:58:00.990347 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:00.990317 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4/alertmanager/0.log" Jun 11 19:58:01.190643 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:01.190617 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4/config-reloader/0.log" Jun 11 19:58:01.390091 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:01.390050 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4/kube-rbac-proxy-web/0.log" Jun 11 19:58:01.590887 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:01.590856 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4/kube-rbac-proxy/0.log" Jun 11 19:58:01.791204 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:01.791175 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4/kube-rbac-proxy-metric/0.log" Jun 11 19:58:01.990463 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:01.990390 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4/prom-label-proxy/0.log" Jun 11 19:58:02.990356 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:02.990332 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-759f689cdb-zx4xv_fbf05462-3c11-403c-bee4-dc50d82ab05d/metrics-server/0.log" Jun 11 19:58:03.098906 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:03.098872 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7fbdd5559c-xcqmq" podUID="162c4db6-84d1-4f08-ab7e-d11f5960401b" containerName="console" containerID="cri-o://894b8b5c610984eea0cbfa9583272d0197685891724490465fee420c2436678a" gracePeriod=15 Jun 11 19:58:03.990078 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:03.990049 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l5pjk_9615928b-9884-4a2e-8b27-3d2ca7f4b59d/init-textfile/0.log" Jun 11 19:58:04.192121 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:04.192094 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l5pjk_9615928b-9884-4a2e-8b27-3d2ca7f4b59d/node-exporter/0.log" Jun 11 19:58:04.390581 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:04.390550 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l5pjk_9615928b-9884-4a2e-8b27-3d2ca7f4b59d/kube-rbac-proxy/0.log" Jun 11 19:58:05.790197 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:05.790163 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_88289a5e-5acf-47af-8e57-ba71345fa447/init-config-reloader/0.log" Jun 11 19:58:05.992262 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:05.992231 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_88289a5e-5acf-47af-8e57-ba71345fa447/prometheus/0.log" Jun 11 19:58:06.190846 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:06.190815 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_88289a5e-5acf-47af-8e57-ba71345fa447/config-reloader/0.log" Jun 11 19:58:06.390289 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:06.390259 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_88289a5e-5acf-47af-8e57-ba71345fa447/thanos-sidecar/0.log" Jun 11 19:58:06.590652 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:06.590627 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_88289a5e-5acf-47af-8e57-ba71345fa447/kube-rbac-proxy-web/0.log" Jun 11 19:58:06.790877 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:06.790797 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_88289a5e-5acf-47af-8e57-ba71345fa447/kube-rbac-proxy/0.log" Jun 11 19:58:06.990374 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:06.990300 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_88289a5e-5acf-47af-8e57-ba71345fa447/kube-rbac-proxy-thanos/0.log" Jun 11 19:58:07.590963 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:07.590931 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-thd84_8493dedb-4a7d-4f91-86ae-0e9818d1b3b2/prometheus-operator-admission-webhook/0.log" Jun 11 19:58:07.790403 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:07.790376 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-864bb64949-bjgkg_1fb80569-82a4-40ba-a2eb-c82860d4b05b/thanos-query/0.log" Jun 11 19:58:07.990670 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:07.990601 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-864bb64949-bjgkg_1fb80569-82a4-40ba-a2eb-c82860d4b05b/kube-rbac-proxy-web/0.log" Jun 11 19:58:08.190454 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:08.190427 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-864bb64949-bjgkg_1fb80569-82a4-40ba-a2eb-c82860d4b05b/kube-rbac-proxy/0.log" Jun 11 19:58:08.389760 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:08.389734 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-864bb64949-bjgkg_1fb80569-82a4-40ba-a2eb-c82860d4b05b/prom-label-proxy/0.log" Jun 11 19:58:08.590093 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:08.590046 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-864bb64949-bjgkg_1fb80569-82a4-40ba-a2eb-c82860d4b05b/kube-rbac-proxy-rules/0.log" Jun 11 19:58:08.790754 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:08.790678 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-864bb64949-bjgkg_1fb80569-82a4-40ba-a2eb-c82860d4b05b/kube-rbac-proxy-metrics/0.log" Jun 11 19:58:09.186867 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:09.186836 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs\") pod \"network-metrics-daemon-z8x8n\" (UID: \"66f02d7a-34af-41ed-b9d1-ebc61a648224\") " pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:58:09.189188 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:09.189168 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66f02d7a-34af-41ed-b9d1-ebc61a648224-metrics-certs\") pod \"network-metrics-daemon-z8x8n\" (UID: \"66f02d7a-34af-41ed-b9d1-ebc61a648224\") " pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:58:09.247931 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:09.247905 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xlfzf\"" Jun 11 19:58:09.255905 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:09.255886 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z8x8n" Jun 11 19:58:09.386742 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:09.386715 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z8x8n"] Jun 11 19:58:09.397122 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:58:09.397090 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f02d7a_34af_41ed_b9d1_ebc61a648224.slice/crio-69ef6d2668ffd71af38cc6d120c02d24c012b83779a544568d1fe82e77366b1c WatchSource:0}: Error finding container 69ef6d2668ffd71af38cc6d120c02d24c012b83779a544568d1fe82e77366b1c: Status 404 returned error can't find the container with id 69ef6d2668ffd71af38cc6d120c02d24c012b83779a544568d1fe82e77366b1c Jun 11 19:58:09.991667 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:09.991630 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7fbdd5559c-xcqmq_162c4db6-84d1-4f08-ab7e-d11f5960401b/console/0.log" Jun 11 19:58:10.190260 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:10.190220 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z8x8n" event={"ID":"66f02d7a-34af-41ed-b9d1-ebc61a648224","Type":"ContainerStarted","Data":"69ef6d2668ffd71af38cc6d120c02d24c012b83779a544568d1fe82e77366b1c"} Jun 11 19:58:11.195400 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:11.195369 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z8x8n" event={"ID":"66f02d7a-34af-41ed-b9d1-ebc61a648224","Type":"ContainerStarted","Data":"7bbfd146612d624bc15317aa37c4ba4e519cabc6ac866d77229424936e4770be"} Jun 11 19:58:11.195838 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:11.195418 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z8x8n" event={"ID":"66f02d7a-34af-41ed-b9d1-ebc61a648224","Type":"ContainerStarted","Data":"d83cc89546eb0e66aea1e3007d7636801638f151d538da008574c3f97695a2e0"} Jun 11 19:58:11.215899 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:11.215849 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z8x8n" podStartSLOduration=253.305248083 podStartE2EDuration="4m14.215834448s" totalImagesPullingTime="910.586365ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:58:11.214158116 +0000 UTC m=+254.245874755" watchObservedRunningTime="2026-06-11 19:58:11.215834448 +0000 UTC m=+254.247551087" Jun 11 19:58:11.990712 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:11.990691 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rkxzl_9b7199ae-2384-40a9-ac35-f185dcce8701/dns-node-resolver/0.log" Jun 11 19:58:12.790484 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:12.790460 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bk68w_ad4cb0c0-3045-4129-a116-d02b9e1dfd57/node-ca/0.log" Jun 11 19:58:13.390728 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:13.390701 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qfp6k_d96c8cfe-b03a-40be-9956-8d0477442dac/serve-healthcheck-canary/0.log" Jun 11 19:58:14.441423 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:14.441396 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:58:14.446241 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:14.446218 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-759f689cdb-zx4xv" Jun 11 19:58:18.227434 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.227409 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7fbdd5559c-xcqmq_162c4db6-84d1-4f08-ab7e-d11f5960401b/console/0.log" Jun 11 19:58:18.227762 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.227445 2564 generic.go:356] "Generic (PLEG): container finished" podID="162c4db6-84d1-4f08-ab7e-d11f5960401b" containerID="894b8b5c610984eea0cbfa9583272d0197685891724490465fee420c2436678a" exitCode=137 Jun 11 19:58:18.227762 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.227484 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fbdd5559c-xcqmq" event={"ID":"162c4db6-84d1-4f08-ab7e-d11f5960401b","Type":"ContainerDied","Data":"894b8b5c610984eea0cbfa9583272d0197685891724490465fee420c2436678a"} Jun 11 19:58:18.244841 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.244822 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7fbdd5559c-xcqmq_162c4db6-84d1-4f08-ab7e-d11f5960401b/console/0.log" Jun 11 19:58:18.246795 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.246771 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:58:18.370524 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.370452 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/162c4db6-84d1-4f08-ab7e-d11f5960401b-oauth-serving-cert\") pod \"162c4db6-84d1-4f08-ab7e-d11f5960401b\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " Jun 11 19:58:18.370524 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.370488 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/162c4db6-84d1-4f08-ab7e-d11f5960401b-console-serving-cert\") pod \"162c4db6-84d1-4f08-ab7e-d11f5960401b\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " Jun 11 19:58:18.370524 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.370519 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22w2k\" (UniqueName: \"kubernetes.io/projected/162c4db6-84d1-4f08-ab7e-d11f5960401b-kube-api-access-22w2k\") pod \"162c4db6-84d1-4f08-ab7e-d11f5960401b\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " Jun 11 19:58:18.370726 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.370562 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/162c4db6-84d1-4f08-ab7e-d11f5960401b-console-config\") pod \"162c4db6-84d1-4f08-ab7e-d11f5960401b\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " Jun 11 19:58:18.370726 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.370623 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/162c4db6-84d1-4f08-ab7e-d11f5960401b-service-ca\") pod \"162c4db6-84d1-4f08-ab7e-d11f5960401b\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " Jun 11 19:58:18.370726 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.370652 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/162c4db6-84d1-4f08-ab7e-d11f5960401b-console-oauth-config\") pod \"162c4db6-84d1-4f08-ab7e-d11f5960401b\" (UID: \"162c4db6-84d1-4f08-ab7e-d11f5960401b\") " Jun 11 19:58:18.371037 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.370953 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/162c4db6-84d1-4f08-ab7e-d11f5960401b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "162c4db6-84d1-4f08-ab7e-d11f5960401b" (UID: "162c4db6-84d1-4f08-ab7e-d11f5960401b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:58:18.371101 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.371066 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/162c4db6-84d1-4f08-ab7e-d11f5960401b-service-ca" (OuterVolumeSpecName: "service-ca") pod "162c4db6-84d1-4f08-ab7e-d11f5960401b" (UID: "162c4db6-84d1-4f08-ab7e-d11f5960401b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:58:18.371101 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.371074 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/162c4db6-84d1-4f08-ab7e-d11f5960401b-console-config" (OuterVolumeSpecName: "console-config") pod "162c4db6-84d1-4f08-ab7e-d11f5960401b" (UID: "162c4db6-84d1-4f08-ab7e-d11f5960401b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:58:18.372938 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.372908 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/162c4db6-84d1-4f08-ab7e-d11f5960401b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "162c4db6-84d1-4f08-ab7e-d11f5960401b" (UID: "162c4db6-84d1-4f08-ab7e-d11f5960401b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:58:18.372938 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.372913 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/162c4db6-84d1-4f08-ab7e-d11f5960401b-kube-api-access-22w2k" (OuterVolumeSpecName: "kube-api-access-22w2k") pod "162c4db6-84d1-4f08-ab7e-d11f5960401b" (UID: "162c4db6-84d1-4f08-ab7e-d11f5960401b"). InnerVolumeSpecName "kube-api-access-22w2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:58:18.373071 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.372980 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/162c4db6-84d1-4f08-ab7e-d11f5960401b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "162c4db6-84d1-4f08-ab7e-d11f5960401b" (UID: "162c4db6-84d1-4f08-ab7e-d11f5960401b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:58:18.471365 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.471339 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/162c4db6-84d1-4f08-ab7e-d11f5960401b-oauth-serving-cert\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:18.471365 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.471357 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/162c4db6-84d1-4f08-ab7e-d11f5960401b-console-serving-cert\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:18.471365 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.471367 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22w2k\" (UniqueName: \"kubernetes.io/projected/162c4db6-84d1-4f08-ab7e-d11f5960401b-kube-api-access-22w2k\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:18.471589 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.471450 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/162c4db6-84d1-4f08-ab7e-d11f5960401b-console-config\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:18.471589 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.471574 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/162c4db6-84d1-4f08-ab7e-d11f5960401b-service-ca\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:18.471702 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:18.471592 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/162c4db6-84d1-4f08-ab7e-d11f5960401b-console-oauth-config\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:19.232508 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:19.232485 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7fbdd5559c-xcqmq_162c4db6-84d1-4f08-ab7e-d11f5960401b/console/0.log" Jun 11 19:58:19.232892 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:19.232571 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fbdd5559c-xcqmq" Jun 11 19:58:19.232892 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:19.232588 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fbdd5559c-xcqmq" event={"ID":"162c4db6-84d1-4f08-ab7e-d11f5960401b","Type":"ContainerDied","Data":"8694fbe8b2317235d82ec29ca085131d6a904f841250c81dbb19e05a3dc794f7"} Jun 11 19:58:19.232892 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:19.232641 2564 scope.go:117] "RemoveContainer" containerID="894b8b5c610984eea0cbfa9583272d0197685891724490465fee420c2436678a" Jun 11 19:58:19.254328 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:19.254300 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fbdd5559c-xcqmq"] Jun 11 19:58:19.260191 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:19.260162 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7fbdd5559c-xcqmq"] Jun 11 19:58:19.347933 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:19.347904 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="162c4db6-84d1-4f08-ab7e-d11f5960401b" path="/var/lib/kubelet/pods/162c4db6-84d1-4f08-ab7e-d11f5960401b/volumes" Jun 11 19:58:36.249998 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:36.249956 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:36.270560 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:36.270528 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:36.312084 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:36.312057 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:38.843822 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:58:38.843765 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dlkxw" podUID="72b1d900-e2b3-4a23-989b-42e796f1c820" Jun 11 19:58:39.306941 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:39.306863 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dlkxw" Jun 11 19:58:41.771608 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:41.771574 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:58:41.773924 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:41.773908 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72b1d900-e2b3-4a23-989b-42e796f1c820-metrics-tls\") pod \"dns-default-dlkxw\" (UID: \"72b1d900-e2b3-4a23-989b-42e796f1c820\") " pod="openshift-dns/dns-default-dlkxw" Jun 11 19:58:42.010611 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:42.010581 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hfjmj\"" Jun 11 19:58:42.018561 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:42.018541 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dlkxw" Jun 11 19:58:42.150020 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:42.149987 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dlkxw"] Jun 11 19:58:42.152165 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:58:42.152122 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72b1d900_e2b3_4a23_989b_42e796f1c820.slice/crio-a0999fdc6f66a9fa26d27f13492731c3bc9efa055758572a65d61e6eec81b5d9 WatchSource:0}: Error finding container a0999fdc6f66a9fa26d27f13492731c3bc9efa055758572a65d61e6eec81b5d9: Status 404 returned error can't find the container with id a0999fdc6f66a9fa26d27f13492731c3bc9efa055758572a65d61e6eec81b5d9 Jun 11 19:58:42.317846 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:42.317813 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dlkxw" event={"ID":"72b1d900-e2b3-4a23-989b-42e796f1c820","Type":"ContainerStarted","Data":"a0999fdc6f66a9fa26d27f13492731c3bc9efa055758572a65d61e6eec81b5d9"} Jun 11 19:58:44.326749 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:44.326713 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dlkxw" event={"ID":"72b1d900-e2b3-4a23-989b-42e796f1c820","Type":"ContainerStarted","Data":"5447245b0116b0990636a7d6acad8864fa4ddff6c9cbab4acdaed946b6a7dd38"} Jun 11 19:58:44.327222 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:44.326810 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dlkxw" event={"ID":"72b1d900-e2b3-4a23-989b-42e796f1c820","Type":"ContainerStarted","Data":"19bdbc4e266a968ad68d2d6bb7d7b90c23a97cfa8ad16e4c5bc23ff305688daa"} Jun 11 19:58:44.327222 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:44.326832 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dlkxw" Jun 11 19:58:44.344339 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:44.344296 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dlkxw" podStartSLOduration=251.765118046 podStartE2EDuration="4m13.344281904s" totalImagesPullingTime="1.579163858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:54:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:58:44.342669344 +0000 UTC m=+287.374385985" watchObservedRunningTime="2026-06-11 19:58:44.344281904 +0000 UTC m=+287.375998545" Jun 11 19:58:50.022208 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:50.022169 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:58:50.022615 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:50.022483 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="alertmanager" containerID="cri-o://075f0456527ab7f6e612a25de58b772b6363f5f00205e2372022f5866620fe76" gracePeriod=120 Jun 11 19:58:50.022615 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:50.022547 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="kube-rbac-proxy-metric" containerID="cri-o://4ab2c9043e10e365f982c327160caf05ef92d0c4ca6abf52a3ccb4633117d74a" gracePeriod=120 Jun 11 19:58:50.022615 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:50.022580 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="kube-rbac-proxy-web" containerID="cri-o://dcfe25dbb035a5efb73b9cc8523048e384d83a62f8a4dd0d696e1a707bf3c6d2" gracePeriod=120 Jun 11 19:58:50.022872 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:50.022607 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="config-reloader" containerID="cri-o://ef23cf884025bc6d1dcdeff4d61cbe5d7c7b3c67393892b72d64e442e9d9e589" gracePeriod=120 Jun 11 19:58:50.022872 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:50.022606 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="kube-rbac-proxy" containerID="cri-o://c9908ac188e6e88c4842555388850dfc1d3e57336b5b01abf639be18d8ad7a38" gracePeriod=120 Jun 11 19:58:50.022872 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:50.022641 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="prom-label-proxy" containerID="cri-o://b03ebdf91160a1c1312b800f387325e4045ef10b9988b0fc1a3a6e28b6f06182" gracePeriod=120 Jun 11 19:58:50.357079 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:50.357046 2564 generic.go:356] "Generic (PLEG): container finished" podID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerID="b03ebdf91160a1c1312b800f387325e4045ef10b9988b0fc1a3a6e28b6f06182" exitCode=0 Jun 11 19:58:50.357079 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:50.357073 2564 generic.go:356] "Generic (PLEG): container finished" podID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerID="c9908ac188e6e88c4842555388850dfc1d3e57336b5b01abf639be18d8ad7a38" exitCode=0 Jun 11 19:58:50.357079 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:50.357079 2564 generic.go:356] "Generic (PLEG): container finished" podID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerID="ef23cf884025bc6d1dcdeff4d61cbe5d7c7b3c67393892b72d64e442e9d9e589" exitCode=0 Jun 11 19:58:50.357079 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:50.357085 2564 generic.go:356] "Generic (PLEG): container finished" podID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerID="075f0456527ab7f6e612a25de58b772b6363f5f00205e2372022f5866620fe76" exitCode=0 Jun 11 19:58:50.357323 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:50.357119 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4","Type":"ContainerDied","Data":"b03ebdf91160a1c1312b800f387325e4045ef10b9988b0fc1a3a6e28b6f06182"} Jun 11 19:58:50.357323 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:50.357203 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4","Type":"ContainerDied","Data":"c9908ac188e6e88c4842555388850dfc1d3e57336b5b01abf639be18d8ad7a38"} Jun 11 19:58:50.357323 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:50.357231 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4","Type":"ContainerDied","Data":"ef23cf884025bc6d1dcdeff4d61cbe5d7c7b3c67393892b72d64e442e9d9e589"} Jun 11 19:58:50.357323 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:50.357256 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4","Type":"ContainerDied","Data":"075f0456527ab7f6e612a25de58b772b6363f5f00205e2372022f5866620fe76"} Jun 11 19:58:51.264703 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.264676 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.348344 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.348276 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-kube-rbac-proxy\") pod \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " Jun 11 19:58:51.348344 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.348305 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-main-tls\") pod \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " Jun 11 19:58:51.348344 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.348332 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sht6c\" (UniqueName: \"kubernetes.io/projected/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-kube-api-access-sht6c\") pod \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " Jun 11 19:58:51.348594 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.348355 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-tls-assets\") pod \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " Jun 11 19:58:51.348594 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.348511 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-web-config\") pod \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " Jun 11 19:58:51.348594 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.348562 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-config-out\") pod \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " Jun 11 19:58:51.348759 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.348605 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-cluster-tls-config\") pod \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " Jun 11 19:58:51.348759 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.348660 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-alertmanager-trusted-ca-bundle\") pod \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " Jun 11 19:58:51.348759 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.348694 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-alertmanager-main-db\") pod \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " Jun 11 19:58:51.348759 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.348720 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " Jun 11 19:58:51.348759 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.348748 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-metrics-client-ca\") pod \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " Jun 11 19:58:51.349022 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.348776 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-kube-rbac-proxy-web\") pod \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " Jun 11 19:58:51.349022 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.348818 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-config-volume\") pod \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\" (UID: \"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4\") " Jun 11 19:58:51.349337 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.349303 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" (UID: "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:58:51.349834 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.349755 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" (UID: "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:58:51.350106 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.350078 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" (UID: "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:58:51.351637 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.351579 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" (UID: "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:58:51.351970 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.351929 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" (UID: "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:58:51.352201 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.352176 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-config-out" (OuterVolumeSpecName: "config-out") pod "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" (UID: "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:58:51.352301 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.352220 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-kube-api-access-sht6c" (OuterVolumeSpecName: "kube-api-access-sht6c") pod "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" (UID: "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4"). InnerVolumeSpecName "kube-api-access-sht6c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:58:51.352493 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.352475 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-config-volume" (OuterVolumeSpecName: "config-volume") pod "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" (UID: "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:58:51.352560 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.352534 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" (UID: "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:58:51.352919 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.352892 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" (UID: "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:58:51.353333 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.353314 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" (UID: "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:58:51.356774 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.356691 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" (UID: "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:58:51.363076 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.363046 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-web-config" (OuterVolumeSpecName: "web-config") pod "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" (UID: "fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:58:51.364281 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.364256 2564 generic.go:356] "Generic (PLEG): container finished" podID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerID="4ab2c9043e10e365f982c327160caf05ef92d0c4ca6abf52a3ccb4633117d74a" exitCode=0 Jun 11 19:58:51.364348 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.364282 2564 generic.go:356] "Generic (PLEG): container finished" podID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerID="dcfe25dbb035a5efb73b9cc8523048e384d83a62f8a4dd0d696e1a707bf3c6d2" exitCode=0 Jun 11 19:58:51.364348 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.364333 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4","Type":"ContainerDied","Data":"4ab2c9043e10e365f982c327160caf05ef92d0c4ca6abf52a3ccb4633117d74a"} Jun 11 19:58:51.364417 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.364399 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4","Type":"ContainerDied","Data":"dcfe25dbb035a5efb73b9cc8523048e384d83a62f8a4dd0d696e1a707bf3c6d2"} Jun 11 19:58:51.364463 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.364341 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.364463 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.364437 2564 scope.go:117] "RemoveContainer" containerID="b03ebdf91160a1c1312b800f387325e4045ef10b9988b0fc1a3a6e28b6f06182" Jun 11 19:58:51.364603 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.364428 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4","Type":"ContainerDied","Data":"47ae763da6350e3a11cfb777c46c3330e0b2446062afb1bc83ba143885c20cc7"} Jun 11 19:58:51.371644 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.371624 2564 scope.go:117] "RemoveContainer" containerID="4ab2c9043e10e365f982c327160caf05ef92d0c4ca6abf52a3ccb4633117d74a" Jun 11 19:58:51.378410 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.378391 2564 scope.go:117] "RemoveContainer" containerID="c9908ac188e6e88c4842555388850dfc1d3e57336b5b01abf639be18d8ad7a38" Jun 11 19:58:51.385124 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.385109 2564 scope.go:117] "RemoveContainer" containerID="dcfe25dbb035a5efb73b9cc8523048e384d83a62f8a4dd0d696e1a707bf3c6d2" Jun 11 19:58:51.388096 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.388075 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:58:51.392049 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.392027 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:58:51.393481 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.393468 2564 scope.go:117] "RemoveContainer" containerID="ef23cf884025bc6d1dcdeff4d61cbe5d7c7b3c67393892b72d64e442e9d9e589" Jun 11 19:58:51.400449 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.400429 2564 scope.go:117] "RemoveContainer" containerID="075f0456527ab7f6e612a25de58b772b6363f5f00205e2372022f5866620fe76" Jun 11 19:58:51.407803 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.407733 2564 scope.go:117] "RemoveContainer" containerID="be0aa950c1f9b0df185760f4bc0d6da44429c707f9cf74493f9cded1cda502e6" Jun 11 19:58:51.414722 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.414703 2564 scope.go:117] "RemoveContainer" containerID="b03ebdf91160a1c1312b800f387325e4045ef10b9988b0fc1a3a6e28b6f06182" Jun 11 19:58:51.415553 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:58:51.415521 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b03ebdf91160a1c1312b800f387325e4045ef10b9988b0fc1a3a6e28b6f06182\": container with ID starting with b03ebdf91160a1c1312b800f387325e4045ef10b9988b0fc1a3a6e28b6f06182 not found: ID does not exist" containerID="b03ebdf91160a1c1312b800f387325e4045ef10b9988b0fc1a3a6e28b6f06182" Jun 11 19:58:51.415650 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.415609 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b03ebdf91160a1c1312b800f387325e4045ef10b9988b0fc1a3a6e28b6f06182"} err="failed to get container status \"b03ebdf91160a1c1312b800f387325e4045ef10b9988b0fc1a3a6e28b6f06182\": rpc error: code = NotFound desc = could not find container \"b03ebdf91160a1c1312b800f387325e4045ef10b9988b0fc1a3a6e28b6f06182\": container with ID starting with b03ebdf91160a1c1312b800f387325e4045ef10b9988b0fc1a3a6e28b6f06182 not found: ID does not exist" Jun 11 19:58:51.415650 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.415645 2564 scope.go:117] "RemoveContainer" containerID="4ab2c9043e10e365f982c327160caf05ef92d0c4ca6abf52a3ccb4633117d74a" Jun 11 19:58:51.416055 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:58:51.416037 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ab2c9043e10e365f982c327160caf05ef92d0c4ca6abf52a3ccb4633117d74a\": container with ID starting with 4ab2c9043e10e365f982c327160caf05ef92d0c4ca6abf52a3ccb4633117d74a not found: ID does not exist" containerID="4ab2c9043e10e365f982c327160caf05ef92d0c4ca6abf52a3ccb4633117d74a" Jun 11 19:58:51.416119 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.416059 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ab2c9043e10e365f982c327160caf05ef92d0c4ca6abf52a3ccb4633117d74a"} err="failed to get container status \"4ab2c9043e10e365f982c327160caf05ef92d0c4ca6abf52a3ccb4633117d74a\": rpc error: code = NotFound desc = could not find container \"4ab2c9043e10e365f982c327160caf05ef92d0c4ca6abf52a3ccb4633117d74a\": container with ID starting with 4ab2c9043e10e365f982c327160caf05ef92d0c4ca6abf52a3ccb4633117d74a not found: ID does not exist" Jun 11 19:58:51.416119 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.416075 2564 scope.go:117] "RemoveContainer" containerID="c9908ac188e6e88c4842555388850dfc1d3e57336b5b01abf639be18d8ad7a38" Jun 11 19:58:51.416344 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:58:51.416330 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9908ac188e6e88c4842555388850dfc1d3e57336b5b01abf639be18d8ad7a38\": container with ID starting with c9908ac188e6e88c4842555388850dfc1d3e57336b5b01abf639be18d8ad7a38 not found: ID does not exist" containerID="c9908ac188e6e88c4842555388850dfc1d3e57336b5b01abf639be18d8ad7a38" Jun 11 19:58:51.416382 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.416346 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9908ac188e6e88c4842555388850dfc1d3e57336b5b01abf639be18d8ad7a38"} err="failed to get container status \"c9908ac188e6e88c4842555388850dfc1d3e57336b5b01abf639be18d8ad7a38\": rpc error: code = NotFound desc = could not find container \"c9908ac188e6e88c4842555388850dfc1d3e57336b5b01abf639be18d8ad7a38\": container with ID starting with c9908ac188e6e88c4842555388850dfc1d3e57336b5b01abf639be18d8ad7a38 not found: ID does not exist" Jun 11 19:58:51.416382 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.416359 2564 scope.go:117] "RemoveContainer" containerID="dcfe25dbb035a5efb73b9cc8523048e384d83a62f8a4dd0d696e1a707bf3c6d2" Jun 11 19:58:51.416579 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:58:51.416559 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcfe25dbb035a5efb73b9cc8523048e384d83a62f8a4dd0d696e1a707bf3c6d2\": container with ID starting with dcfe25dbb035a5efb73b9cc8523048e384d83a62f8a4dd0d696e1a707bf3c6d2 not found: ID does not exist" containerID="dcfe25dbb035a5efb73b9cc8523048e384d83a62f8a4dd0d696e1a707bf3c6d2" Jun 11 19:58:51.416627 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.416585 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcfe25dbb035a5efb73b9cc8523048e384d83a62f8a4dd0d696e1a707bf3c6d2"} err="failed to get container status \"dcfe25dbb035a5efb73b9cc8523048e384d83a62f8a4dd0d696e1a707bf3c6d2\": rpc error: code = NotFound desc = could not find container \"dcfe25dbb035a5efb73b9cc8523048e384d83a62f8a4dd0d696e1a707bf3c6d2\": container with ID starting with dcfe25dbb035a5efb73b9cc8523048e384d83a62f8a4dd0d696e1a707bf3c6d2 not found: ID does not exist" Jun 11 19:58:51.416627 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.416601 2564 scope.go:117] "RemoveContainer" containerID="ef23cf884025bc6d1dcdeff4d61cbe5d7c7b3c67393892b72d64e442e9d9e589" Jun 11 19:58:51.416907 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:58:51.416890 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef23cf884025bc6d1dcdeff4d61cbe5d7c7b3c67393892b72d64e442e9d9e589\": container with ID starting with ef23cf884025bc6d1dcdeff4d61cbe5d7c7b3c67393892b72d64e442e9d9e589 not found: ID does not exist" containerID="ef23cf884025bc6d1dcdeff4d61cbe5d7c7b3c67393892b72d64e442e9d9e589" Jun 11 19:58:51.416946 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.416911 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef23cf884025bc6d1dcdeff4d61cbe5d7c7b3c67393892b72d64e442e9d9e589"} err="failed to get container status \"ef23cf884025bc6d1dcdeff4d61cbe5d7c7b3c67393892b72d64e442e9d9e589\": rpc error: code = NotFound desc = could not find container \"ef23cf884025bc6d1dcdeff4d61cbe5d7c7b3c67393892b72d64e442e9d9e589\": container with ID starting with ef23cf884025bc6d1dcdeff4d61cbe5d7c7b3c67393892b72d64e442e9d9e589 not found: ID does not exist" Jun 11 19:58:51.416946 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.416923 2564 scope.go:117] "RemoveContainer" containerID="075f0456527ab7f6e612a25de58b772b6363f5f00205e2372022f5866620fe76" Jun 11 19:58:51.417191 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.416962 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:58:51.417191 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:58:51.417147 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"075f0456527ab7f6e612a25de58b772b6363f5f00205e2372022f5866620fe76\": container with ID starting with 075f0456527ab7f6e612a25de58b772b6363f5f00205e2372022f5866620fe76 not found: ID does not exist" containerID="075f0456527ab7f6e612a25de58b772b6363f5f00205e2372022f5866620fe76" Jun 11 19:58:51.417191 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417164 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"075f0456527ab7f6e612a25de58b772b6363f5f00205e2372022f5866620fe76"} err="failed to get container status \"075f0456527ab7f6e612a25de58b772b6363f5f00205e2372022f5866620fe76\": rpc error: code = NotFound desc = could not find container \"075f0456527ab7f6e612a25de58b772b6363f5f00205e2372022f5866620fe76\": container with ID starting with 075f0456527ab7f6e612a25de58b772b6363f5f00205e2372022f5866620fe76 not found: ID does not exist" Jun 11 19:58:51.417191 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417176 2564 scope.go:117] "RemoveContainer" containerID="be0aa950c1f9b0df185760f4bc0d6da44429c707f9cf74493f9cded1cda502e6" Jun 11 19:58:51.417335 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417250 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="kube-rbac-proxy" Jun 11 19:58:51.417335 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417264 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="kube-rbac-proxy" Jun 11 19:58:51.417335 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417277 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="config-reloader" Jun 11 19:58:51.417335 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417285 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="config-reloader" Jun 11 19:58:51.417335 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417302 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="kube-rbac-proxy-metric" Jun 11 19:58:51.417335 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417311 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="kube-rbac-proxy-metric" Jun 11 19:58:51.417335 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417321 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="162c4db6-84d1-4f08-ab7e-d11f5960401b" containerName="console" Jun 11 19:58:51.417335 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417330 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="162c4db6-84d1-4f08-ab7e-d11f5960401b" containerName="console" Jun 11 19:58:51.417606 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417346 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="kube-rbac-proxy-web" Jun 11 19:58:51.417606 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417355 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="kube-rbac-proxy-web" Jun 11 19:58:51.417606 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417367 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="alertmanager" Jun 11 19:58:51.417606 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417375 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="alertmanager" Jun 11 19:58:51.417606 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417381 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="prom-label-proxy" Jun 11 19:58:51.417606 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417386 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="prom-label-proxy" Jun 11 19:58:51.417606 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:58:51.417384 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be0aa950c1f9b0df185760f4bc0d6da44429c707f9cf74493f9cded1cda502e6\": container with ID starting with be0aa950c1f9b0df185760f4bc0d6da44429c707f9cf74493f9cded1cda502e6 not found: ID does not exist" containerID="be0aa950c1f9b0df185760f4bc0d6da44429c707f9cf74493f9cded1cda502e6" Jun 11 19:58:51.417606 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417393 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="init-config-reloader" Jun 11 19:58:51.417606 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417399 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="init-config-reloader" Jun 11 19:58:51.417606 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417399 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be0aa950c1f9b0df185760f4bc0d6da44429c707f9cf74493f9cded1cda502e6"} err="failed to get container status \"be0aa950c1f9b0df185760f4bc0d6da44429c707f9cf74493f9cded1cda502e6\": rpc error: code = NotFound desc = could not find container \"be0aa950c1f9b0df185760f4bc0d6da44429c707f9cf74493f9cded1cda502e6\": container with ID starting with be0aa950c1f9b0df185760f4bc0d6da44429c707f9cf74493f9cded1cda502e6 not found: ID does not exist" Jun 11 19:58:51.417606 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417413 2564 scope.go:117] "RemoveContainer" containerID="b03ebdf91160a1c1312b800f387325e4045ef10b9988b0fc1a3a6e28b6f06182" Jun 11 19:58:51.417606 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417444 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="config-reloader" Jun 11 19:58:51.417606 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417452 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="kube-rbac-proxy" Jun 11 19:58:51.417606 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417460 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="alertmanager" Jun 11 19:58:51.417606 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417464 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="kube-rbac-proxy-metric" Jun 11 19:58:51.417606 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417473 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="kube-rbac-proxy-web" Jun 11 19:58:51.417606 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417482 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="162c4db6-84d1-4f08-ab7e-d11f5960401b" containerName="console" Jun 11 19:58:51.417606 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417487 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" containerName="prom-label-proxy" Jun 11 19:58:51.418288 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417635 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b03ebdf91160a1c1312b800f387325e4045ef10b9988b0fc1a3a6e28b6f06182"} err="failed to get container status \"b03ebdf91160a1c1312b800f387325e4045ef10b9988b0fc1a3a6e28b6f06182\": rpc error: code = NotFound desc = could not find container \"b03ebdf91160a1c1312b800f387325e4045ef10b9988b0fc1a3a6e28b6f06182\": container with ID starting with b03ebdf91160a1c1312b800f387325e4045ef10b9988b0fc1a3a6e28b6f06182 not found: ID does not exist" Jun 11 19:58:51.418288 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417655 2564 scope.go:117] "RemoveContainer" containerID="4ab2c9043e10e365f982c327160caf05ef92d0c4ca6abf52a3ccb4633117d74a" Jun 11 19:58:51.418288 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417884 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ab2c9043e10e365f982c327160caf05ef92d0c4ca6abf52a3ccb4633117d74a"} err="failed to get container status \"4ab2c9043e10e365f982c327160caf05ef92d0c4ca6abf52a3ccb4633117d74a\": rpc error: code = NotFound desc = could not find container \"4ab2c9043e10e365f982c327160caf05ef92d0c4ca6abf52a3ccb4633117d74a\": container with ID starting with 4ab2c9043e10e365f982c327160caf05ef92d0c4ca6abf52a3ccb4633117d74a not found: ID does not exist" Jun 11 19:58:51.418288 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.417898 2564 scope.go:117] "RemoveContainer" containerID="c9908ac188e6e88c4842555388850dfc1d3e57336b5b01abf639be18d8ad7a38" Jun 11 19:58:51.418288 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.418144 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9908ac188e6e88c4842555388850dfc1d3e57336b5b01abf639be18d8ad7a38"} err="failed to get container status \"c9908ac188e6e88c4842555388850dfc1d3e57336b5b01abf639be18d8ad7a38\": rpc error: code = NotFound desc = could not find container \"c9908ac188e6e88c4842555388850dfc1d3e57336b5b01abf639be18d8ad7a38\": container with ID starting with c9908ac188e6e88c4842555388850dfc1d3e57336b5b01abf639be18d8ad7a38 not found: ID does not exist" Jun 11 19:58:51.418288 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.418164 2564 scope.go:117] "RemoveContainer" containerID="dcfe25dbb035a5efb73b9cc8523048e384d83a62f8a4dd0d696e1a707bf3c6d2" Jun 11 19:58:51.418467 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.418403 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcfe25dbb035a5efb73b9cc8523048e384d83a62f8a4dd0d696e1a707bf3c6d2"} err="failed to get container status \"dcfe25dbb035a5efb73b9cc8523048e384d83a62f8a4dd0d696e1a707bf3c6d2\": rpc error: code = NotFound desc = could not find container \"dcfe25dbb035a5efb73b9cc8523048e384d83a62f8a4dd0d696e1a707bf3c6d2\": container with ID starting with dcfe25dbb035a5efb73b9cc8523048e384d83a62f8a4dd0d696e1a707bf3c6d2 not found: ID does not exist" Jun 11 19:58:51.418467 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.418418 2564 scope.go:117] "RemoveContainer" containerID="ef23cf884025bc6d1dcdeff4d61cbe5d7c7b3c67393892b72d64e442e9d9e589" Jun 11 19:58:51.418652 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.418635 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef23cf884025bc6d1dcdeff4d61cbe5d7c7b3c67393892b72d64e442e9d9e589"} err="failed to get container status \"ef23cf884025bc6d1dcdeff4d61cbe5d7c7b3c67393892b72d64e442e9d9e589\": rpc error: code = NotFound desc = could not find container \"ef23cf884025bc6d1dcdeff4d61cbe5d7c7b3c67393892b72d64e442e9d9e589\": container with ID starting with ef23cf884025bc6d1dcdeff4d61cbe5d7c7b3c67393892b72d64e442e9d9e589 not found: ID does not exist" Jun 11 19:58:51.418700 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.418653 2564 scope.go:117] "RemoveContainer" containerID="075f0456527ab7f6e612a25de58b772b6363f5f00205e2372022f5866620fe76" Jun 11 19:58:51.418881 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.418861 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"075f0456527ab7f6e612a25de58b772b6363f5f00205e2372022f5866620fe76"} err="failed to get container status \"075f0456527ab7f6e612a25de58b772b6363f5f00205e2372022f5866620fe76\": rpc error: code = NotFound desc = could not find container \"075f0456527ab7f6e612a25de58b772b6363f5f00205e2372022f5866620fe76\": container with ID starting with 075f0456527ab7f6e612a25de58b772b6363f5f00205e2372022f5866620fe76 not found: ID does not exist" Jun 11 19:58:51.418931 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.418882 2564 scope.go:117] "RemoveContainer" containerID="be0aa950c1f9b0df185760f4bc0d6da44429c707f9cf74493f9cded1cda502e6" Jun 11 19:58:51.419095 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.419076 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be0aa950c1f9b0df185760f4bc0d6da44429c707f9cf74493f9cded1cda502e6"} err="failed to get container status \"be0aa950c1f9b0df185760f4bc0d6da44429c707f9cf74493f9cded1cda502e6\": rpc error: code = NotFound desc = could not find container \"be0aa950c1f9b0df185760f4bc0d6da44429c707f9cf74493f9cded1cda502e6\": container with ID starting with be0aa950c1f9b0df185760f4bc0d6da44429c707f9cf74493f9cded1cda502e6 not found: ID does not exist" Jun 11 19:58:51.422592 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.422577 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.425105 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.425084 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 19:58:51.425202 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.425104 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 19:58:51.425202 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.425131 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 19:58:51.425202 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.425103 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 19:58:51.425394 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.425375 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6t2lb\"" Jun 11 19:58:51.425477 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.425452 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 19:58:51.425574 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.425559 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 19:58:51.425718 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.425704 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 19:58:51.425934 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.425919 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 19:58:51.430653 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.430634 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 19:58:51.433818 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.433776 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:58:51.450187 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.450166 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-config-out\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:51.450187 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.450185 2564 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-cluster-tls-config\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:51.450297 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.450195 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:51.450297 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.450205 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-alertmanager-main-db\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:51.450297 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.450214 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:51.450297 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.450222 2564 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-metrics-client-ca\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:51.450297 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.450230 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:51.450297 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.450238 2564 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-config-volume\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:51.450297 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.450246 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:51.450297 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.450254 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-secret-alertmanager-main-tls\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:51.450297 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.450262 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sht6c\" (UniqueName: \"kubernetes.io/projected/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-kube-api-access-sht6c\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:51.450297 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.450270 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-tls-assets\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:51.450297 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.450277 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4-web-config\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:51.550777 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.550744 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f8d7364-0143-413b-9328-5ba53576291b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.550777 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.550776 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f8d7364-0143-413b-9328-5ba53576291b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.550990 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.550826 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.550990 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.550857 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.550990 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.550872 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f8d7364-0143-413b-9328-5ba53576291b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.550990 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.550906 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-web-config\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.550990 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.550963 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxkkj\" (UniqueName: \"kubernetes.io/projected/5f8d7364-0143-413b-9328-5ba53576291b-kube-api-access-zxkkj\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.551132 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.550997 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f8d7364-0143-413b-9328-5ba53576291b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.551132 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.551018 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.551132 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.551038 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.551132 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.551080 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f8d7364-0143-413b-9328-5ba53576291b-config-out\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.551132 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.551111 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.551272 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.551130 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.651530 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.651455 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f8d7364-0143-413b-9328-5ba53576291b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.651530 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.651486 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f8d7364-0143-413b-9328-5ba53576291b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.651530 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.651504 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.651530 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.651526 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.651819 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.651548 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f8d7364-0143-413b-9328-5ba53576291b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.651819 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.651580 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-web-config\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.651819 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.651626 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxkkj\" (UniqueName: \"kubernetes.io/projected/5f8d7364-0143-413b-9328-5ba53576291b-kube-api-access-zxkkj\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.651819 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.651663 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f8d7364-0143-413b-9328-5ba53576291b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.651819 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.651688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.651819 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.651712 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.651819 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.651763 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f8d7364-0143-413b-9328-5ba53576291b-config-out\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.651819 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.651819 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.652176 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.651847 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.652176 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.651939 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f8d7364-0143-413b-9328-5ba53576291b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.652394 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.652366 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f8d7364-0143-413b-9328-5ba53576291b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.652498 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.652475 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f8d7364-0143-413b-9328-5ba53576291b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.654910 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.654884 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f8d7364-0143-413b-9328-5ba53576291b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.655070 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.655033 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.655166 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.655118 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f8d7364-0143-413b-9328-5ba53576291b-config-out\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.655166 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.655138 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.655166 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.655153 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-web-config\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.655308 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.655252 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.655423 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.655406 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.655566 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.655547 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.656881 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.656864 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f8d7364-0143-413b-9328-5ba53576291b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.660247 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.660231 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxkkj\" (UniqueName: \"kubernetes.io/projected/5f8d7364-0143-413b-9328-5ba53576291b-kube-api-access-zxkkj\") pod \"alertmanager-main-0\" (UID: \"5f8d7364-0143-413b-9328-5ba53576291b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.732451 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.732417 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:58:51.886767 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:51.886742 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:58:51.889278 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:58:51.889249 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f8d7364_0143_413b_9328_5ba53576291b.slice/crio-945306d5b0d3a3b634ba4935c101ad7effd12c49261a368b46a3d0d19ead8a8c WatchSource:0}: Error finding container 945306d5b0d3a3b634ba4935c101ad7effd12c49261a368b46a3d0d19ead8a8c: Status 404 returned error can't find the container with id 945306d5b0d3a3b634ba4935c101ad7effd12c49261a368b46a3d0d19ead8a8c Jun 11 19:58:52.370476 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:52.370445 2564 generic.go:356] "Generic (PLEG): container finished" podID="5f8d7364-0143-413b-9328-5ba53576291b" containerID="3c9a38d54265e598a86453e5027ef93a039dbdf34a25caa1ed839edc606a1557" exitCode=0 Jun 11 19:58:52.370860 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:52.370495 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f8d7364-0143-413b-9328-5ba53576291b","Type":"ContainerDied","Data":"3c9a38d54265e598a86453e5027ef93a039dbdf34a25caa1ed839edc606a1557"} Jun 11 19:58:52.370860 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:52.370542 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f8d7364-0143-413b-9328-5ba53576291b","Type":"ContainerStarted","Data":"945306d5b0d3a3b634ba4935c101ad7effd12c49261a368b46a3d0d19ead8a8c"} Jun 11 19:58:53.348206 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:53.348168 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4" path="/var/lib/kubelet/pods/fbf1d70d-c722-4dcd-bb9b-542ddd61e1b4/volumes" Jun 11 19:58:53.376997 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:53.376966 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f8d7364-0143-413b-9328-5ba53576291b","Type":"ContainerStarted","Data":"48906abcb68b54820950f60f8ac508e39be467086d34c25bbb9d385d98478caa"} Jun 11 19:58:53.377344 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:53.377043 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f8d7364-0143-413b-9328-5ba53576291b","Type":"ContainerStarted","Data":"ab55bdc76ecd032f2a46d0ef0d8a237a4d45dca43bdb1a208832f7dde3b93a66"} Jun 11 19:58:53.377344 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:53.377082 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f8d7364-0143-413b-9328-5ba53576291b","Type":"ContainerStarted","Data":"77c2ededb6cf98a9be45609903c7b1abff7bad0cf2aefcab3a4451efd2f4b3dc"} Jun 11 19:58:53.377344 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:53.377127 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f8d7364-0143-413b-9328-5ba53576291b","Type":"ContainerStarted","Data":"8890464a9f77ec928b7267ee936dbed8b061a993cc265ac2eda7a935fe3af372"} Jun 11 19:58:53.377344 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:53.377163 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f8d7364-0143-413b-9328-5ba53576291b","Type":"ContainerStarted","Data":"557b8f5d0dbac595ab09f89cb3dc7eaead7be1d68343da3c1da61bff7dfb3428"} Jun 11 19:58:53.377344 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:53.377197 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f8d7364-0143-413b-9328-5ba53576291b","Type":"ContainerStarted","Data":"dc5d56abb29baf037978185b54b61ab7946047243fe832d35090994462792243"} Jun 11 19:58:53.402974 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:53.402926 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.387191461 podStartE2EDuration="2.402912431s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.72097ms" isStatefulPod=false podCreationTimestamp="2026-06-11 19:58:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:58:53.402308535 +0000 UTC m=+296.434025175" watchObservedRunningTime="2026-06-11 19:58:53.402912431 +0000 UTC m=+296.434629070" Jun 11 19:58:54.332301 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.332269 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dlkxw" Jun 11 19:58:54.368293 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.368259 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:58:54.368633 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.368599 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="prometheus" containerID="cri-o://548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767" gracePeriod=600 Jun 11 19:58:54.368633 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.368618 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="kube-rbac-proxy-thanos" containerID="cri-o://45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2" gracePeriod=600 Jun 11 19:58:54.368850 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.368663 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="config-reloader" containerID="cri-o://2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325" gracePeriod=600 Jun 11 19:58:54.368850 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.368631 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="kube-rbac-proxy" containerID="cri-o://8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7" gracePeriod=600 Jun 11 19:58:54.368850 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.368610 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="kube-rbac-proxy-web" containerID="cri-o://3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951" gracePeriod=600 Jun 11 19:58:54.368850 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.368753 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="thanos-sidecar" containerID="cri-o://7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707" gracePeriod=600 Jun 11 19:58:54.605974 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.605949 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:54.675861 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.675836 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-db\") pod \"88289a5e-5acf-47af-8e57-ba71345fa447\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " Jun 11 19:58:54.676019 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.675888 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-metrics-client-certs\") pod \"88289a5e-5acf-47af-8e57-ba71345fa447\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " Jun 11 19:58:54.676019 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.675917 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-kube-rbac-proxy\") pod \"88289a5e-5acf-47af-8e57-ba71345fa447\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " Jun 11 19:58:54.676019 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.675948 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-configmap-kubelet-serving-ca-bundle\") pod \"88289a5e-5acf-47af-8e57-ba71345fa447\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " Jun 11 19:58:54.676019 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.675984 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88289a5e-5acf-47af-8e57-ba71345fa447-config-out\") pod \"88289a5e-5acf-47af-8e57-ba71345fa447\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " Jun 11 19:58:54.676217 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.676019 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-rulefiles-2\") pod \"88289a5e-5acf-47af-8e57-ba71345fa447\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " Jun 11 19:58:54.676217 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.676049 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"88289a5e-5acf-47af-8e57-ba71345fa447\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " Jun 11 19:58:54.676217 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.676081 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-rulefiles-0\") pod \"88289a5e-5acf-47af-8e57-ba71345fa447\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " Jun 11 19:58:54.676217 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.676106 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-config\") pod \"88289a5e-5acf-47af-8e57-ba71345fa447\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " Jun 11 19:58:54.676217 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.676131 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-configmap-serving-certs-ca-bundle\") pod \"88289a5e-5acf-47af-8e57-ba71345fa447\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " Jun 11 19:58:54.676217 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.676175 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88289a5e-5acf-47af-8e57-ba71345fa447-tls-assets\") pod \"88289a5e-5acf-47af-8e57-ba71345fa447\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " Jun 11 19:58:54.676217 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.676202 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-rulefiles-1\") pod \"88289a5e-5acf-47af-8e57-ba71345fa447\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " Jun 11 19:58:54.676538 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.676233 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-configmap-metrics-client-ca\") pod \"88289a5e-5acf-47af-8e57-ba71345fa447\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " Jun 11 19:58:54.676538 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.676277 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-thanos-prometheus-http-client-file\") pod \"88289a5e-5acf-47af-8e57-ba71345fa447\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " Jun 11 19:58:54.676538 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.676317 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-web-config\") pod \"88289a5e-5acf-47af-8e57-ba71345fa447\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " Jun 11 19:58:54.676538 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.676342 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"88289a5e-5acf-47af-8e57-ba71345fa447\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " Jun 11 19:58:54.676538 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.676358 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "88289a5e-5acf-47af-8e57-ba71345fa447" (UID: "88289a5e-5acf-47af-8e57-ba71345fa447"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:58:54.676538 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.676374 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-grpc-tls\") pod \"88289a5e-5acf-47af-8e57-ba71345fa447\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " Jun 11 19:58:54.676538 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.676410 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-trusted-ca-bundle\") pod \"88289a5e-5acf-47af-8e57-ba71345fa447\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " Jun 11 19:58:54.676538 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.676436 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h76rd\" (UniqueName: \"kubernetes.io/projected/88289a5e-5acf-47af-8e57-ba71345fa447-kube-api-access-h76rd\") pod \"88289a5e-5acf-47af-8e57-ba71345fa447\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " Jun 11 19:58:54.676538 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.676460 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-prometheus-k8s-tls\") pod \"88289a5e-5acf-47af-8e57-ba71345fa447\" (UID: \"88289a5e-5acf-47af-8e57-ba71345fa447\") " Jun 11 19:58:54.676981 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.676703 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:54.676981 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.676733 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "88289a5e-5acf-47af-8e57-ba71345fa447" (UID: "88289a5e-5acf-47af-8e57-ba71345fa447"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:58:54.677674 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.677645 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "88289a5e-5acf-47af-8e57-ba71345fa447" (UID: "88289a5e-5acf-47af-8e57-ba71345fa447"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:58:54.677974 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.677917 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "88289a5e-5acf-47af-8e57-ba71345fa447" (UID: "88289a5e-5acf-47af-8e57-ba71345fa447"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:58:54.679149 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.679118 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "88289a5e-5acf-47af-8e57-ba71345fa447" (UID: "88289a5e-5acf-47af-8e57-ba71345fa447"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:58:54.679237 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.679211 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "88289a5e-5acf-47af-8e57-ba71345fa447" (UID: "88289a5e-5acf-47af-8e57-ba71345fa447"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:58:54.679797 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.679477 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "88289a5e-5acf-47af-8e57-ba71345fa447" (UID: "88289a5e-5acf-47af-8e57-ba71345fa447"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:58:54.679797 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.679610 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "88289a5e-5acf-47af-8e57-ba71345fa447" (UID: "88289a5e-5acf-47af-8e57-ba71345fa447"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:58:54.679797 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.679712 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "88289a5e-5acf-47af-8e57-ba71345fa447" (UID: "88289a5e-5acf-47af-8e57-ba71345fa447"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:58:54.679797 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.679712 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88289a5e-5acf-47af-8e57-ba71345fa447-config-out" (OuterVolumeSpecName: "config-out") pod "88289a5e-5acf-47af-8e57-ba71345fa447" (UID: "88289a5e-5acf-47af-8e57-ba71345fa447"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:58:54.680052 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.679775 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "88289a5e-5acf-47af-8e57-ba71345fa447" (UID: "88289a5e-5acf-47af-8e57-ba71345fa447"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:58:54.680052 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.679894 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "88289a5e-5acf-47af-8e57-ba71345fa447" (UID: "88289a5e-5acf-47af-8e57-ba71345fa447"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:58:54.680300 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.680269 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "88289a5e-5acf-47af-8e57-ba71345fa447" (UID: "88289a5e-5acf-47af-8e57-ba71345fa447"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:58:54.680745 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.680709 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "88289a5e-5acf-47af-8e57-ba71345fa447" (UID: "88289a5e-5acf-47af-8e57-ba71345fa447"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:58:54.681623 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.681598 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-config" (OuterVolumeSpecName: "config") pod "88289a5e-5acf-47af-8e57-ba71345fa447" (UID: "88289a5e-5acf-47af-8e57-ba71345fa447"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:58:54.681902 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.681878 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "88289a5e-5acf-47af-8e57-ba71345fa447" (UID: "88289a5e-5acf-47af-8e57-ba71345fa447"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:58:54.682085 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.682067 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "88289a5e-5acf-47af-8e57-ba71345fa447" (UID: "88289a5e-5acf-47af-8e57-ba71345fa447"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:58:54.682170 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.682157 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88289a5e-5acf-47af-8e57-ba71345fa447-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "88289a5e-5acf-47af-8e57-ba71345fa447" (UID: "88289a5e-5acf-47af-8e57-ba71345fa447"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:58:54.683230 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.683210 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88289a5e-5acf-47af-8e57-ba71345fa447-kube-api-access-h76rd" (OuterVolumeSpecName: "kube-api-access-h76rd") pod "88289a5e-5acf-47af-8e57-ba71345fa447" (UID: "88289a5e-5acf-47af-8e57-ba71345fa447"). InnerVolumeSpecName "kube-api-access-h76rd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:58:54.691178 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.691157 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-web-config" (OuterVolumeSpecName: "web-config") pod "88289a5e-5acf-47af-8e57-ba71345fa447" (UID: "88289a5e-5acf-47af-8e57-ba71345fa447"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:58:54.777904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.777880 2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-grpc-tls\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:54.777904 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.777902 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:54.778051 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.777912 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h76rd\" (UniqueName: \"kubernetes.io/projected/88289a5e-5acf-47af-8e57-ba71345fa447-kube-api-access-h76rd\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:54.778051 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.777921 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:54.778051 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.777929 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-db\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:54.778051 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.777937 2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-metrics-client-certs\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:54.778051 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.777945 2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-kube-rbac-proxy\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:54.778051 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.777954 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88289a5e-5acf-47af-8e57-ba71345fa447-config-out\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:54.778051 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.777964 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:54.778051 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.777972 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:54.778051 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.777980 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:54.778051 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.777988 2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-config\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:54.778051 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.777996 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:54.778051 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.778005 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88289a5e-5acf-47af-8e57-ba71345fa447-tls-assets\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:54.778051 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.778019 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:54.778051 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.778028 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88289a5e-5acf-47af-8e57-ba71345fa447-configmap-metrics-client-ca\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:54.778051 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.778038 2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:54.778051 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.778045 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-web-config\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:54.778051 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:54.778054 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88289a5e-5acf-47af-8e57-ba71345fa447-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 19:58:55.391410 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.391382 2564 generic.go:356] "Generic (PLEG): container finished" podID="88289a5e-5acf-47af-8e57-ba71345fa447" containerID="45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2" exitCode=0 Jun 11 19:58:55.391410 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.391408 2564 generic.go:356] "Generic (PLEG): container finished" podID="88289a5e-5acf-47af-8e57-ba71345fa447" containerID="8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7" exitCode=0 Jun 11 19:58:55.391590 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.391414 2564 generic.go:356] "Generic (PLEG): container finished" podID="88289a5e-5acf-47af-8e57-ba71345fa447" containerID="3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951" exitCode=0 Jun 11 19:58:55.391590 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.391420 2564 generic.go:356] "Generic (PLEG): container finished" podID="88289a5e-5acf-47af-8e57-ba71345fa447" containerID="7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707" exitCode=0 Jun 11 19:58:55.391590 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.391425 2564 generic.go:356] "Generic (PLEG): container finished" podID="88289a5e-5acf-47af-8e57-ba71345fa447" containerID="2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325" exitCode=0 Jun 11 19:58:55.391590 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.391430 2564 generic.go:356] "Generic (PLEG): container finished" podID="88289a5e-5acf-47af-8e57-ba71345fa447" containerID="548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767" exitCode=0 Jun 11 19:58:55.391590 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.391460 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88289a5e-5acf-47af-8e57-ba71345fa447","Type":"ContainerDied","Data":"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2"} Jun 11 19:58:55.391590 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.391472 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.391590 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.391552 2564 scope.go:117] "RemoveContainer" containerID="45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2" Jun 11 19:58:55.391952 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.391539 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88289a5e-5acf-47af-8e57-ba71345fa447","Type":"ContainerDied","Data":"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7"} Jun 11 19:58:55.391952 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.391716 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88289a5e-5acf-47af-8e57-ba71345fa447","Type":"ContainerDied","Data":"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951"} Jun 11 19:58:55.391952 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.391749 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88289a5e-5acf-47af-8e57-ba71345fa447","Type":"ContainerDied","Data":"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707"} Jun 11 19:58:55.391952 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.391807 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88289a5e-5acf-47af-8e57-ba71345fa447","Type":"ContainerDied","Data":"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325"} Jun 11 19:58:55.391952 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.391846 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88289a5e-5acf-47af-8e57-ba71345fa447","Type":"ContainerDied","Data":"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767"} Jun 11 19:58:55.391952 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.391887 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88289a5e-5acf-47af-8e57-ba71345fa447","Type":"ContainerDied","Data":"fe9880d4aa01d50a0cda06bba8c9e51511f3d9b9051826d123de6248527fcae7"} Jun 11 19:58:55.402126 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.402108 2564 scope.go:117] "RemoveContainer" containerID="8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7" Jun 11 19:58:55.409224 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.409205 2564 scope.go:117] "RemoveContainer" containerID="3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951" Jun 11 19:58:55.416266 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.416249 2564 scope.go:117] "RemoveContainer" containerID="7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707" Jun 11 19:58:55.416593 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.416577 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:58:55.423476 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.423461 2564 scope.go:117] "RemoveContainer" containerID="2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325" Jun 11 19:58:55.424147 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.424129 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:58:55.430327 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.430314 2564 scope.go:117] "RemoveContainer" containerID="548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767" Jun 11 19:58:55.437058 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.437039 2564 scope.go:117] "RemoveContainer" containerID="1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11" Jun 11 19:58:55.443523 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.443508 2564 scope.go:117] "RemoveContainer" containerID="45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2" Jun 11 19:58:55.443752 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:58:55.443736 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2\": container with ID starting with 45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2 not found: ID does not exist" containerID="45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2" Jun 11 19:58:55.443870 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.443759 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2"} err="failed to get container status \"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2\": rpc error: code = NotFound desc = could not find container \"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2\": container with ID starting with 45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2 not found: ID does not exist" Jun 11 19:58:55.443870 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.443775 2564 scope.go:117] "RemoveContainer" containerID="8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7" Jun 11 19:58:55.444005 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:58:55.443992 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7\": container with ID starting with 8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7 not found: ID does not exist" containerID="8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7" Jun 11 19:58:55.444050 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.444008 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7"} err="failed to get container status \"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7\": rpc error: code = NotFound desc = could not find container \"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7\": container with ID starting with 8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7 not found: ID does not exist" Jun 11 19:58:55.444050 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.444019 2564 scope.go:117] "RemoveContainer" containerID="3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951" Jun 11 19:58:55.444202 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:58:55.444186 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951\": container with ID starting with 3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951 not found: ID does not exist" containerID="3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951" Jun 11 19:58:55.444237 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.444205 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951"} err="failed to get container status \"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951\": rpc error: code = NotFound desc = could not find container \"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951\": container with ID starting with 3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951 not found: ID does not exist" Jun 11 19:58:55.444237 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.444218 2564 scope.go:117] "RemoveContainer" containerID="7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707" Jun 11 19:58:55.444440 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:58:55.444425 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707\": container with ID starting with 7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707 not found: ID does not exist" containerID="7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707" Jun 11 19:58:55.444500 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.444441 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707"} err="failed to get container status \"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707\": rpc error: code = NotFound desc = could not find container \"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707\": container with ID starting with 7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707 not found: ID does not exist" Jun 11 19:58:55.444500 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.444453 2564 scope.go:117] "RemoveContainer" containerID="2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325" Jun 11 19:58:55.444700 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:58:55.444686 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325\": container with ID starting with 2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325 not found: ID does not exist" containerID="2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325" Jun 11 19:58:55.444746 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.444703 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325"} err="failed to get container status \"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325\": rpc error: code = NotFound desc = could not find container \"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325\": container with ID starting with 2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325 not found: ID does not exist" Jun 11 19:58:55.444746 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.444713 2564 scope.go:117] "RemoveContainer" containerID="548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767" Jun 11 19:58:55.444942 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:58:55.444926 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767\": container with ID starting with 548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767 not found: ID does not exist" containerID="548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767" Jun 11 19:58:55.444985 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.444943 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767"} err="failed to get container status \"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767\": rpc error: code = NotFound desc = could not find container \"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767\": container with ID starting with 548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767 not found: ID does not exist" Jun 11 19:58:55.444985 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.444955 2564 scope.go:117] "RemoveContainer" containerID="1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11" Jun 11 19:58:55.445179 ip-10-0-142-46 kubenswrapper[2564]: E0611 19:58:55.445161 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11\": container with ID starting with 1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11 not found: ID does not exist" containerID="1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11" Jun 11 19:58:55.445219 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.445185 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11"} err="failed to get container status \"1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11\": rpc error: code = NotFound desc = could not find container \"1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11\": container with ID starting with 1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11 not found: ID does not exist" Jun 11 19:58:55.445219 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.445200 2564 scope.go:117] "RemoveContainer" containerID="45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2" Jun 11 19:58:55.445425 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.445409 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2"} err="failed to get container status \"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2\": rpc error: code = NotFound desc = could not find container \"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2\": container with ID starting with 45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2 not found: ID does not exist" Jun 11 19:58:55.445425 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.445425 2564 scope.go:117] "RemoveContainer" containerID="8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7" Jun 11 19:58:55.445645 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.445628 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7"} err="failed to get container status \"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7\": rpc error: code = NotFound desc = could not find container \"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7\": container with ID starting with 8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7 not found: ID does not exist" Jun 11 19:58:55.445689 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.445646 2564 scope.go:117] "RemoveContainer" containerID="3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951" Jun 11 19:58:55.445830 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.445814 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951"} err="failed to get container status \"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951\": rpc error: code = NotFound desc = could not find container \"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951\": container with ID starting with 3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951 not found: ID does not exist" Jun 11 19:58:55.445830 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.445829 2564 scope.go:117] "RemoveContainer" containerID="7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707" Jun 11 19:58:55.446053 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.446035 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707"} err="failed to get container status \"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707\": rpc error: code = NotFound desc = could not find container \"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707\": container with ID starting with 7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707 not found: ID does not exist" Jun 11 19:58:55.446098 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.446053 2564 scope.go:117] "RemoveContainer" containerID="2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325" Jun 11 19:58:55.446285 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.446269 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325"} err="failed to get container status \"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325\": rpc error: code = NotFound desc = could not find container \"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325\": container with ID starting with 2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325 not found: ID does not exist" Jun 11 19:58:55.446285 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.446284 2564 scope.go:117] "RemoveContainer" containerID="548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767" Jun 11 19:58:55.446491 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.446474 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767"} err="failed to get container status \"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767\": rpc error: code = NotFound desc = could not find container \"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767\": container with ID starting with 548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767 not found: ID does not exist" Jun 11 19:58:55.446530 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.446493 2564 scope.go:117] "RemoveContainer" containerID="1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11" Jun 11 19:58:55.446725 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.446703 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11"} err="failed to get container status \"1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11\": rpc error: code = NotFound desc = could not find container \"1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11\": container with ID starting with 1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11 not found: ID does not exist" Jun 11 19:58:55.446725 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.446725 2564 scope.go:117] "RemoveContainer" containerID="45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2" Jun 11 19:58:55.446977 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.446960 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2"} err="failed to get container status \"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2\": rpc error: code = NotFound desc = could not find container \"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2\": container with ID starting with 45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2 not found: ID does not exist" Jun 11 19:58:55.447026 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.446978 2564 scope.go:117] "RemoveContainer" containerID="8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7" Jun 11 19:58:55.447192 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.447175 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7"} err="failed to get container status \"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7\": rpc error: code = NotFound desc = could not find container \"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7\": container with ID starting with 8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7 not found: ID does not exist" Jun 11 19:58:55.447236 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.447192 2564 scope.go:117] "RemoveContainer" containerID="3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951" Jun 11 19:58:55.447372 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.447356 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951"} err="failed to get container status \"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951\": rpc error: code = NotFound desc = could not find container \"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951\": container with ID starting with 3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951 not found: ID does not exist" Jun 11 19:58:55.447421 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.447372 2564 scope.go:117] "RemoveContainer" containerID="7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707" Jun 11 19:58:55.447553 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.447538 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707"} err="failed to get container status \"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707\": rpc error: code = NotFound desc = could not find container \"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707\": container with ID starting with 7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707 not found: ID does not exist" Jun 11 19:58:55.447606 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.447553 2564 scope.go:117] "RemoveContainer" containerID="2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325" Jun 11 19:58:55.447748 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.447731 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325"} err="failed to get container status \"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325\": rpc error: code = NotFound desc = could not find container \"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325\": container with ID starting with 2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325 not found: ID does not exist" Jun 11 19:58:55.447814 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.447748 2564 scope.go:117] "RemoveContainer" containerID="548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767" Jun 11 19:58:55.447980 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.447965 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767"} err="failed to get container status \"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767\": rpc error: code = NotFound desc = could not find container \"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767\": container with ID starting with 548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767 not found: ID does not exist" Jun 11 19:58:55.448017 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.447980 2564 scope.go:117] "RemoveContainer" containerID="1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11" Jun 11 19:58:55.448151 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.448134 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11"} err="failed to get container status \"1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11\": rpc error: code = NotFound desc = could not find container \"1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11\": container with ID starting with 1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11 not found: ID does not exist" Jun 11 19:58:55.448205 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.448155 2564 scope.go:117] "RemoveContainer" containerID="45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2" Jun 11 19:58:55.448359 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.448341 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2"} err="failed to get container status \"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2\": rpc error: code = NotFound desc = could not find container \"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2\": container with ID starting with 45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2 not found: ID does not exist" Jun 11 19:58:55.448426 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.448360 2564 scope.go:117] "RemoveContainer" containerID="8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7" Jun 11 19:58:55.448572 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.448557 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7"} err="failed to get container status \"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7\": rpc error: code = NotFound desc = could not find container \"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7\": container with ID starting with 8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7 not found: ID does not exist" Jun 11 19:58:55.448637 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.448571 2564 scope.go:117] "RemoveContainer" containerID="3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951" Jun 11 19:58:55.448775 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.448758 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951"} err="failed to get container status \"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951\": rpc error: code = NotFound desc = could not find container \"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951\": container with ID starting with 3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951 not found: ID does not exist" Jun 11 19:58:55.448865 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.448776 2564 scope.go:117] "RemoveContainer" containerID="7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707" Jun 11 19:58:55.448998 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.448981 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707"} err="failed to get container status \"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707\": rpc error: code = NotFound desc = could not find container \"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707\": container with ID starting with 7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707 not found: ID does not exist" Jun 11 19:58:55.449054 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.448998 2564 scope.go:117] "RemoveContainer" containerID="2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325" Jun 11 19:58:55.449189 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.449169 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325"} err="failed to get container status \"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325\": rpc error: code = NotFound desc = could not find container \"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325\": container with ID starting with 2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325 not found: ID does not exist" Jun 11 19:58:55.449189 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.449188 2564 scope.go:117] "RemoveContainer" containerID="548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767" Jun 11 19:58:55.449427 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.449396 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767"} err="failed to get container status \"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767\": rpc error: code = NotFound desc = could not find container \"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767\": container with ID starting with 548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767 not found: ID does not exist" Jun 11 19:58:55.449427 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.449428 2564 scope.go:117] "RemoveContainer" containerID="1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11" Jun 11 19:58:55.450623 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.449818 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11"} err="failed to get container status \"1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11\": rpc error: code = NotFound desc = could not find container \"1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11\": container with ID starting with 1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11 not found: ID does not exist" Jun 11 19:58:55.450623 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.449848 2564 scope.go:117] "RemoveContainer" containerID="45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2" Jun 11 19:58:55.450623 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.450090 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2"} err="failed to get container status \"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2\": rpc error: code = NotFound desc = could not find container \"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2\": container with ID starting with 45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2 not found: ID does not exist" Jun 11 19:58:55.450623 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.450128 2564 scope.go:117] "RemoveContainer" containerID="8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7" Jun 11 19:58:55.450623 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.450369 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7"} err="failed to get container status \"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7\": rpc error: code = NotFound desc = could not find container \"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7\": container with ID starting with 8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7 not found: ID does not exist" Jun 11 19:58:55.450623 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.450399 2564 scope.go:117] "RemoveContainer" containerID="3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951" Jun 11 19:58:55.450623 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.450595 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951"} err="failed to get container status \"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951\": rpc error: code = NotFound desc = could not find container \"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951\": container with ID starting with 3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951 not found: ID does not exist" Jun 11 19:58:55.450623 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.450615 2564 scope.go:117] "RemoveContainer" containerID="7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707" Jun 11 19:58:55.451037 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.450869 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707"} err="failed to get container status \"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707\": rpc error: code = NotFound desc = could not find container \"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707\": container with ID starting with 7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707 not found: ID does not exist" Jun 11 19:58:55.451037 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.450889 2564 scope.go:117] "RemoveContainer" containerID="2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325" Jun 11 19:58:55.451135 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.451114 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325"} err="failed to get container status \"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325\": rpc error: code = NotFound desc = could not find container \"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325\": container with ID starting with 2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325 not found: ID does not exist" Jun 11 19:58:55.451170 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.451137 2564 scope.go:117] "RemoveContainer" containerID="548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767" Jun 11 19:58:55.451356 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.451333 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767"} err="failed to get container status \"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767\": rpc error: code = NotFound desc = could not find container \"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767\": container with ID starting with 548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767 not found: ID does not exist" Jun 11 19:58:55.451356 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.451349 2564 scope.go:117] "RemoveContainer" containerID="1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11" Jun 11 19:58:55.451563 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.451541 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11"} err="failed to get container status \"1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11\": rpc error: code = NotFound desc = could not find container \"1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11\": container with ID starting with 1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11 not found: ID does not exist" Jun 11 19:58:55.451613 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.451565 2564 scope.go:117] "RemoveContainer" containerID="45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2" Jun 11 19:58:55.451675 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.451658 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:58:55.451818 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.451776 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2"} err="failed to get container status \"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2\": rpc error: code = NotFound desc = could not find container \"45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2\": container with ID starting with 45a5ea72a2e2fe675a0a62986e0bb69d67ca0fb245637686de1f8ea8ba5cfbd2 not found: ID does not exist" Jun 11 19:58:55.451893 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.451820 2564 scope.go:117] "RemoveContainer" containerID="8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7" Jun 11 19:58:55.451996 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.451978 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="kube-rbac-proxy" Jun 11 19:58:55.452045 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452001 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="kube-rbac-proxy" Jun 11 19:58:55.452045 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452015 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="init-config-reloader" Jun 11 19:58:55.452045 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452024 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="init-config-reloader" Jun 11 19:58:55.452045 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452030 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="config-reloader" Jun 11 19:58:55.452045 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452035 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="config-reloader" Jun 11 19:58:55.452045 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452043 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="kube-rbac-proxy-thanos" Jun 11 19:58:55.452045 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452048 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="kube-rbac-proxy-thanos" Jun 11 19:58:55.452283 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452062 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="prometheus" Jun 11 19:58:55.452283 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452067 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="prometheus" Jun 11 19:58:55.452283 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452065 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7"} err="failed to get container status \"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7\": rpc error: code = NotFound desc = could not find container \"8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7\": container with ID starting with 8f93f33a33fbff1e98297a599300bcf4701d89ede11ae4c02727670c07afd8a7 not found: ID does not exist" Jun 11 19:58:55.452283 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452080 2564 scope.go:117] "RemoveContainer" containerID="3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951" Jun 11 19:58:55.452283 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452083 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="thanos-sidecar" Jun 11 19:58:55.452283 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452089 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="thanos-sidecar" Jun 11 19:58:55.452283 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452095 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="kube-rbac-proxy-web" Jun 11 19:58:55.452283 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452100 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="kube-rbac-proxy-web" Jun 11 19:58:55.452283 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452144 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="kube-rbac-proxy-thanos" Jun 11 19:58:55.452283 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452153 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="thanos-sidecar" Jun 11 19:58:55.452283 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452159 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="config-reloader" Jun 11 19:58:55.452283 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452164 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="kube-rbac-proxy-web" Jun 11 19:58:55.452283 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452169 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="kube-rbac-proxy" Jun 11 19:58:55.452283 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452180 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" containerName="prometheus" Jun 11 19:58:55.452741 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452335 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951"} err="failed to get container status \"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951\": rpc error: code = NotFound desc = could not find container \"3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951\": container with ID starting with 3151d170d79a037fed6cf2d8f0acd269424aff98c13eb7fecda29881482a8951 not found: ID does not exist" Jun 11 19:58:55.452741 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452347 2564 scope.go:117] "RemoveContainer" containerID="7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707" Jun 11 19:58:55.452741 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452559 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707"} err="failed to get container status \"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707\": rpc error: code = NotFound desc = could not find container \"7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707\": container with ID starting with 7a029010c5482e28a2105b3d0ed9c2db894f65af4afabaa07d2169dd08ec7707 not found: ID does not exist" Jun 11 19:58:55.452741 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452584 2564 scope.go:117] "RemoveContainer" containerID="2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325" Jun 11 19:58:55.452916 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452777 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325"} err="failed to get container status \"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325\": rpc error: code = NotFound desc = could not find container \"2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325\": container with ID starting with 2774786ddfff58d4d11be0d7a2b131571759def660df8811f23593ea2ae79325 not found: ID does not exist" Jun 11 19:58:55.452916 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.452813 2564 scope.go:117] "RemoveContainer" containerID="548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767" Jun 11 19:58:55.453016 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.453001 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767"} err="failed to get container status \"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767\": rpc error: code = NotFound desc = could not find container \"548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767\": container with ID starting with 548924f2e70c44fb81b33d5fb69f220a64efb8b700501dc16cf842dbd9889767 not found: ID does not exist" Jun 11 19:58:55.453049 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.453017 2564 scope.go:117] "RemoveContainer" containerID="1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11" Jun 11 19:58:55.453230 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.453211 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11"} err="failed to get container status \"1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11\": rpc error: code = NotFound desc = could not find container \"1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11\": container with ID starting with 1660183dd2e06fb819798e4711de0f57dae82ab09731bdefcba73b66cac71d11 not found: ID does not exist" Jun 11 19:58:55.457334 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.457318 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.461455 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.461439 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 19:58:55.461548 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.461530 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 19:58:55.461637 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.461618 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 19:58:55.462070 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.461949 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 19:58:55.462070 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.461972 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-33tugpkjnj8vd\"" Jun 11 19:58:55.462070 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.461973 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 19:58:55.462266 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.462133 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 19:58:55.462266 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.462188 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 19:58:55.462266 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.462210 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 19:58:55.462266 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.462221 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 19:58:55.462266 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.462221 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x6qdb\"" Jun 11 19:58:55.462554 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.462447 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 19:58:55.462554 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.462513 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 19:58:55.462862 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.462656 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 19:58:55.465555 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.465532 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 19:58:55.468511 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.468492 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 19:58:55.473350 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.473332 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:58:55.586326 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.586294 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95k6f\" (UniqueName: \"kubernetes.io/projected/ea812eda-06b4-446c-84c7-590ab65d59c7-kube-api-access-95k6f\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.586484 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.586341 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-config\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.586484 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.586360 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.586484 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.586416 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea812eda-06b4-446c-84c7-590ab65d59c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.586484 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.586440 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.586484 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.586459 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.586484 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.586481 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.586872 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.586495 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.586872 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.586510 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.586872 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.586529 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.586872 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.586569 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea812eda-06b4-446c-84c7-590ab65d59c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.586872 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.586583 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.586872 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.586601 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.586872 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.586615 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.586872 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.586638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.586872 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.586707 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.586872 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.586751 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.586872 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.586778 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea812eda-06b4-446c-84c7-590ab65d59c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.586872 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.586818 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.586872 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.586838 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.688084 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.688019 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.688084 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.688054 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea812eda-06b4-446c-84c7-590ab65d59c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.688084 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.688072 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.688600 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.688197 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.688600 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.688232 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.688600 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.688267 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.688600 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.688302 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.688600 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.688343 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.688600 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.688387 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea812eda-06b4-446c-84c7-590ab65d59c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.688600 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.688411 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.688600 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.688434 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.688600 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.688463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95k6f\" (UniqueName: \"kubernetes.io/projected/ea812eda-06b4-446c-84c7-590ab65d59c7-kube-api-access-95k6f\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.688600 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.688509 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-config\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.688600 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.688536 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.688600 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.688564 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea812eda-06b4-446c-84c7-590ab65d59c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.688600 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.688589 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.688600 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.688612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.689466 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.688646 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.689466 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.688671 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.689466 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.688696 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.689466 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.689090 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.689466 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.689123 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.689709 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.689643 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.690138 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.690113 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea812eda-06b4-446c-84c7-590ab65d59c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.690226 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.690206 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.690681 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.690656 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.692102 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.691199 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.692102 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.691378 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.692102 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.691818 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.692102 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.691843 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea812eda-06b4-446c-84c7-590ab65d59c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.692739 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.692411 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea812eda-06b4-446c-84c7-590ab65d59c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.692739 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.692678 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea812eda-06b4-446c-84c7-590ab65d59c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.692908 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.692883 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.693719 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.693293 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.693719 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.693681 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.694126 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.694105 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.694270 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.694244 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.695247 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.695221 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-config\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.695338 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.695318 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea812eda-06b4-446c-84c7-590ab65d59c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.703219 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.703201 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95k6f\" (UniqueName: \"kubernetes.io/projected/ea812eda-06b4-446c-84c7-590ab65d59c7-kube-api-access-95k6f\") pod \"prometheus-k8s-0\" (UID: \"ea812eda-06b4-446c-84c7-590ab65d59c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.766497 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.766472 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:58:55.907675 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:55.907571 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:58:55.911680 ip-10-0-142-46 kubenswrapper[2564]: W0611 19:58:55.911649 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea812eda_06b4_446c_84c7_590ab65d59c7.slice/crio-150e08cc42b4c7f4446b15ee861288dba8c2d423ebd01e82fdaa5c0d2046c4ad WatchSource:0}: Error finding container 150e08cc42b4c7f4446b15ee861288dba8c2d423ebd01e82fdaa5c0d2046c4ad: Status 404 returned error can't find the container with id 150e08cc42b4c7f4446b15ee861288dba8c2d423ebd01e82fdaa5c0d2046c4ad Jun 11 19:58:56.397765 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:56.397729 2564 generic.go:356] "Generic (PLEG): container finished" podID="ea812eda-06b4-446c-84c7-590ab65d59c7" containerID="bebcb44f3746138638fd18bbec120572d4d25986e14ca2f2db1b5be6ad2d57eb" exitCode=0 Jun 11 19:58:56.397963 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:56.397834 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea812eda-06b4-446c-84c7-590ab65d59c7","Type":"ContainerDied","Data":"bebcb44f3746138638fd18bbec120572d4d25986e14ca2f2db1b5be6ad2d57eb"} Jun 11 19:58:56.397963 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:56.397907 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea812eda-06b4-446c-84c7-590ab65d59c7","Type":"ContainerStarted","Data":"150e08cc42b4c7f4446b15ee861288dba8c2d423ebd01e82fdaa5c0d2046c4ad"} Jun 11 19:58:57.298505 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:57.298483 2564 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 19:58:57.348161 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:57.348044 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88289a5e-5acf-47af-8e57-ba71345fa447" path="/var/lib/kubelet/pods/88289a5e-5acf-47af-8e57-ba71345fa447/volumes" Jun 11 19:58:57.406345 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:57.406310 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea812eda-06b4-446c-84c7-590ab65d59c7","Type":"ContainerStarted","Data":"a7ee930366f0ed2704bb7f84c6ecf077285c8a0609f1492c38b1fbdf9af63b8d"} Jun 11 19:58:57.406495 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:57.406377 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea812eda-06b4-446c-84c7-590ab65d59c7","Type":"ContainerStarted","Data":"5408eb096581796e2b4176994b2d8fa20bad37e480411a9fb79f6344b082f0d0"} Jun 11 19:58:57.406495 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:57.406419 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea812eda-06b4-446c-84c7-590ab65d59c7","Type":"ContainerStarted","Data":"df77368646d35ff9ad18fece52ec1b12a9ee1a74fceb2a4c6151efceceb63272"} Jun 11 19:58:57.406495 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:57.406458 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea812eda-06b4-446c-84c7-590ab65d59c7","Type":"ContainerStarted","Data":"1846e5d9793fb0170e7f0c8c8adcbc7011e8ed887b4f4d924b462c9820bb37ce"} Jun 11 19:58:57.406650 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:57.406508 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea812eda-06b4-446c-84c7-590ab65d59c7","Type":"ContainerStarted","Data":"07b7b658d84425584d303bf64ef6480bb5e763f5017342f7d51775f2a30b06bf"} Jun 11 19:58:57.406650 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:57.406543 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea812eda-06b4-446c-84c7-590ab65d59c7","Type":"ContainerStarted","Data":"3c1797d11a18513165dd97891ac653304a56a1d76d1d116ae89a765662f95f63"} Jun 11 19:58:57.436809 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:58:57.435862 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.417184868 podStartE2EDuration="2.435843683s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.658815ms" isStatefulPod=false podCreationTimestamp="2026-06-11 19:58:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:58:57.433174131 +0000 UTC m=+300.464890792" watchObservedRunningTime="2026-06-11 19:58:57.435843683 +0000 UTC m=+300.467560323" Jun 11 19:59:00.766943 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:59:00.766909 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:59:55.767721 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:59:55.767627 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:59:55.783623 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:59:55.783595 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:59:56.646029 ip-10-0-142-46 kubenswrapper[2564]: I0611 19:59:56.646005 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 20:02:12.283855 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.283769 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m"] Jun 11 20:02:12.287248 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.287228 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" Jun 11 20:02:12.291099 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.291074 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 20:02:12.291218 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.291118 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 20:02:12.291218 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.291126 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7pz95\"" Jun 11 20:02:12.291431 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.291417 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 20:02:12.291510 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.291496 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 20:02:12.301474 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.301455 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m"] Jun 11 20:02:12.396843 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.396811 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf4cbcb4-94d4-4972-aff2-cccf9ec21889-tmp\") pod \"opendatahub-operator-controller-manager-cd897d645-bl99m\" (UID: \"cf4cbcb4-94d4-4972-aff2-cccf9ec21889\") " pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" Jun 11 20:02:12.397003 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.396883 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf4cbcb4-94d4-4972-aff2-cccf9ec21889-webhook-cert\") pod \"opendatahub-operator-controller-manager-cd897d645-bl99m\" (UID: \"cf4cbcb4-94d4-4972-aff2-cccf9ec21889\") " pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" Jun 11 20:02:12.397003 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.396924 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mdqb\" (UniqueName: \"kubernetes.io/projected/cf4cbcb4-94d4-4972-aff2-cccf9ec21889-kube-api-access-8mdqb\") pod \"opendatahub-operator-controller-manager-cd897d645-bl99m\" (UID: \"cf4cbcb4-94d4-4972-aff2-cccf9ec21889\") " pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" Jun 11 20:02:12.397003 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.396958 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cf4cbcb4-94d4-4972-aff2-cccf9ec21889-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cd897d645-bl99m\" (UID: \"cf4cbcb4-94d4-4972-aff2-cccf9ec21889\") " pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" Jun 11 20:02:12.397168 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.397090 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cf4cbcb4-94d4-4972-aff2-cccf9ec21889-manifests\") pod \"opendatahub-operator-controller-manager-cd897d645-bl99m\" (UID: \"cf4cbcb4-94d4-4972-aff2-cccf9ec21889\") " pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" Jun 11 20:02:12.497649 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.497624 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf4cbcb4-94d4-4972-aff2-cccf9ec21889-tmp\") pod \"opendatahub-operator-controller-manager-cd897d645-bl99m\" (UID: \"cf4cbcb4-94d4-4972-aff2-cccf9ec21889\") " pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" Jun 11 20:02:12.497819 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.497656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf4cbcb4-94d4-4972-aff2-cccf9ec21889-webhook-cert\") pod \"opendatahub-operator-controller-manager-cd897d645-bl99m\" (UID: \"cf4cbcb4-94d4-4972-aff2-cccf9ec21889\") " pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" Jun 11 20:02:12.497819 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.497677 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mdqb\" (UniqueName: \"kubernetes.io/projected/cf4cbcb4-94d4-4972-aff2-cccf9ec21889-kube-api-access-8mdqb\") pod \"opendatahub-operator-controller-manager-cd897d645-bl99m\" (UID: \"cf4cbcb4-94d4-4972-aff2-cccf9ec21889\") " pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" Jun 11 20:02:12.497819 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.497700 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cf4cbcb4-94d4-4972-aff2-cccf9ec21889-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cd897d645-bl99m\" (UID: \"cf4cbcb4-94d4-4972-aff2-cccf9ec21889\") " pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" Jun 11 20:02:12.498004 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.497950 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cf4cbcb4-94d4-4972-aff2-cccf9ec21889-manifests\") pod \"opendatahub-operator-controller-manager-cd897d645-bl99m\" (UID: \"cf4cbcb4-94d4-4972-aff2-cccf9ec21889\") " pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" Jun 11 20:02:12.498307 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.498276 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cf4cbcb4-94d4-4972-aff2-cccf9ec21889-manifests\") pod \"opendatahub-operator-controller-manager-cd897d645-bl99m\" (UID: \"cf4cbcb4-94d4-4972-aff2-cccf9ec21889\") " pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" Jun 11 20:02:12.500126 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.500107 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf4cbcb4-94d4-4972-aff2-cccf9ec21889-tmp\") pod \"opendatahub-operator-controller-manager-cd897d645-bl99m\" (UID: \"cf4cbcb4-94d4-4972-aff2-cccf9ec21889\") " pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" Jun 11 20:02:12.500240 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.500225 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cf4cbcb4-94d4-4972-aff2-cccf9ec21889-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cd897d645-bl99m\" (UID: \"cf4cbcb4-94d4-4972-aff2-cccf9ec21889\") " pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" Jun 11 20:02:12.500410 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.500390 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cf4cbcb4-94d4-4972-aff2-cccf9ec21889-webhook-cert\") pod \"opendatahub-operator-controller-manager-cd897d645-bl99m\" (UID: \"cf4cbcb4-94d4-4972-aff2-cccf9ec21889\") " pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" Jun 11 20:02:12.505953 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.505930 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mdqb\" (UniqueName: \"kubernetes.io/projected/cf4cbcb4-94d4-4972-aff2-cccf9ec21889-kube-api-access-8mdqb\") pod \"opendatahub-operator-controller-manager-cd897d645-bl99m\" (UID: \"cf4cbcb4-94d4-4972-aff2-cccf9ec21889\") " pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" Jun 11 20:02:12.597328 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.597304 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" Jun 11 20:02:12.729723 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.729699 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m"] Jun 11 20:02:12.731834 ip-10-0-142-46 kubenswrapper[2564]: W0611 20:02:12.731805 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf4cbcb4_94d4_4972_aff2_cccf9ec21889.slice/crio-96329a0942203203df1e82565e0e5ba7e87910620f443e39bac4b512f9bb5dd4 WatchSource:0}: Error finding container 96329a0942203203df1e82565e0e5ba7e87910620f443e39bac4b512f9bb5dd4: Status 404 returned error can't find the container with id 96329a0942203203df1e82565e0e5ba7e87910620f443e39bac4b512f9bb5dd4 Jun 11 20:02:12.733612 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:12.733594 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 20:02:13.134448 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:13.134416 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" event={"ID":"cf4cbcb4-94d4-4972-aff2-cccf9ec21889","Type":"ContainerStarted","Data":"96329a0942203203df1e82565e0e5ba7e87910620f443e39bac4b512f9bb5dd4"} Jun 11 20:02:16.147887 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:16.147844 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" event={"ID":"cf4cbcb4-94d4-4972-aff2-cccf9ec21889","Type":"ContainerStarted","Data":"fca44cbf5b1d848a22bb00b86bbb2eef561f82fb8334cd94ed319743308e19d0"} Jun 11 20:02:17.152603 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:17.152558 2564 generic.go:356] "Generic (PLEG): container finished" podID="cf4cbcb4-94d4-4972-aff2-cccf9ec21889" containerID="fca44cbf5b1d848a22bb00b86bbb2eef561f82fb8334cd94ed319743308e19d0" exitCode=0 Jun 11 20:02:17.153002 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:17.152645 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" event={"ID":"cf4cbcb4-94d4-4972-aff2-cccf9ec21889","Type":"ContainerDied","Data":"fca44cbf5b1d848a22bb00b86bbb2eef561f82fb8334cd94ed319743308e19d0"} Jun 11 20:02:18.158507 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:18.158471 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" event={"ID":"cf4cbcb4-94d4-4972-aff2-cccf9ec21889","Type":"ContainerStarted","Data":"bfa97277fbfd8785450f59e055e981f78fd5b23ccd43a4e970e40f2ba0ccb4d5"} Jun 11 20:02:18.159033 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:18.158609 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" Jun 11 20:02:18.180449 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:18.180404 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" podStartSLOduration=2.111881601 podStartE2EDuration="6.180390652s" totalImagesPullingTime="3.143080672s" totalInitContainerRuntime="925.428379ms" isStatefulPod=false podCreationTimestamp="2026-06-11 20:02:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:18.180246198 +0000 UTC m=+501.211962851" watchObservedRunningTime="2026-06-11 20:02:18.180390652 +0000 UTC m=+501.212107292" Jun 11 20:02:29.164937 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:29.164908 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cd897d645-bl99m" Jun 11 20:02:30.204410 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.204374 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt"] Jun 11 20:02:30.219305 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.219273 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt" Jun 11 20:02:30.223968 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.223940 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 20:02:30.224306 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.223946 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 20:02:30.224475 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.223946 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xqrxm\"" Jun 11 20:02:30.224593 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.223991 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 20:02:30.224593 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.223999 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 20:02:30.224593 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.224017 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 20:02:30.224950 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.224928 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt"] Jun 11 20:02:30.347535 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.347511 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb-cert\") pod \"lws-controller-manager-8999ff5c6-zllkt\" (UID: \"6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb\") " pod="openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt" Jun 11 20:02:30.347704 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.347543 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb-metrics-cert\") pod \"lws-controller-manager-8999ff5c6-zllkt\" (UID: \"6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb\") " pod="openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt" Jun 11 20:02:30.347704 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.347565 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdmzm\" (UniqueName: \"kubernetes.io/projected/6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb-kube-api-access-cdmzm\") pod \"lws-controller-manager-8999ff5c6-zllkt\" (UID: \"6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb\") " pod="openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt" Jun 11 20:02:30.347704 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.347600 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb-manager-config\") pod \"lws-controller-manager-8999ff5c6-zllkt\" (UID: \"6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb\") " pod="openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt" Jun 11 20:02:30.448507 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.448473 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb-manager-config\") pod \"lws-controller-manager-8999ff5c6-zllkt\" (UID: \"6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb\") " pod="openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt" Jun 11 20:02:30.448660 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.448534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb-cert\") pod \"lws-controller-manager-8999ff5c6-zllkt\" (UID: \"6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb\") " pod="openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt" Jun 11 20:02:30.448660 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.448646 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb-metrics-cert\") pod \"lws-controller-manager-8999ff5c6-zllkt\" (UID: \"6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb\") " pod="openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt" Jun 11 20:02:30.448731 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.448688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdmzm\" (UniqueName: \"kubernetes.io/projected/6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb-kube-api-access-cdmzm\") pod \"lws-controller-manager-8999ff5c6-zllkt\" (UID: \"6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb\") " pod="openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt" Jun 11 20:02:30.449159 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.449138 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb-manager-config\") pod \"lws-controller-manager-8999ff5c6-zllkt\" (UID: \"6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb\") " pod="openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt" Jun 11 20:02:30.451117 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.451089 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb-metrics-cert\") pod \"lws-controller-manager-8999ff5c6-zllkt\" (UID: \"6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb\") " pod="openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt" Jun 11 20:02:30.451201 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.451144 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb-cert\") pod \"lws-controller-manager-8999ff5c6-zllkt\" (UID: \"6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb\") " pod="openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt" Jun 11 20:02:30.458223 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.458169 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdmzm\" (UniqueName: \"kubernetes.io/projected/6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb-kube-api-access-cdmzm\") pod \"lws-controller-manager-8999ff5c6-zllkt\" (UID: \"6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb\") " pod="openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt" Jun 11 20:02:30.531048 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.531011 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt" Jun 11 20:02:30.692398 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:30.692284 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt"] Jun 11 20:02:30.695105 ip-10-0-142-46 kubenswrapper[2564]: W0611 20:02:30.695080 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c75b55d_0ee4_4ba9_ba00_a577eb4b74fb.slice/crio-54f0e71545413d47d443d198c2f7856e80e1e6d997239e68fbb1c7ba12cb99f4 WatchSource:0}: Error finding container 54f0e71545413d47d443d198c2f7856e80e1e6d997239e68fbb1c7ba12cb99f4: Status 404 returned error can't find the container with id 54f0e71545413d47d443d198c2f7856e80e1e6d997239e68fbb1c7ba12cb99f4 Jun 11 20:02:31.210905 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:31.210874 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt" event={"ID":"6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb","Type":"ContainerStarted","Data":"54f0e71545413d47d443d198c2f7856e80e1e6d997239e68fbb1c7ba12cb99f4"} Jun 11 20:02:34.226630 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:34.226596 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt" event={"ID":"6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb","Type":"ContainerStarted","Data":"568201debf4f96fe26e2dd98ca491eedfdfbe4b26a809153e1469b41757b1009"} Jun 11 20:02:34.227012 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:34.226695 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt" Jun 11 20:02:34.247405 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:34.247361 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt" podStartSLOduration=1.701386359 podStartE2EDuration="4.247345383s" totalImagesPullingTime="2.545959024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:02:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:34.246599256 +0000 UTC m=+517.278315896" watchObservedRunningTime="2026-06-11 20:02:34.247345383 +0000 UTC m=+517.279062023" Jun 11 20:02:37.529494 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:37.529417 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8d547749b-zf8v2"] Jun 11 20:02:37.532780 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:37.532755 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8d547749b-zf8v2" Jun 11 20:02:37.535329 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:37.535308 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 20:02:37.536322 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:37.536298 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qsbgm\"" Jun 11 20:02:37.536433 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:37.536361 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 20:02:37.536433 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:37.536378 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 20:02:37.536588 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:37.536472 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 20:02:37.543445 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:37.543423 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8d547749b-zf8v2"] Jun 11 20:02:37.612440 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:37.612412 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmgqv\" (UniqueName: \"kubernetes.io/projected/52deafb4-e9f0-42d5-92e2-b1aba9aee108-kube-api-access-bmgqv\") pod \"kube-auth-proxy-8d547749b-zf8v2\" (UID: \"52deafb4-e9f0-42d5-92e2-b1aba9aee108\") " pod="openshift-ingress/kube-auth-proxy-8d547749b-zf8v2" Jun 11 20:02:37.612618 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:37.612458 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52deafb4-e9f0-42d5-92e2-b1aba9aee108-tmp\") pod \"kube-auth-proxy-8d547749b-zf8v2\" (UID: \"52deafb4-e9f0-42d5-92e2-b1aba9aee108\") " pod="openshift-ingress/kube-auth-proxy-8d547749b-zf8v2" Jun 11 20:02:37.612618 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:37.612490 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52deafb4-e9f0-42d5-92e2-b1aba9aee108-tls-certs\") pod \"kube-auth-proxy-8d547749b-zf8v2\" (UID: \"52deafb4-e9f0-42d5-92e2-b1aba9aee108\") " pod="openshift-ingress/kube-auth-proxy-8d547749b-zf8v2" Jun 11 20:02:37.713167 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:37.713132 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52deafb4-e9f0-42d5-92e2-b1aba9aee108-tls-certs\") pod \"kube-auth-proxy-8d547749b-zf8v2\" (UID: \"52deafb4-e9f0-42d5-92e2-b1aba9aee108\") " pod="openshift-ingress/kube-auth-proxy-8d547749b-zf8v2" Jun 11 20:02:37.713416 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:37.713264 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmgqv\" (UniqueName: \"kubernetes.io/projected/52deafb4-e9f0-42d5-92e2-b1aba9aee108-kube-api-access-bmgqv\") pod \"kube-auth-proxy-8d547749b-zf8v2\" (UID: \"52deafb4-e9f0-42d5-92e2-b1aba9aee108\") " pod="openshift-ingress/kube-auth-proxy-8d547749b-zf8v2" Jun 11 20:02:37.713416 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:37.713308 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52deafb4-e9f0-42d5-92e2-b1aba9aee108-tmp\") pod \"kube-auth-proxy-8d547749b-zf8v2\" (UID: \"52deafb4-e9f0-42d5-92e2-b1aba9aee108\") " pod="openshift-ingress/kube-auth-proxy-8d547749b-zf8v2" Jun 11 20:02:37.715583 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:37.715562 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52deafb4-e9f0-42d5-92e2-b1aba9aee108-tmp\") pod \"kube-auth-proxy-8d547749b-zf8v2\" (UID: \"52deafb4-e9f0-42d5-92e2-b1aba9aee108\") " pod="openshift-ingress/kube-auth-proxy-8d547749b-zf8v2" Jun 11 20:02:37.715926 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:37.715907 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52deafb4-e9f0-42d5-92e2-b1aba9aee108-tls-certs\") pod \"kube-auth-proxy-8d547749b-zf8v2\" (UID: \"52deafb4-e9f0-42d5-92e2-b1aba9aee108\") " pod="openshift-ingress/kube-auth-proxy-8d547749b-zf8v2" Jun 11 20:02:37.724562 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:37.724542 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmgqv\" (UniqueName: \"kubernetes.io/projected/52deafb4-e9f0-42d5-92e2-b1aba9aee108-kube-api-access-bmgqv\") pod \"kube-auth-proxy-8d547749b-zf8v2\" (UID: \"52deafb4-e9f0-42d5-92e2-b1aba9aee108\") " pod="openshift-ingress/kube-auth-proxy-8d547749b-zf8v2" Jun 11 20:02:37.842888 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:37.842857 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8d547749b-zf8v2" Jun 11 20:02:37.972236 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:37.972205 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8d547749b-zf8v2"] Jun 11 20:02:37.975840 ip-10-0-142-46 kubenswrapper[2564]: W0611 20:02:37.975813 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52deafb4_e9f0_42d5_92e2_b1aba9aee108.slice/crio-6d4d46217ea2614bb1d1e9d17e0961e4f623a07043baf692dc371f9135ef4fca WatchSource:0}: Error finding container 6d4d46217ea2614bb1d1e9d17e0961e4f623a07043baf692dc371f9135ef4fca: Status 404 returned error can't find the container with id 6d4d46217ea2614bb1d1e9d17e0961e4f623a07043baf692dc371f9135ef4fca Jun 11 20:02:38.245364 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:38.245282 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8d547749b-zf8v2" event={"ID":"52deafb4-e9f0-42d5-92e2-b1aba9aee108","Type":"ContainerStarted","Data":"6d4d46217ea2614bb1d1e9d17e0961e4f623a07043baf692dc371f9135ef4fca"} Jun 11 20:02:42.267293 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:42.267245 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8d547749b-zf8v2" event={"ID":"52deafb4-e9f0-42d5-92e2-b1aba9aee108","Type":"ContainerStarted","Data":"5855cbf3e80d589662ec46656fe3a81cb7497e145b5d1b8459bcb90b46307f57"} Jun 11 20:02:42.319534 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:42.319481 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8d547749b-zf8v2" podStartSLOduration=1.711501205 podStartE2EDuration="5.319467605s" totalImagesPullingTime="3.6079664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:42.318534016 +0000 UTC m=+525.350250656" watchObservedRunningTime="2026-06-11 20:02:42.319467605 +0000 UTC m=+525.351184245" Jun 11 20:02:45.234764 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:02:45.234738 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8999ff5c6-zllkt" Jun 11 20:04:20.758588 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:20.758553 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wsrw2"] Jun 11 20:04:20.760561 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:20.760547 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wsrw2" Jun 11 20:04:20.763176 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:20.763153 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 20:04:20.764113 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:20.764091 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-rtlkl\"" Jun 11 20:04:20.764229 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:20.764091 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 20:04:20.764229 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:20.764142 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 20:04:20.775051 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:20.775032 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wsrw2"] Jun 11 20:04:20.853917 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:20.853891 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2l8s\" (UniqueName: \"kubernetes.io/projected/7eee7395-52cc-45cb-b646-9d9ab953a9d3-kube-api-access-c2l8s\") pod \"dns-operator-controller-manager-864dd78c4c-wsrw2\" (UID: \"7eee7395-52cc-45cb-b646-9d9ab953a9d3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wsrw2" Jun 11 20:04:20.955152 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:20.955111 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2l8s\" (UniqueName: \"kubernetes.io/projected/7eee7395-52cc-45cb-b646-9d9ab953a9d3-kube-api-access-c2l8s\") pod \"dns-operator-controller-manager-864dd78c4c-wsrw2\" (UID: \"7eee7395-52cc-45cb-b646-9d9ab953a9d3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wsrw2" Jun 11 20:04:20.965451 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:20.965418 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2l8s\" (UniqueName: \"kubernetes.io/projected/7eee7395-52cc-45cb-b646-9d9ab953a9d3-kube-api-access-c2l8s\") pod \"dns-operator-controller-manager-864dd78c4c-wsrw2\" (UID: \"7eee7395-52cc-45cb-b646-9d9ab953a9d3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wsrw2" Jun 11 20:04:21.071531 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:21.071500 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wsrw2" Jun 11 20:04:21.199121 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:21.199066 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wsrw2"] Jun 11 20:04:21.202766 ip-10-0-142-46 kubenswrapper[2564]: W0611 20:04:21.202739 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eee7395_52cc_45cb_b646_9d9ab953a9d3.slice/crio-bd7b1fcb4b0ab9a028df34f6f4e7caaeaa6df86092e4cba94fa4ab0cec12c331 WatchSource:0}: Error finding container bd7b1fcb4b0ab9a028df34f6f4e7caaeaa6df86092e4cba94fa4ab0cec12c331: Status 404 returned error can't find the container with id bd7b1fcb4b0ab9a028df34f6f4e7caaeaa6df86092e4cba94fa4ab0cec12c331 Jun 11 20:04:21.662706 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:21.662676 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wsrw2" event={"ID":"7eee7395-52cc-45cb-b646-9d9ab953a9d3","Type":"ContainerStarted","Data":"bd7b1fcb4b0ab9a028df34f6f4e7caaeaa6df86092e4cba94fa4ab0cec12c331"} Jun 11 20:04:24.680412 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:24.680368 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wsrw2" event={"ID":"7eee7395-52cc-45cb-b646-9d9ab953a9d3","Type":"ContainerStarted","Data":"38a0dd9025ef142e840b6690a75c43c245255e0f66a31b1864841ee58fcde611"} Jun 11 20:04:24.680834 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:24.680516 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wsrw2" Jun 11 20:04:24.700157 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:24.700107 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wsrw2" podStartSLOduration=2.135694971 podStartE2EDuration="4.700093474s" totalImagesPullingTime="2.564398503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:04:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:04:24.698225635 +0000 UTC m=+627.729942287" watchObservedRunningTime="2026-06-11 20:04:24.700093474 +0000 UTC m=+627.731810114" Jun 11 20:04:35.686859 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:35.686827 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wsrw2" Jun 11 20:04:36.402327 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:36.402295 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmlkb"] Jun 11 20:04:36.404444 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:36.404428 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmlkb" Jun 11 20:04:36.407386 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:36.407360 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tqds8\"" Jun 11 20:04:36.424904 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:36.424883 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmlkb"] Jun 11 20:04:36.591982 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:36.591953 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab6ada21-ad71-4ac9-8d3d-610d824dec91-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qmlkb\" (UID: \"ab6ada21-ad71-4ac9-8d3d-610d824dec91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmlkb" Jun 11 20:04:36.592164 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:36.591994 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x4ls\" (UniqueName: \"kubernetes.io/projected/ab6ada21-ad71-4ac9-8d3d-610d824dec91-kube-api-access-2x4ls\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qmlkb\" (UID: \"ab6ada21-ad71-4ac9-8d3d-610d824dec91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmlkb" Jun 11 20:04:36.603580 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:36.603555 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmlkb"] Jun 11 20:04:36.603800 ip-10-0-142-46 kubenswrapper[2564]: E0611 20:04:36.603768 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-2x4ls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmlkb" podUID="ab6ada21-ad71-4ac9-8d3d-610d824dec91" Jun 11 20:04:36.693231 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:36.693161 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab6ada21-ad71-4ac9-8d3d-610d824dec91-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qmlkb\" (UID: \"ab6ada21-ad71-4ac9-8d3d-610d824dec91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmlkb" Jun 11 20:04:36.693231 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:36.693201 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x4ls\" (UniqueName: \"kubernetes.io/projected/ab6ada21-ad71-4ac9-8d3d-610d824dec91-kube-api-access-2x4ls\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qmlkb\" (UID: \"ab6ada21-ad71-4ac9-8d3d-610d824dec91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmlkb" Jun 11 20:04:36.693580 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:36.693515 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab6ada21-ad71-4ac9-8d3d-610d824dec91-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qmlkb\" (UID: \"ab6ada21-ad71-4ac9-8d3d-610d824dec91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmlkb" Jun 11 20:04:36.710134 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:36.710112 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x4ls\" (UniqueName: \"kubernetes.io/projected/ab6ada21-ad71-4ac9-8d3d-610d824dec91-kube-api-access-2x4ls\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qmlkb\" (UID: \"ab6ada21-ad71-4ac9-8d3d-610d824dec91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmlkb" Jun 11 20:04:36.735557 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:36.735532 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmlkb" Jun 11 20:04:36.741166 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:36.741146 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmlkb" Jun 11 20:04:36.894327 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:36.894304 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab6ada21-ad71-4ac9-8d3d-610d824dec91-extensions-socket-volume\") pod \"ab6ada21-ad71-4ac9-8d3d-610d824dec91\" (UID: \"ab6ada21-ad71-4ac9-8d3d-610d824dec91\") " Jun 11 20:04:36.894481 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:36.894348 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x4ls\" (UniqueName: \"kubernetes.io/projected/ab6ada21-ad71-4ac9-8d3d-610d824dec91-kube-api-access-2x4ls\") pod \"ab6ada21-ad71-4ac9-8d3d-610d824dec91\" (UID: \"ab6ada21-ad71-4ac9-8d3d-610d824dec91\") " Jun 11 20:04:36.894573 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:36.894548 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab6ada21-ad71-4ac9-8d3d-610d824dec91-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ab6ada21-ad71-4ac9-8d3d-610d824dec91" (UID: "ab6ada21-ad71-4ac9-8d3d-610d824dec91"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:04:36.896468 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:36.896443 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab6ada21-ad71-4ac9-8d3d-610d824dec91-kube-api-access-2x4ls" (OuterVolumeSpecName: "kube-api-access-2x4ls") pod "ab6ada21-ad71-4ac9-8d3d-610d824dec91" (UID: "ab6ada21-ad71-4ac9-8d3d-610d824dec91"). InnerVolumeSpecName "kube-api-access-2x4ls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:04:36.995868 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:36.995810 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab6ada21-ad71-4ac9-8d3d-610d824dec91-extensions-socket-volume\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:04:36.995868 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:36.995832 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x4ls\" (UniqueName: \"kubernetes.io/projected/ab6ada21-ad71-4ac9-8d3d-610d824dec91-kube-api-access-2x4ls\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:04:37.045824 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:37.045794 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmlkb"] Jun 11 20:04:37.063684 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:37.063654 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmlkb"] Jun 11 20:04:37.121495 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:37.121462 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw"] Jun 11 20:04:37.123684 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:37.123663 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw" Jun 11 20:04:37.145396 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:37.145367 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw"] Jun 11 20:04:37.196595 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:37.196566 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twqjk\" (UniqueName: \"kubernetes.io/projected/d5b6a702-8da3-4a40-be8b-fe4ecb172e98-kube-api-access-twqjk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7rcnw\" (UID: \"d5b6a702-8da3-4a40-be8b-fe4ecb172e98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw" Jun 11 20:04:37.196729 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:37.196624 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5b6a702-8da3-4a40-be8b-fe4ecb172e98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7rcnw\" (UID: \"d5b6a702-8da3-4a40-be8b-fe4ecb172e98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw" Jun 11 20:04:37.297094 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:37.297020 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twqjk\" (UniqueName: \"kubernetes.io/projected/d5b6a702-8da3-4a40-be8b-fe4ecb172e98-kube-api-access-twqjk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7rcnw\" (UID: \"d5b6a702-8da3-4a40-be8b-fe4ecb172e98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw" Jun 11 20:04:37.297197 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:37.297094 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5b6a702-8da3-4a40-be8b-fe4ecb172e98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7rcnw\" (UID: \"d5b6a702-8da3-4a40-be8b-fe4ecb172e98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw" Jun 11 20:04:37.297419 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:37.297402 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5b6a702-8da3-4a40-be8b-fe4ecb172e98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7rcnw\" (UID: \"d5b6a702-8da3-4a40-be8b-fe4ecb172e98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw" Jun 11 20:04:37.306621 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:37.306592 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twqjk\" (UniqueName: \"kubernetes.io/projected/d5b6a702-8da3-4a40-be8b-fe4ecb172e98-kube-api-access-twqjk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7rcnw\" (UID: \"d5b6a702-8da3-4a40-be8b-fe4ecb172e98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw" Jun 11 20:04:37.347774 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:37.347742 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab6ada21-ad71-4ac9-8d3d-610d824dec91" path="/var/lib/kubelet/pods/ab6ada21-ad71-4ac9-8d3d-610d824dec91/volumes" Jun 11 20:04:37.434069 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:37.434035 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw" Jun 11 20:04:37.568027 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:37.568007 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw"] Jun 11 20:04:37.570436 ip-10-0-142-46 kubenswrapper[2564]: W0611 20:04:37.570414 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5b6a702_8da3_4a40_be8b_fe4ecb172e98.slice/crio-a5ad6a86d85bb263bb6777ef57e943b131b14759113d2dd579e17019d591deb8 WatchSource:0}: Error finding container a5ad6a86d85bb263bb6777ef57e943b131b14759113d2dd579e17019d591deb8: Status 404 returned error can't find the container with id a5ad6a86d85bb263bb6777ef57e943b131b14759113d2dd579e17019d591deb8 Jun 11 20:04:37.741271 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:37.741241 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qmlkb" Jun 11 20:04:37.741271 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:37.741261 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw" event={"ID":"d5b6a702-8da3-4a40-be8b-fe4ecb172e98","Type":"ContainerStarted","Data":"a5ad6a86d85bb263bb6777ef57e943b131b14759113d2dd579e17019d591deb8"} Jun 11 20:04:42.765806 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:42.765740 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw" event={"ID":"d5b6a702-8da3-4a40-be8b-fe4ecb172e98","Type":"ContainerStarted","Data":"a73f9d9ba8734d5d1917b08675f4515ae4382290832f52852ae56bf28505ce9d"} Jun 11 20:04:42.766238 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:42.765850 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw" Jun 11 20:04:42.791700 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:42.791652 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw" podStartSLOduration=1.318009265 podStartE2EDuration="5.791638293s" totalImagesPullingTime="4.473629028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:04:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:04:42.789704015 +0000 UTC m=+645.821420709" watchObservedRunningTime="2026-06-11 20:04:42.791638293 +0000 UTC m=+645.823354934" Jun 11 20:04:53.772399 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:53.772368 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw" Jun 11 20:04:53.889691 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:53.889654 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw"] Jun 11 20:04:53.889939 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:53.889915 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw" podUID="d5b6a702-8da3-4a40-be8b-fe4ecb172e98" containerName="manager" containerID="cri-o://a73f9d9ba8734d5d1917b08675f4515ae4382290832f52852ae56bf28505ce9d" gracePeriod=10 Jun 11 20:04:54.129193 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:54.129168 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw" Jun 11 20:04:54.231921 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:54.231887 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5b6a702-8da3-4a40-be8b-fe4ecb172e98-extensions-socket-volume\") pod \"d5b6a702-8da3-4a40-be8b-fe4ecb172e98\" (UID: \"d5b6a702-8da3-4a40-be8b-fe4ecb172e98\") " Jun 11 20:04:54.232065 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:54.231940 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twqjk\" (UniqueName: \"kubernetes.io/projected/d5b6a702-8da3-4a40-be8b-fe4ecb172e98-kube-api-access-twqjk\") pod \"d5b6a702-8da3-4a40-be8b-fe4ecb172e98\" (UID: \"d5b6a702-8da3-4a40-be8b-fe4ecb172e98\") " Jun 11 20:04:54.232375 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:54.232348 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5b6a702-8da3-4a40-be8b-fe4ecb172e98-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d5b6a702-8da3-4a40-be8b-fe4ecb172e98" (UID: "d5b6a702-8da3-4a40-be8b-fe4ecb172e98"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:04:54.234279 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:54.234260 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5b6a702-8da3-4a40-be8b-fe4ecb172e98-kube-api-access-twqjk" (OuterVolumeSpecName: "kube-api-access-twqjk") pod "d5b6a702-8da3-4a40-be8b-fe4ecb172e98" (UID: "d5b6a702-8da3-4a40-be8b-fe4ecb172e98"). InnerVolumeSpecName "kube-api-access-twqjk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:04:54.332827 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:54.332799 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5b6a702-8da3-4a40-be8b-fe4ecb172e98-extensions-socket-volume\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:04:54.332827 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:54.332823 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twqjk\" (UniqueName: \"kubernetes.io/projected/d5b6a702-8da3-4a40-be8b-fe4ecb172e98-kube-api-access-twqjk\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:04:54.817855 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:54.817816 2564 generic.go:356] "Generic (PLEG): container finished" podID="d5b6a702-8da3-4a40-be8b-fe4ecb172e98" containerID="a73f9d9ba8734d5d1917b08675f4515ae4382290832f52852ae56bf28505ce9d" exitCode=0 Jun 11 20:04:54.818234 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:54.817865 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw" Jun 11 20:04:54.818234 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:54.817894 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw" event={"ID":"d5b6a702-8da3-4a40-be8b-fe4ecb172e98","Type":"ContainerDied","Data":"a73f9d9ba8734d5d1917b08675f4515ae4382290832f52852ae56bf28505ce9d"} Jun 11 20:04:54.818234 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:54.817943 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw" event={"ID":"d5b6a702-8da3-4a40-be8b-fe4ecb172e98","Type":"ContainerDied","Data":"a5ad6a86d85bb263bb6777ef57e943b131b14759113d2dd579e17019d591deb8"} Jun 11 20:04:54.818234 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:54.817964 2564 scope.go:117] "RemoveContainer" containerID="a73f9d9ba8734d5d1917b08675f4515ae4382290832f52852ae56bf28505ce9d" Jun 11 20:04:54.826629 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:54.826612 2564 scope.go:117] "RemoveContainer" containerID="a73f9d9ba8734d5d1917b08675f4515ae4382290832f52852ae56bf28505ce9d" Jun 11 20:04:54.826931 ip-10-0-142-46 kubenswrapper[2564]: E0611 20:04:54.826916 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a73f9d9ba8734d5d1917b08675f4515ae4382290832f52852ae56bf28505ce9d\": container with ID starting with a73f9d9ba8734d5d1917b08675f4515ae4382290832f52852ae56bf28505ce9d not found: ID does not exist" containerID="a73f9d9ba8734d5d1917b08675f4515ae4382290832f52852ae56bf28505ce9d" Jun 11 20:04:54.826977 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:54.826941 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a73f9d9ba8734d5d1917b08675f4515ae4382290832f52852ae56bf28505ce9d"} err="failed to get container status \"a73f9d9ba8734d5d1917b08675f4515ae4382290832f52852ae56bf28505ce9d\": rpc error: code = NotFound desc = could not find container \"a73f9d9ba8734d5d1917b08675f4515ae4382290832f52852ae56bf28505ce9d\": container with ID starting with a73f9d9ba8734d5d1917b08675f4515ae4382290832f52852ae56bf28505ce9d not found: ID does not exist" Jun 11 20:04:54.840336 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:54.840304 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw"] Jun 11 20:04:54.845191 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:54.845170 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7rcnw"] Jun 11 20:04:55.347525 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:04:55.347494 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5b6a702-8da3-4a40-be8b-fe4ecb172e98" path="/var/lib/kubelet/pods/d5b6a702-8da3-4a40-be8b-fe4ecb172e98/volumes" Jun 11 20:05:21.058718 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.058688 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nflrp"] Jun 11 20:05:21.059183 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.059025 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5b6a702-8da3-4a40-be8b-fe4ecb172e98" containerName="manager" Jun 11 20:05:21.059183 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.059038 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5b6a702-8da3-4a40-be8b-fe4ecb172e98" containerName="manager" Jun 11 20:05:21.059183 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.059101 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5b6a702-8da3-4a40-be8b-fe4ecb172e98" containerName="manager" Jun 11 20:05:21.064289 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.064273 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nflrp" Jun 11 20:05:21.067045 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.067027 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 20:05:21.067104 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.067068 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8284c\"" Jun 11 20:05:21.072033 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.072010 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nflrp"] Jun 11 20:05:21.155432 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.155406 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f13c4322-73ee-47e2-9f47-f291893739d9-config-file\") pod \"limitador-limitador-64c94fd64f-nflrp\" (UID: \"f13c4322-73ee-47e2-9f47-f291893739d9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nflrp" Jun 11 20:05:21.155432 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.155435 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66ppb\" (UniqueName: \"kubernetes.io/projected/f13c4322-73ee-47e2-9f47-f291893739d9-kube-api-access-66ppb\") pod \"limitador-limitador-64c94fd64f-nflrp\" (UID: \"f13c4322-73ee-47e2-9f47-f291893739d9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nflrp" Jun 11 20:05:21.155828 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.155808 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nflrp"] Jun 11 20:05:21.256004 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.255971 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f13c4322-73ee-47e2-9f47-f291893739d9-config-file\") pod \"limitador-limitador-64c94fd64f-nflrp\" (UID: \"f13c4322-73ee-47e2-9f47-f291893739d9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nflrp" Jun 11 20:05:21.256150 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.256007 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66ppb\" (UniqueName: \"kubernetes.io/projected/f13c4322-73ee-47e2-9f47-f291893739d9-kube-api-access-66ppb\") pod \"limitador-limitador-64c94fd64f-nflrp\" (UID: \"f13c4322-73ee-47e2-9f47-f291893739d9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nflrp" Jun 11 20:05:21.256640 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.256622 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f13c4322-73ee-47e2-9f47-f291893739d9-config-file\") pod \"limitador-limitador-64c94fd64f-nflrp\" (UID: \"f13c4322-73ee-47e2-9f47-f291893739d9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nflrp" Jun 11 20:05:21.264821 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.264773 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66ppb\" (UniqueName: \"kubernetes.io/projected/f13c4322-73ee-47e2-9f47-f291893739d9-kube-api-access-66ppb\") pod \"limitador-limitador-64c94fd64f-nflrp\" (UID: \"f13c4322-73ee-47e2-9f47-f291893739d9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nflrp" Jun 11 20:05:21.375057 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.375030 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nflrp" Jun 11 20:05:21.502694 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.502664 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nflrp"] Jun 11 20:05:21.505521 ip-10-0-142-46 kubenswrapper[2564]: W0611 20:05:21.505495 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13c4322_73ee_47e2_9f47_f291893739d9.slice/crio-042cdbffd1fd48a17d707415b2a312479754517086377b206e39180e592ffc45 WatchSource:0}: Error finding container 042cdbffd1fd48a17d707415b2a312479754517086377b206e39180e592ffc45: Status 404 returned error can't find the container with id 042cdbffd1fd48a17d707415b2a312479754517086377b206e39180e592ffc45 Jun 11 20:05:21.850138 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.850107 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-6nvhf"] Jun 11 20:05:21.854334 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.854311 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6nvhf" Jun 11 20:05:21.856901 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.856881 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-q26nj\"" Jun 11 20:05:21.861421 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.861227 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6nvhf"] Jun 11 20:05:21.934216 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.934190 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nflrp" event={"ID":"f13c4322-73ee-47e2-9f47-f291893739d9","Type":"ContainerStarted","Data":"042cdbffd1fd48a17d707415b2a312479754517086377b206e39180e592ffc45"} Jun 11 20:05:21.962524 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:21.962499 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntdcs\" (UniqueName: \"kubernetes.io/projected/2184ee04-8ade-45c4-b914-97abf3d04ced-kube-api-access-ntdcs\") pod \"authorino-58cd955675-6nvhf\" (UID: \"2184ee04-8ade-45c4-b914-97abf3d04ced\") " pod="kuadrant-system/authorino-58cd955675-6nvhf" Jun 11 20:05:22.063107 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:22.063074 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntdcs\" (UniqueName: \"kubernetes.io/projected/2184ee04-8ade-45c4-b914-97abf3d04ced-kube-api-access-ntdcs\") pod \"authorino-58cd955675-6nvhf\" (UID: \"2184ee04-8ade-45c4-b914-97abf3d04ced\") " pod="kuadrant-system/authorino-58cd955675-6nvhf" Jun 11 20:05:22.071564 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:22.071525 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntdcs\" (UniqueName: \"kubernetes.io/projected/2184ee04-8ade-45c4-b914-97abf3d04ced-kube-api-access-ntdcs\") pod \"authorino-58cd955675-6nvhf\" (UID: \"2184ee04-8ade-45c4-b914-97abf3d04ced\") " pod="kuadrant-system/authorino-58cd955675-6nvhf" Jun 11 20:05:22.163990 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:22.163682 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6nvhf" Jun 11 20:05:22.327421 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:22.327382 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6nvhf"] Jun 11 20:05:22.330817 ip-10-0-142-46 kubenswrapper[2564]: W0611 20:05:22.330770 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2184ee04_8ade_45c4_b914_97abf3d04ced.slice/crio-2cc1b0a24c4d5f1fd21f3913309abd48e45b889b860bbd0ac3ecb339b486797d WatchSource:0}: Error finding container 2cc1b0a24c4d5f1fd21f3913309abd48e45b889b860bbd0ac3ecb339b486797d: Status 404 returned error can't find the container with id 2cc1b0a24c4d5f1fd21f3913309abd48e45b889b860bbd0ac3ecb339b486797d Jun 11 20:05:22.940483 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:22.940449 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6nvhf" event={"ID":"2184ee04-8ade-45c4-b914-97abf3d04ced","Type":"ContainerStarted","Data":"2cc1b0a24c4d5f1fd21f3913309abd48e45b889b860bbd0ac3ecb339b486797d"} Jun 11 20:05:26.962165 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:26.962122 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6nvhf" event={"ID":"2184ee04-8ade-45c4-b914-97abf3d04ced","Type":"ContainerStarted","Data":"b7fc2d78ddc938f336069087f176b13250682fd3eddee349f9ac7864c2f5e8c1"} Jun 11 20:05:26.963580 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:26.963554 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nflrp" event={"ID":"f13c4322-73ee-47e2-9f47-f291893739d9","Type":"ContainerStarted","Data":"2f473499669f4f9d01a524a82739e6e1396603433b36c79d6fde0906e747c7b2"} Jun 11 20:05:26.963697 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:26.963684 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-nflrp" Jun 11 20:05:26.976210 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:26.976167 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-6nvhf" podStartSLOduration=2.2844165690000002 podStartE2EDuration="5.976155093s" totalImagesPullingTime="3.691738524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:05:26.975150476 +0000 UTC m=+690.006867116" watchObservedRunningTime="2026-06-11 20:05:26.976155093 +0000 UTC m=+690.007871754" Jun 11 20:05:26.992431 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:26.992385 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-nflrp" podStartSLOduration=1.531874585 podStartE2EDuration="5.992371989s" totalImagesPullingTime="4.460497404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:05:26.991134589 +0000 UTC m=+690.022851230" watchObservedRunningTime="2026-06-11 20:05:26.992371989 +0000 UTC m=+690.024088628" Jun 11 20:05:27.721803 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:27.721761 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6nvhf"] Jun 11 20:05:28.972676 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:28.972627 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-6nvhf" podUID="2184ee04-8ade-45c4-b914-97abf3d04ced" containerName="authorino" containerID="cri-o://b7fc2d78ddc938f336069087f176b13250682fd3eddee349f9ac7864c2f5e8c1" gracePeriod=30 Jun 11 20:05:29.221403 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:29.221379 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6nvhf" Jun 11 20:05:29.340430 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:29.335243 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntdcs\" (UniqueName: \"kubernetes.io/projected/2184ee04-8ade-45c4-b914-97abf3d04ced-kube-api-access-ntdcs\") pod \"2184ee04-8ade-45c4-b914-97abf3d04ced\" (UID: \"2184ee04-8ade-45c4-b914-97abf3d04ced\") " Jun 11 20:05:29.341110 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:29.341082 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2184ee04-8ade-45c4-b914-97abf3d04ced-kube-api-access-ntdcs" (OuterVolumeSpecName: "kube-api-access-ntdcs") pod "2184ee04-8ade-45c4-b914-97abf3d04ced" (UID: "2184ee04-8ade-45c4-b914-97abf3d04ced"). InnerVolumeSpecName "kube-api-access-ntdcs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:05:29.436875 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:29.436836 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntdcs\" (UniqueName: \"kubernetes.io/projected/2184ee04-8ade-45c4-b914-97abf3d04ced-kube-api-access-ntdcs\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:05:29.978497 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:29.978458 2564 generic.go:356] "Generic (PLEG): container finished" podID="2184ee04-8ade-45c4-b914-97abf3d04ced" containerID="b7fc2d78ddc938f336069087f176b13250682fd3eddee349f9ac7864c2f5e8c1" exitCode=0 Jun 11 20:05:29.978997 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:29.978516 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6nvhf" Jun 11 20:05:29.978997 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:29.978545 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6nvhf" event={"ID":"2184ee04-8ade-45c4-b914-97abf3d04ced","Type":"ContainerDied","Data":"b7fc2d78ddc938f336069087f176b13250682fd3eddee349f9ac7864c2f5e8c1"} Jun 11 20:05:29.978997 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:29.978591 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6nvhf" event={"ID":"2184ee04-8ade-45c4-b914-97abf3d04ced","Type":"ContainerDied","Data":"2cc1b0a24c4d5f1fd21f3913309abd48e45b889b860bbd0ac3ecb339b486797d"} Jun 11 20:05:29.978997 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:29.978613 2564 scope.go:117] "RemoveContainer" containerID="b7fc2d78ddc938f336069087f176b13250682fd3eddee349f9ac7864c2f5e8c1" Jun 11 20:05:29.986627 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:29.986609 2564 scope.go:117] "RemoveContainer" containerID="b7fc2d78ddc938f336069087f176b13250682fd3eddee349f9ac7864c2f5e8c1" Jun 11 20:05:29.986900 ip-10-0-142-46 kubenswrapper[2564]: E0611 20:05:29.986881 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7fc2d78ddc938f336069087f176b13250682fd3eddee349f9ac7864c2f5e8c1\": container with ID starting with b7fc2d78ddc938f336069087f176b13250682fd3eddee349f9ac7864c2f5e8c1 not found: ID does not exist" containerID="b7fc2d78ddc938f336069087f176b13250682fd3eddee349f9ac7864c2f5e8c1" Jun 11 20:05:29.986951 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:29.986908 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7fc2d78ddc938f336069087f176b13250682fd3eddee349f9ac7864c2f5e8c1"} err="failed to get container status \"b7fc2d78ddc938f336069087f176b13250682fd3eddee349f9ac7864c2f5e8c1\": rpc error: code = NotFound desc = could not find container \"b7fc2d78ddc938f336069087f176b13250682fd3eddee349f9ac7864c2f5e8c1\": container with ID starting with b7fc2d78ddc938f336069087f176b13250682fd3eddee349f9ac7864c2f5e8c1 not found: ID does not exist" Jun 11 20:05:29.995300 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:29.995277 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6nvhf"] Jun 11 20:05:29.997120 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:29.997100 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-6nvhf"] Jun 11 20:05:31.348306 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:31.348270 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2184ee04-8ade-45c4-b914-97abf3d04ced" path="/var/lib/kubelet/pods/2184ee04-8ade-45c4-b914-97abf3d04ced/volumes" Jun 11 20:05:37.969191 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:37.969118 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-nflrp" Jun 11 20:05:38.716383 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:38.716340 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nflrp"] Jun 11 20:05:38.716617 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:38.716576 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-nflrp" podUID="f13c4322-73ee-47e2-9f47-f291893739d9" containerName="limitador" containerID="cri-o://2f473499669f4f9d01a524a82739e6e1396603433b36c79d6fde0906e747c7b2" gracePeriod=30 Jun 11 20:05:39.664462 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:39.664438 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nflrp" Jun 11 20:05:39.728148 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:39.728121 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66ppb\" (UniqueName: \"kubernetes.io/projected/f13c4322-73ee-47e2-9f47-f291893739d9-kube-api-access-66ppb\") pod \"f13c4322-73ee-47e2-9f47-f291893739d9\" (UID: \"f13c4322-73ee-47e2-9f47-f291893739d9\") " Jun 11 20:05:39.728300 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:39.728171 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f13c4322-73ee-47e2-9f47-f291893739d9-config-file\") pod \"f13c4322-73ee-47e2-9f47-f291893739d9\" (UID: \"f13c4322-73ee-47e2-9f47-f291893739d9\") " Jun 11 20:05:39.728550 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:39.728530 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f13c4322-73ee-47e2-9f47-f291893739d9-config-file" (OuterVolumeSpecName: "config-file") pod "f13c4322-73ee-47e2-9f47-f291893739d9" (UID: "f13c4322-73ee-47e2-9f47-f291893739d9"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:05:39.730299 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:39.730278 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f13c4322-73ee-47e2-9f47-f291893739d9-kube-api-access-66ppb" (OuterVolumeSpecName: "kube-api-access-66ppb") pod "f13c4322-73ee-47e2-9f47-f291893739d9" (UID: "f13c4322-73ee-47e2-9f47-f291893739d9"). InnerVolumeSpecName "kube-api-access-66ppb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:05:39.829332 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:39.829302 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66ppb\" (UniqueName: \"kubernetes.io/projected/f13c4322-73ee-47e2-9f47-f291893739d9-kube-api-access-66ppb\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:05:39.829332 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:39.829328 2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f13c4322-73ee-47e2-9f47-f291893739d9-config-file\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:05:40.022308 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:40.022274 2564 generic.go:356] "Generic (PLEG): container finished" podID="f13c4322-73ee-47e2-9f47-f291893739d9" containerID="2f473499669f4f9d01a524a82739e6e1396603433b36c79d6fde0906e747c7b2" exitCode=0 Jun 11 20:05:40.022308 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:40.022311 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nflrp" event={"ID":"f13c4322-73ee-47e2-9f47-f291893739d9","Type":"ContainerDied","Data":"2f473499669f4f9d01a524a82739e6e1396603433b36c79d6fde0906e747c7b2"} Jun 11 20:05:40.022546 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:40.022326 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nflrp" Jun 11 20:05:40.022546 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:40.022348 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nflrp" event={"ID":"f13c4322-73ee-47e2-9f47-f291893739d9","Type":"ContainerDied","Data":"042cdbffd1fd48a17d707415b2a312479754517086377b206e39180e592ffc45"} Jun 11 20:05:40.022546 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:40.022368 2564 scope.go:117] "RemoveContainer" containerID="2f473499669f4f9d01a524a82739e6e1396603433b36c79d6fde0906e747c7b2" Jun 11 20:05:40.030883 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:40.030864 2564 scope.go:117] "RemoveContainer" containerID="2f473499669f4f9d01a524a82739e6e1396603433b36c79d6fde0906e747c7b2" Jun 11 20:05:40.031123 ip-10-0-142-46 kubenswrapper[2564]: E0611 20:05:40.031104 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f473499669f4f9d01a524a82739e6e1396603433b36c79d6fde0906e747c7b2\": container with ID starting with 2f473499669f4f9d01a524a82739e6e1396603433b36c79d6fde0906e747c7b2 not found: ID does not exist" containerID="2f473499669f4f9d01a524a82739e6e1396603433b36c79d6fde0906e747c7b2" Jun 11 20:05:40.031180 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:40.031132 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f473499669f4f9d01a524a82739e6e1396603433b36c79d6fde0906e747c7b2"} err="failed to get container status \"2f473499669f4f9d01a524a82739e6e1396603433b36c79d6fde0906e747c7b2\": rpc error: code = NotFound desc = could not find container \"2f473499669f4f9d01a524a82739e6e1396603433b36c79d6fde0906e747c7b2\": container with ID starting with 2f473499669f4f9d01a524a82739e6e1396603433b36c79d6fde0906e747c7b2 not found: ID does not exist" Jun 11 20:05:40.044035 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:40.044012 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nflrp"] Jun 11 20:05:40.048659 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:40.048637 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nflrp"] Jun 11 20:05:41.348079 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:41.348046 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f13c4322-73ee-47e2-9f47-f291893739d9" path="/var/lib/kubelet/pods/f13c4322-73ee-47e2-9f47-f291893739d9/volumes" Jun 11 20:05:44.315512 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:44.315480 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-c8qfp"] Jun 11 20:05:44.315875 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:44.315843 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f13c4322-73ee-47e2-9f47-f291893739d9" containerName="limitador" Jun 11 20:05:44.315875 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:44.315856 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f13c4322-73ee-47e2-9f47-f291893739d9" containerName="limitador" Jun 11 20:05:44.315875 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:44.315865 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2184ee04-8ade-45c4-b914-97abf3d04ced" containerName="authorino" Jun 11 20:05:44.315875 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:44.315870 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2184ee04-8ade-45c4-b914-97abf3d04ced" containerName="authorino" Jun 11 20:05:44.316003 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:44.315953 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2184ee04-8ade-45c4-b914-97abf3d04ced" containerName="authorino" Jun 11 20:05:44.316003 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:44.315962 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f13c4322-73ee-47e2-9f47-f291893739d9" containerName="limitador" Jun 11 20:05:44.320459 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:44.320440 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-c8qfp" Jun 11 20:05:44.322950 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:44.322927 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7c9zv\"" Jun 11 20:05:44.323061 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:44.322961 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 11 20:05:44.325808 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:44.325764 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-c8qfp"] Jun 11 20:05:44.369394 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:44.369373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0ba91a82-9684-4656-b19d-86e792fa64f5-data\") pod \"postgres-69fb4594cf-c8qfp\" (UID: \"0ba91a82-9684-4656-b19d-86e792fa64f5\") " pod="opendatahub/postgres-69fb4594cf-c8qfp" Jun 11 20:05:44.369515 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:44.369495 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gt5b\" (UniqueName: \"kubernetes.io/projected/0ba91a82-9684-4656-b19d-86e792fa64f5-kube-api-access-9gt5b\") pod \"postgres-69fb4594cf-c8qfp\" (UID: \"0ba91a82-9684-4656-b19d-86e792fa64f5\") " pod="opendatahub/postgres-69fb4594cf-c8qfp" Jun 11 20:05:44.470599 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:44.470570 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0ba91a82-9684-4656-b19d-86e792fa64f5-data\") pod \"postgres-69fb4594cf-c8qfp\" (UID: \"0ba91a82-9684-4656-b19d-86e792fa64f5\") " pod="opendatahub/postgres-69fb4594cf-c8qfp" Jun 11 20:05:44.470734 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:44.470671 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gt5b\" (UniqueName: \"kubernetes.io/projected/0ba91a82-9684-4656-b19d-86e792fa64f5-kube-api-access-9gt5b\") pod \"postgres-69fb4594cf-c8qfp\" (UID: \"0ba91a82-9684-4656-b19d-86e792fa64f5\") " pod="opendatahub/postgres-69fb4594cf-c8qfp" Jun 11 20:05:44.471073 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:44.471057 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0ba91a82-9684-4656-b19d-86e792fa64f5-data\") pod \"postgres-69fb4594cf-c8qfp\" (UID: \"0ba91a82-9684-4656-b19d-86e792fa64f5\") " pod="opendatahub/postgres-69fb4594cf-c8qfp" Jun 11 20:05:44.478759 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:44.478734 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gt5b\" (UniqueName: \"kubernetes.io/projected/0ba91a82-9684-4656-b19d-86e792fa64f5-kube-api-access-9gt5b\") pod \"postgres-69fb4594cf-c8qfp\" (UID: \"0ba91a82-9684-4656-b19d-86e792fa64f5\") " pod="opendatahub/postgres-69fb4594cf-c8qfp" Jun 11 20:05:44.632723 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:44.632632 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-c8qfp" Jun 11 20:05:44.755284 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:44.755215 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-c8qfp"] Jun 11 20:05:44.757665 ip-10-0-142-46 kubenswrapper[2564]: W0611 20:05:44.757639 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba91a82_9684_4656_b19d_86e792fa64f5.slice/crio-b96a31db9ff1681a0db8603f73935774cdb37c94ea5059df805ba8331e82473e WatchSource:0}: Error finding container b96a31db9ff1681a0db8603f73935774cdb37c94ea5059df805ba8331e82473e: Status 404 returned error can't find the container with id b96a31db9ff1681a0db8603f73935774cdb37c94ea5059df805ba8331e82473e Jun 11 20:05:45.045933 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:45.045850 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-c8qfp" event={"ID":"0ba91a82-9684-4656-b19d-86e792fa64f5","Type":"ContainerStarted","Data":"b96a31db9ff1681a0db8603f73935774cdb37c94ea5059df805ba8331e82473e"} Jun 11 20:05:48.062475 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:48.062386 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-c8qfp" event={"ID":"0ba91a82-9684-4656-b19d-86e792fa64f5","Type":"ContainerStarted","Data":"62b31d1b5296ea2f30774ab52e22031f18515f7e2ee2cc1f9ae6806827693761"} Jun 11 20:05:48.062921 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:48.062516 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-c8qfp" Jun 11 20:05:48.078992 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:48.078941 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-c8qfp" podStartSLOduration=1.118010686 podStartE2EDuration="4.078927596s" totalImagesPullingTime="2.96091691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:05:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:05:48.076905971 +0000 UTC m=+711.108622610" watchObservedRunningTime="2026-06-11 20:05:48.078927596 +0000 UTC m=+711.110644236" Jun 11 20:05:54.102628 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:05:54.102597 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-c8qfp" Jun 11 20:06:08.878114 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:08.878073 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-4896x"] Jun 11 20:06:08.893599 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:08.893566 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-4896x"] Jun 11 20:06:08.893754 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:08.893659 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-4896x" Jun 11 20:06:08.896264 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:08.896237 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 20:06:08.896397 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:08.896352 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 20:06:08.896397 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:08.896355 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-dgkb6\"" Jun 11 20:06:08.978922 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:08.978897 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n67x\" (UniqueName: \"kubernetes.io/projected/8d558360-d518-4870-b533-05876973b2d6-kube-api-access-7n67x\") pod \"keycloak-operator-d67dbbb48-4896x\" (UID: \"8d558360-d518-4870-b533-05876973b2d6\") " pod="keycloak-system/keycloak-operator-d67dbbb48-4896x" Jun 11 20:06:09.079568 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:09.079542 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n67x\" (UniqueName: \"kubernetes.io/projected/8d558360-d518-4870-b533-05876973b2d6-kube-api-access-7n67x\") pod \"keycloak-operator-d67dbbb48-4896x\" (UID: \"8d558360-d518-4870-b533-05876973b2d6\") " pod="keycloak-system/keycloak-operator-d67dbbb48-4896x" Jun 11 20:06:09.088173 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:09.088149 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n67x\" (UniqueName: \"kubernetes.io/projected/8d558360-d518-4870-b533-05876973b2d6-kube-api-access-7n67x\") pod \"keycloak-operator-d67dbbb48-4896x\" (UID: \"8d558360-d518-4870-b533-05876973b2d6\") " pod="keycloak-system/keycloak-operator-d67dbbb48-4896x" Jun 11 20:06:09.206429 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:09.206353 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-4896x" Jun 11 20:06:09.335422 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:09.335391 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-4896x"] Jun 11 20:06:09.338393 ip-10-0-142-46 kubenswrapper[2564]: W0611 20:06:09.338363 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d558360_d518_4870_b533_05876973b2d6.slice/crio-6eb0a543983c7573794a922712b72496dd0e9a1f5ecf11e8359193cc144b87a8 WatchSource:0}: Error finding container 6eb0a543983c7573794a922712b72496dd0e9a1f5ecf11e8359193cc144b87a8: Status 404 returned error can't find the container with id 6eb0a543983c7573794a922712b72496dd0e9a1f5ecf11e8359193cc144b87a8 Jun 11 20:06:10.159748 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:10.159707 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-4896x" event={"ID":"8d558360-d518-4870-b533-05876973b2d6","Type":"ContainerStarted","Data":"6eb0a543983c7573794a922712b72496dd0e9a1f5ecf11e8359193cc144b87a8"} Jun 11 20:06:16.189721 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:16.189679 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-4896x" event={"ID":"8d558360-d518-4870-b533-05876973b2d6","Type":"ContainerStarted","Data":"ae33d04417fe60f8694c272c6266eeaf1ae2aa5bdee5345998bc54379bf60afb"} Jun 11 20:06:16.205867 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:16.205822 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-4896x" podStartSLOduration=1.8874904639999999 podStartE2EDuration="8.205808297s" totalImagesPullingTime="6.318317833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:06:16.20473276 +0000 UTC m=+739.236449400" watchObservedRunningTime="2026-06-11 20:06:16.205808297 +0000 UTC m=+739.237524930" Jun 11 20:06:55.090755 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:55.090721 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rgx6d"] Jun 11 20:06:55.099313 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:55.099285 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rgx6d" Jun 11 20:06:55.102134 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:55.102029 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-q26nj\"" Jun 11 20:06:55.103895 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:55.103872 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rgx6d"] Jun 11 20:06:55.182537 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:55.182495 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kzn2\" (UniqueName: \"kubernetes.io/projected/db02c692-3765-42f6-a005-0de6fa7f5003-kube-api-access-9kzn2\") pod \"authorino-5d4b67c446-rgx6d\" (UID: \"db02c692-3765-42f6-a005-0de6fa7f5003\") " pod="kuadrant-system/authorino-5d4b67c446-rgx6d" Jun 11 20:06:55.283435 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:55.283394 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kzn2\" (UniqueName: \"kubernetes.io/projected/db02c692-3765-42f6-a005-0de6fa7f5003-kube-api-access-9kzn2\") pod \"authorino-5d4b67c446-rgx6d\" (UID: \"db02c692-3765-42f6-a005-0de6fa7f5003\") " pod="kuadrant-system/authorino-5d4b67c446-rgx6d" Jun 11 20:06:55.296591 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:55.296561 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kzn2\" (UniqueName: \"kubernetes.io/projected/db02c692-3765-42f6-a005-0de6fa7f5003-kube-api-access-9kzn2\") pod \"authorino-5d4b67c446-rgx6d\" (UID: \"db02c692-3765-42f6-a005-0de6fa7f5003\") " pod="kuadrant-system/authorino-5d4b67c446-rgx6d" Jun 11 20:06:55.305121 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:55.305097 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rgx6d"] Jun 11 20:06:55.305334 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:55.305323 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rgx6d" Jun 11 20:06:55.332890 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:55.332862 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-55b7498bdc-hwn4p"] Jun 11 20:06:55.336381 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:55.336364 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55b7498bdc-hwn4p" Jun 11 20:06:55.349208 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:55.349183 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55b7498bdc-hwn4p"] Jun 11 20:06:55.444635 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:55.444611 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rgx6d"] Jun 11 20:06:55.447206 ip-10-0-142-46 kubenswrapper[2564]: W0611 20:06:55.447176 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb02c692_3765_42f6_a005_0de6fa7f5003.slice/crio-ac4c386f4737973af3067fe4cbcdc22d455b8406e11923fb1f86142dbdc9ef77 WatchSource:0}: Error finding container ac4c386f4737973af3067fe4cbcdc22d455b8406e11923fb1f86142dbdc9ef77: Status 404 returned error can't find the container with id ac4c386f4737973af3067fe4cbcdc22d455b8406e11923fb1f86142dbdc9ef77 Jun 11 20:06:55.449412 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:55.449391 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-55b7498bdc-hwn4p"] Jun 11 20:06:55.449723 ip-10-0-142-46 kubenswrapper[2564]: E0611 20:06:55.449699 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lspkl], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-55b7498bdc-hwn4p" podUID="a893f1c0-556a-41aa-b921-4f159e8fea94" Jun 11 20:06:55.484594 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:55.484570 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lspkl\" (UniqueName: \"kubernetes.io/projected/a893f1c0-556a-41aa-b921-4f159e8fea94-kube-api-access-lspkl\") pod \"authorino-55b7498bdc-hwn4p\" (UID: \"a893f1c0-556a-41aa-b921-4f159e8fea94\") " pod="kuadrant-system/authorino-55b7498bdc-hwn4p" Jun 11 20:06:55.585152 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:55.585108 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lspkl\" (UniqueName: \"kubernetes.io/projected/a893f1c0-556a-41aa-b921-4f159e8fea94-kube-api-access-lspkl\") pod \"authorino-55b7498bdc-hwn4p\" (UID: \"a893f1c0-556a-41aa-b921-4f159e8fea94\") " pod="kuadrant-system/authorino-55b7498bdc-hwn4p" Jun 11 20:06:55.592986 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:55.592963 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lspkl\" (UniqueName: \"kubernetes.io/projected/a893f1c0-556a-41aa-b921-4f159e8fea94-kube-api-access-lspkl\") pod \"authorino-55b7498bdc-hwn4p\" (UID: \"a893f1c0-556a-41aa-b921-4f159e8fea94\") " pod="kuadrant-system/authorino-55b7498bdc-hwn4p" Jun 11 20:06:56.365422 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:56.365381 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rgx6d" event={"ID":"db02c692-3765-42f6-a005-0de6fa7f5003","Type":"ContainerStarted","Data":"c14a7b01014f48b42757b0ba10fdd841ebeef0cf72d9f1b9af19b972281e605a"} Jun 11 20:06:56.365422 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:56.365413 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-rgx6d" podUID="db02c692-3765-42f6-a005-0de6fa7f5003" containerName="authorino" containerID="cri-o://c14a7b01014f48b42757b0ba10fdd841ebeef0cf72d9f1b9af19b972281e605a" gracePeriod=30 Jun 11 20:06:56.365938 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:56.365434 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55b7498bdc-hwn4p" Jun 11 20:06:56.365938 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:56.365427 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rgx6d" event={"ID":"db02c692-3765-42f6-a005-0de6fa7f5003","Type":"ContainerStarted","Data":"ac4c386f4737973af3067fe4cbcdc22d455b8406e11923fb1f86142dbdc9ef77"} Jun 11 20:06:56.377276 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:56.377253 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55b7498bdc-hwn4p" Jun 11 20:06:56.379871 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:56.379822 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-rgx6d" podStartSLOduration=1.084848997 podStartE2EDuration="1.379805204s" totalImagesPullingTime="294.956207ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:06:56.378639864 +0000 UTC m=+779.410356503" watchObservedRunningTime="2026-06-11 20:06:56.379805204 +0000 UTC m=+779.411521842" Jun 11 20:06:56.491859 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:56.491832 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lspkl\" (UniqueName: \"kubernetes.io/projected/a893f1c0-556a-41aa-b921-4f159e8fea94-kube-api-access-lspkl\") pod \"a893f1c0-556a-41aa-b921-4f159e8fea94\" (UID: \"a893f1c0-556a-41aa-b921-4f159e8fea94\") " Jun 11 20:06:56.493863 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:56.493832 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a893f1c0-556a-41aa-b921-4f159e8fea94-kube-api-access-lspkl" (OuterVolumeSpecName: "kube-api-access-lspkl") pod "a893f1c0-556a-41aa-b921-4f159e8fea94" (UID: "a893f1c0-556a-41aa-b921-4f159e8fea94"). InnerVolumeSpecName "kube-api-access-lspkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:06:56.593460 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:56.593428 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lspkl\" (UniqueName: \"kubernetes.io/projected/a893f1c0-556a-41aa-b921-4f159e8fea94-kube-api-access-lspkl\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:06:56.613086 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:56.613061 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rgx6d" Jun 11 20:06:56.694759 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:56.694666 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kzn2\" (UniqueName: \"kubernetes.io/projected/db02c692-3765-42f6-a005-0de6fa7f5003-kube-api-access-9kzn2\") pod \"db02c692-3765-42f6-a005-0de6fa7f5003\" (UID: \"db02c692-3765-42f6-a005-0de6fa7f5003\") " Jun 11 20:06:56.696917 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:56.696890 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db02c692-3765-42f6-a005-0de6fa7f5003-kube-api-access-9kzn2" (OuterVolumeSpecName: "kube-api-access-9kzn2") pod "db02c692-3765-42f6-a005-0de6fa7f5003" (UID: "db02c692-3765-42f6-a005-0de6fa7f5003"). InnerVolumeSpecName "kube-api-access-9kzn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:06:56.795873 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:56.795836 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kzn2\" (UniqueName: \"kubernetes.io/projected/db02c692-3765-42f6-a005-0de6fa7f5003-kube-api-access-9kzn2\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:06:57.370311 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:57.370281 2564 generic.go:356] "Generic (PLEG): container finished" podID="db02c692-3765-42f6-a005-0de6fa7f5003" containerID="c14a7b01014f48b42757b0ba10fdd841ebeef0cf72d9f1b9af19b972281e605a" exitCode=0 Jun 11 20:06:57.370686 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:57.370318 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rgx6d" Jun 11 20:06:57.370686 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:57.370368 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rgx6d" event={"ID":"db02c692-3765-42f6-a005-0de6fa7f5003","Type":"ContainerDied","Data":"c14a7b01014f48b42757b0ba10fdd841ebeef0cf72d9f1b9af19b972281e605a"} Jun 11 20:06:57.370686 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:57.370406 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rgx6d" event={"ID":"db02c692-3765-42f6-a005-0de6fa7f5003","Type":"ContainerDied","Data":"ac4c386f4737973af3067fe4cbcdc22d455b8406e11923fb1f86142dbdc9ef77"} Jun 11 20:06:57.370686 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:57.370422 2564 scope.go:117] "RemoveContainer" containerID="c14a7b01014f48b42757b0ba10fdd841ebeef0cf72d9f1b9af19b972281e605a" Jun 11 20:06:57.370686 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:57.370433 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55b7498bdc-hwn4p" Jun 11 20:06:57.378606 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:57.378587 2564 scope.go:117] "RemoveContainer" containerID="c14a7b01014f48b42757b0ba10fdd841ebeef0cf72d9f1b9af19b972281e605a" Jun 11 20:06:57.378883 ip-10-0-142-46 kubenswrapper[2564]: E0611 20:06:57.378861 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c14a7b01014f48b42757b0ba10fdd841ebeef0cf72d9f1b9af19b972281e605a\": container with ID starting with c14a7b01014f48b42757b0ba10fdd841ebeef0cf72d9f1b9af19b972281e605a not found: ID does not exist" containerID="c14a7b01014f48b42757b0ba10fdd841ebeef0cf72d9f1b9af19b972281e605a" Jun 11 20:06:57.378959 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:57.378893 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c14a7b01014f48b42757b0ba10fdd841ebeef0cf72d9f1b9af19b972281e605a"} err="failed to get container status \"c14a7b01014f48b42757b0ba10fdd841ebeef0cf72d9f1b9af19b972281e605a\": rpc error: code = NotFound desc = could not find container \"c14a7b01014f48b42757b0ba10fdd841ebeef0cf72d9f1b9af19b972281e605a\": container with ID starting with c14a7b01014f48b42757b0ba10fdd841ebeef0cf72d9f1b9af19b972281e605a not found: ID does not exist" Jun 11 20:06:57.397371 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:57.397344 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-55b7498bdc-hwn4p"] Jun 11 20:06:57.401645 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:57.401620 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-55b7498bdc-hwn4p"] Jun 11 20:06:57.410025 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:57.410003 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rgx6d"] Jun 11 20:06:57.412129 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:57.412109 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rgx6d"] Jun 11 20:06:59.347862 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:59.347831 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a893f1c0-556a-41aa-b921-4f159e8fea94" path="/var/lib/kubelet/pods/a893f1c0-556a-41aa-b921-4f159e8fea94/volumes" Jun 11 20:06:59.348221 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:06:59.348058 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db02c692-3765-42f6-a005-0de6fa7f5003" path="/var/lib/kubelet/pods/db02c692-3765-42f6-a005-0de6fa7f5003/volumes" Jun 11 20:07:35.391428 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:07:35.391397 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-c42vw"] Jun 11 20:07:35.391907 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:07:35.391722 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db02c692-3765-42f6-a005-0de6fa7f5003" containerName="authorino" Jun 11 20:07:35.391907 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:07:35.391733 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="db02c692-3765-42f6-a005-0de6fa7f5003" containerName="authorino" Jun 11 20:07:35.391907 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:07:35.391825 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="db02c692-3765-42f6-a005-0de6fa7f5003" containerName="authorino" Jun 11 20:07:35.394883 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:07:35.394864 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-c42vw" Jun 11 20:07:35.397427 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:07:35.397405 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vmn5x\"" Jun 11 20:07:35.397553 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:07:35.397447 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 20:07:35.404419 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:07:35.404400 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-c42vw"] Jun 11 20:07:35.525912 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:07:35.525880 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2jc7\" (UniqueName: \"kubernetes.io/projected/42c8ac8d-38cc-4551-89bb-62a5a3d6d6fa-kube-api-access-b2jc7\") pod \"payload-pre-processing-579785bc64-c42vw\" (UID: \"42c8ac8d-38cc-4551-89bb-62a5a3d6d6fa\") " pod="openshift-ingress/payload-pre-processing-579785bc64-c42vw" Jun 11 20:07:35.626499 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:07:35.626466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2jc7\" (UniqueName: \"kubernetes.io/projected/42c8ac8d-38cc-4551-89bb-62a5a3d6d6fa-kube-api-access-b2jc7\") pod \"payload-pre-processing-579785bc64-c42vw\" (UID: \"42c8ac8d-38cc-4551-89bb-62a5a3d6d6fa\") " pod="openshift-ingress/payload-pre-processing-579785bc64-c42vw" Jun 11 20:07:35.634818 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:07:35.634774 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2jc7\" (UniqueName: \"kubernetes.io/projected/42c8ac8d-38cc-4551-89bb-62a5a3d6d6fa-kube-api-access-b2jc7\") pod \"payload-pre-processing-579785bc64-c42vw\" (UID: \"42c8ac8d-38cc-4551-89bb-62a5a3d6d6fa\") " pod="openshift-ingress/payload-pre-processing-579785bc64-c42vw" Jun 11 20:07:35.706011 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:07:35.705985 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-c42vw" Jun 11 20:07:35.829671 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:07:35.829650 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-c42vw"] Jun 11 20:07:35.831998 ip-10-0-142-46 kubenswrapper[2564]: W0611 20:07:35.831971 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42c8ac8d_38cc_4551_89bb_62a5a3d6d6fa.slice/crio-197336d75f078768f512a64570bc9ded0715c2b94ef4273f48ed9e20eea0805e WatchSource:0}: Error finding container 197336d75f078768f512a64570bc9ded0715c2b94ef4273f48ed9e20eea0805e: Status 404 returned error can't find the container with id 197336d75f078768f512a64570bc9ded0715c2b94ef4273f48ed9e20eea0805e Jun 11 20:07:35.834207 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:07:35.834189 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 20:07:36.551052 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:07:36.551007 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-c42vw" event={"ID":"42c8ac8d-38cc-4551-89bb-62a5a3d6d6fa","Type":"ContainerStarted","Data":"197336d75f078768f512a64570bc9ded0715c2b94ef4273f48ed9e20eea0805e"} Jun 11 20:07:38.561699 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:07:38.561657 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-c42vw" event={"ID":"42c8ac8d-38cc-4551-89bb-62a5a3d6d6fa","Type":"ContainerStarted","Data":"0eb5a9e5db12f3216db36a5b347ae0918bfec349d9207048eebdf9581b156b41"} Jun 11 20:07:38.562111 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:07:38.561727 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-c42vw" Jun 11 20:07:38.578399 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:07:38.578351 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-c42vw" podStartSLOduration=1.359015999 podStartE2EDuration="3.578336419s" totalImagesPullingTime="2.21932042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:07:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:07:38.5766862 +0000 UTC m=+821.608402842" watchObservedRunningTime="2026-06-11 20:07:38.578336419 +0000 UTC m=+821.610053062" Jun 11 20:07:49.569207 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:07:49.569176 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-c42vw" Jun 11 20:08:23.779641 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:08:23.779608 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68487d4d87-2bz2h"] Jun 11 20:08:23.788170 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:08:23.788150 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68487d4d87-2bz2h" Jun 11 20:08:23.797196 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:08:23.797167 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68487d4d87-2bz2h"] Jun 11 20:08:23.797743 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:08:23.797721 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-q26nj\"" Jun 11 20:08:23.797916 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:08:23.797751 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 20:08:23.798071 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:08:23.797808 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 20:08:23.941322 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:08:23.941292 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lqgn\" (UniqueName: \"kubernetes.io/projected/e3fa6d15-7582-475a-b35f-5950af1f655a-kube-api-access-6lqgn\") pod \"authorino-68487d4d87-2bz2h\" (UID: \"e3fa6d15-7582-475a-b35f-5950af1f655a\") " pod="kuadrant-system/authorino-68487d4d87-2bz2h" Jun 11 20:08:23.941483 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:08:23.941392 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e3fa6d15-7582-475a-b35f-5950af1f655a-tls-cert\") pod \"authorino-68487d4d87-2bz2h\" (UID: \"e3fa6d15-7582-475a-b35f-5950af1f655a\") " pod="kuadrant-system/authorino-68487d4d87-2bz2h" Jun 11 20:08:23.941483 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:08:23.941420 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e3fa6d15-7582-475a-b35f-5950af1f655a-oidc-ca\") pod \"authorino-68487d4d87-2bz2h\" (UID: \"e3fa6d15-7582-475a-b35f-5950af1f655a\") " pod="kuadrant-system/authorino-68487d4d87-2bz2h" Jun 11 20:08:24.042586 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:08:24.042504 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e3fa6d15-7582-475a-b35f-5950af1f655a-tls-cert\") pod \"authorino-68487d4d87-2bz2h\" (UID: \"e3fa6d15-7582-475a-b35f-5950af1f655a\") " pod="kuadrant-system/authorino-68487d4d87-2bz2h" Jun 11 20:08:24.042586 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:08:24.042545 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e3fa6d15-7582-475a-b35f-5950af1f655a-oidc-ca\") pod \"authorino-68487d4d87-2bz2h\" (UID: \"e3fa6d15-7582-475a-b35f-5950af1f655a\") " pod="kuadrant-system/authorino-68487d4d87-2bz2h" Jun 11 20:08:24.042586 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:08:24.042581 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lqgn\" (UniqueName: \"kubernetes.io/projected/e3fa6d15-7582-475a-b35f-5950af1f655a-kube-api-access-6lqgn\") pod \"authorino-68487d4d87-2bz2h\" (UID: \"e3fa6d15-7582-475a-b35f-5950af1f655a\") " pod="kuadrant-system/authorino-68487d4d87-2bz2h" Jun 11 20:08:24.043141 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:08:24.043122 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e3fa6d15-7582-475a-b35f-5950af1f655a-oidc-ca\") pod \"authorino-68487d4d87-2bz2h\" (UID: \"e3fa6d15-7582-475a-b35f-5950af1f655a\") " pod="kuadrant-system/authorino-68487d4d87-2bz2h" Jun 11 20:08:24.045152 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:08:24.045129 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e3fa6d15-7582-475a-b35f-5950af1f655a-tls-cert\") pod \"authorino-68487d4d87-2bz2h\" (UID: \"e3fa6d15-7582-475a-b35f-5950af1f655a\") " pod="kuadrant-system/authorino-68487d4d87-2bz2h" Jun 11 20:08:24.050560 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:08:24.050542 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lqgn\" (UniqueName: \"kubernetes.io/projected/e3fa6d15-7582-475a-b35f-5950af1f655a-kube-api-access-6lqgn\") pod \"authorino-68487d4d87-2bz2h\" (UID: \"e3fa6d15-7582-475a-b35f-5950af1f655a\") " pod="kuadrant-system/authorino-68487d4d87-2bz2h" Jun 11 20:08:24.103692 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:08:24.103664 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68487d4d87-2bz2h" Jun 11 20:08:24.231398 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:08:24.231367 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68487d4d87-2bz2h"] Jun 11 20:08:24.234590 ip-10-0-142-46 kubenswrapper[2564]: W0611 20:08:24.234561 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3fa6d15_7582_475a_b35f_5950af1f655a.slice/crio-809150eb9df2b64984d15214f8e5ada0b7a7d398ec685bedeb592d93e7597530 WatchSource:0}: Error finding container 809150eb9df2b64984d15214f8e5ada0b7a7d398ec685bedeb592d93e7597530: Status 404 returned error can't find the container with id 809150eb9df2b64984d15214f8e5ada0b7a7d398ec685bedeb592d93e7597530 Jun 11 20:08:24.770194 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:08:24.770156 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68487d4d87-2bz2h" event={"ID":"e3fa6d15-7582-475a-b35f-5950af1f655a","Type":"ContainerStarted","Data":"54f5410a38278148b13980c9816dab8db56cdbe85d645902fa68f2091d5aa001"} Jun 11 20:08:24.770401 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:08:24.770209 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68487d4d87-2bz2h" event={"ID":"e3fa6d15-7582-475a-b35f-5950af1f655a","Type":"ContainerStarted","Data":"809150eb9df2b64984d15214f8e5ada0b7a7d398ec685bedeb592d93e7597530"} Jun 11 20:08:24.787779 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:08:24.787734 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68487d4d87-2bz2h" podStartSLOduration=1.334896075 podStartE2EDuration="1.78771871s" totalImagesPullingTime="452.822635ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:08:24.785769652 +0000 UTC m=+867.817486292" watchObservedRunningTime="2026-06-11 20:08:24.78771871 +0000 UTC m=+867.819435350" Jun 11 20:10:11.340890 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:11.340815 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5cd8ccc46b-9r7wt"] Jun 11 20:10:11.344174 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:11.344150 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cd8ccc46b-9r7wt" Jun 11 20:10:11.353828 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:11.353804 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cd8ccc46b-9r7wt"] Jun 11 20:10:11.438246 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:11.438206 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn95c\" (UniqueName: \"kubernetes.io/projected/fc68f42a-338f-4bb5-b64b-2b5dadf85c15-kube-api-access-fn95c\") pod \"authorino-5cd8ccc46b-9r7wt\" (UID: \"fc68f42a-338f-4bb5-b64b-2b5dadf85c15\") " pod="kuadrant-system/authorino-5cd8ccc46b-9r7wt" Jun 11 20:10:11.438409 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:11.438271 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fc68f42a-338f-4bb5-b64b-2b5dadf85c15-tls-cert\") pod \"authorino-5cd8ccc46b-9r7wt\" (UID: \"fc68f42a-338f-4bb5-b64b-2b5dadf85c15\") " pod="kuadrant-system/authorino-5cd8ccc46b-9r7wt" Jun 11 20:10:11.438409 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:11.438362 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fc68f42a-338f-4bb5-b64b-2b5dadf85c15-oidc-ca\") pod \"authorino-5cd8ccc46b-9r7wt\" (UID: \"fc68f42a-338f-4bb5-b64b-2b5dadf85c15\") " pod="kuadrant-system/authorino-5cd8ccc46b-9r7wt" Jun 11 20:10:11.539032 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:11.538997 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn95c\" (UniqueName: \"kubernetes.io/projected/fc68f42a-338f-4bb5-b64b-2b5dadf85c15-kube-api-access-fn95c\") pod \"authorino-5cd8ccc46b-9r7wt\" (UID: \"fc68f42a-338f-4bb5-b64b-2b5dadf85c15\") " pod="kuadrant-system/authorino-5cd8ccc46b-9r7wt" Jun 11 20:10:11.539160 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:11.539047 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fc68f42a-338f-4bb5-b64b-2b5dadf85c15-tls-cert\") pod \"authorino-5cd8ccc46b-9r7wt\" (UID: \"fc68f42a-338f-4bb5-b64b-2b5dadf85c15\") " pod="kuadrant-system/authorino-5cd8ccc46b-9r7wt" Jun 11 20:10:11.539160 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:11.539080 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fc68f42a-338f-4bb5-b64b-2b5dadf85c15-oidc-ca\") pod \"authorino-5cd8ccc46b-9r7wt\" (UID: \"fc68f42a-338f-4bb5-b64b-2b5dadf85c15\") " pod="kuadrant-system/authorino-5cd8ccc46b-9r7wt" Jun 11 20:10:11.539649 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:11.539624 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fc68f42a-338f-4bb5-b64b-2b5dadf85c15-oidc-ca\") pod \"authorino-5cd8ccc46b-9r7wt\" (UID: \"fc68f42a-338f-4bb5-b64b-2b5dadf85c15\") " pod="kuadrant-system/authorino-5cd8ccc46b-9r7wt" Jun 11 20:10:11.541729 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:11.541702 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fc68f42a-338f-4bb5-b64b-2b5dadf85c15-tls-cert\") pod \"authorino-5cd8ccc46b-9r7wt\" (UID: \"fc68f42a-338f-4bb5-b64b-2b5dadf85c15\") " pod="kuadrant-system/authorino-5cd8ccc46b-9r7wt" Jun 11 20:10:11.546359 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:11.546331 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn95c\" (UniqueName: \"kubernetes.io/projected/fc68f42a-338f-4bb5-b64b-2b5dadf85c15-kube-api-access-fn95c\") pod \"authorino-5cd8ccc46b-9r7wt\" (UID: \"fc68f42a-338f-4bb5-b64b-2b5dadf85c15\") " pod="kuadrant-system/authorino-5cd8ccc46b-9r7wt" Jun 11 20:10:11.653365 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:11.653296 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cd8ccc46b-9r7wt" Jun 11 20:10:11.778337 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:11.778306 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cd8ccc46b-9r7wt"] Jun 11 20:10:11.781293 ip-10-0-142-46 kubenswrapper[2564]: W0611 20:10:11.781268 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc68f42a_338f_4bb5_b64b_2b5dadf85c15.slice/crio-cfe566d11adb3d5ddeea3ef053751692da43b749a55950a06e94072af62e7669 WatchSource:0}: Error finding container cfe566d11adb3d5ddeea3ef053751692da43b749a55950a06e94072af62e7669: Status 404 returned error can't find the container with id cfe566d11adb3d5ddeea3ef053751692da43b749a55950a06e94072af62e7669 Jun 11 20:10:12.249900 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:12.249862 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cd8ccc46b-9r7wt" event={"ID":"fc68f42a-338f-4bb5-b64b-2b5dadf85c15","Type":"ContainerStarted","Data":"cfe566d11adb3d5ddeea3ef053751692da43b749a55950a06e94072af62e7669"} Jun 11 20:10:13.257068 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:13.257025 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cd8ccc46b-9r7wt" event={"ID":"fc68f42a-338f-4bb5-b64b-2b5dadf85c15","Type":"ContainerStarted","Data":"dfddc56111d95321e5b02ff673272b752ae01561fb58c94c5b769a23a8ae5bb1"} Jun 11 20:10:13.310696 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:13.310627 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5cd8ccc46b-9r7wt" podStartSLOduration=1.8446767990000001 podStartE2EDuration="2.310605523s" totalImagesPullingTime="465.928724ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:10:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:10:13.300299984 +0000 UTC m=+976.332016624" watchObservedRunningTime="2026-06-11 20:10:13.310605523 +0000 UTC m=+976.342322163" Jun 11 20:10:13.351450 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:13.351417 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68487d4d87-2bz2h"] Jun 11 20:10:13.351641 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:13.351618 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-68487d4d87-2bz2h" podUID="e3fa6d15-7582-475a-b35f-5950af1f655a" containerName="authorino" containerID="cri-o://54f5410a38278148b13980c9816dab8db56cdbe85d645902fa68f2091d5aa001" gracePeriod=30 Jun 11 20:10:13.606391 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:13.606366 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68487d4d87-2bz2h" Jun 11 20:10:13.760520 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:13.760481 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e3fa6d15-7582-475a-b35f-5950af1f655a-tls-cert\") pod \"e3fa6d15-7582-475a-b35f-5950af1f655a\" (UID: \"e3fa6d15-7582-475a-b35f-5950af1f655a\") " Jun 11 20:10:13.760717 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:13.760542 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e3fa6d15-7582-475a-b35f-5950af1f655a-oidc-ca\") pod \"e3fa6d15-7582-475a-b35f-5950af1f655a\" (UID: \"e3fa6d15-7582-475a-b35f-5950af1f655a\") " Jun 11 20:10:13.760717 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:13.760580 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lqgn\" (UniqueName: \"kubernetes.io/projected/e3fa6d15-7582-475a-b35f-5950af1f655a-kube-api-access-6lqgn\") pod \"e3fa6d15-7582-475a-b35f-5950af1f655a\" (UID: \"e3fa6d15-7582-475a-b35f-5950af1f655a\") " Jun 11 20:10:13.762822 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:13.762775 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3fa6d15-7582-475a-b35f-5950af1f655a-kube-api-access-6lqgn" (OuterVolumeSpecName: "kube-api-access-6lqgn") pod "e3fa6d15-7582-475a-b35f-5950af1f655a" (UID: "e3fa6d15-7582-475a-b35f-5950af1f655a"). InnerVolumeSpecName "kube-api-access-6lqgn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:10:13.765517 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:13.765486 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3fa6d15-7582-475a-b35f-5950af1f655a-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "e3fa6d15-7582-475a-b35f-5950af1f655a" (UID: "e3fa6d15-7582-475a-b35f-5950af1f655a"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:10:13.770687 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:13.770635 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3fa6d15-7582-475a-b35f-5950af1f655a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e3fa6d15-7582-475a-b35f-5950af1f655a" (UID: "e3fa6d15-7582-475a-b35f-5950af1f655a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 20:10:13.862213 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:13.862180 2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e3fa6d15-7582-475a-b35f-5950af1f655a-tls-cert\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:10:13.862213 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:13.862210 2564 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e3fa6d15-7582-475a-b35f-5950af1f655a-oidc-ca\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:10:13.862355 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:13.862223 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lqgn\" (UniqueName: \"kubernetes.io/projected/e3fa6d15-7582-475a-b35f-5950af1f655a-kube-api-access-6lqgn\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:10:14.265775 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:14.265740 2564 generic.go:356] "Generic (PLEG): container finished" podID="e3fa6d15-7582-475a-b35f-5950af1f655a" containerID="54f5410a38278148b13980c9816dab8db56cdbe85d645902fa68f2091d5aa001" exitCode=0 Jun 11 20:10:14.266261 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:14.265831 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68487d4d87-2bz2h" Jun 11 20:10:14.266261 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:14.265831 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68487d4d87-2bz2h" event={"ID":"e3fa6d15-7582-475a-b35f-5950af1f655a","Type":"ContainerDied","Data":"54f5410a38278148b13980c9816dab8db56cdbe85d645902fa68f2091d5aa001"} Jun 11 20:10:14.266261 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:14.265976 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68487d4d87-2bz2h" event={"ID":"e3fa6d15-7582-475a-b35f-5950af1f655a","Type":"ContainerDied","Data":"809150eb9df2b64984d15214f8e5ada0b7a7d398ec685bedeb592d93e7597530"} Jun 11 20:10:14.266261 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:14.266003 2564 scope.go:117] "RemoveContainer" containerID="54f5410a38278148b13980c9816dab8db56cdbe85d645902fa68f2091d5aa001" Jun 11 20:10:14.275092 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:14.275075 2564 scope.go:117] "RemoveContainer" containerID="54f5410a38278148b13980c9816dab8db56cdbe85d645902fa68f2091d5aa001" Jun 11 20:10:14.275312 ip-10-0-142-46 kubenswrapper[2564]: E0611 20:10:14.275293 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54f5410a38278148b13980c9816dab8db56cdbe85d645902fa68f2091d5aa001\": container with ID starting with 54f5410a38278148b13980c9816dab8db56cdbe85d645902fa68f2091d5aa001 not found: ID does not exist" containerID="54f5410a38278148b13980c9816dab8db56cdbe85d645902fa68f2091d5aa001" Jun 11 20:10:14.275355 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:14.275321 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54f5410a38278148b13980c9816dab8db56cdbe85d645902fa68f2091d5aa001"} err="failed to get container status \"54f5410a38278148b13980c9816dab8db56cdbe85d645902fa68f2091d5aa001\": rpc error: code = NotFound desc = could not find container \"54f5410a38278148b13980c9816dab8db56cdbe85d645902fa68f2091d5aa001\": container with ID starting with 54f5410a38278148b13980c9816dab8db56cdbe85d645902fa68f2091d5aa001 not found: ID does not exist" Jun 11 20:10:14.286582 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:14.286563 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68487d4d87-2bz2h"] Jun 11 20:10:14.290019 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:14.290001 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-68487d4d87-2bz2h"] Jun 11 20:10:15.349772 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:10:15.349731 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3fa6d15-7582-475a-b35f-5950af1f655a" path="/var/lib/kubelet/pods/e3fa6d15-7582-475a-b35f-5950af1f655a/volumes" Jun 11 20:15:00.145676 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:00.145596 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29686815-grwwc"] Jun 11 20:15:00.148180 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:00.145955 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3fa6d15-7582-475a-b35f-5950af1f655a" containerName="authorino" Jun 11 20:15:00.148180 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:00.145966 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3fa6d15-7582-475a-b35f-5950af1f655a" containerName="authorino" Jun 11 20:15:00.148180 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:00.146040 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3fa6d15-7582-475a-b35f-5950af1f655a" containerName="authorino" Jun 11 20:15:00.149110 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:00.149094 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686815-grwwc" Jun 11 20:15:00.151428 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:00.151411 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9gqk7\"" Jun 11 20:15:00.165246 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:00.165223 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686815-grwwc"] Jun 11 20:15:00.216866 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:00.216837 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpknf\" (UniqueName: \"kubernetes.io/projected/7b07956a-e99a-4361-bfc0-6605f61b5a56-kube-api-access-jpknf\") pod \"maas-api-key-cleanup-29686815-grwwc\" (UID: \"7b07956a-e99a-4361-bfc0-6605f61b5a56\") " pod="opendatahub/maas-api-key-cleanup-29686815-grwwc" Jun 11 20:15:00.317179 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:00.317155 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpknf\" (UniqueName: \"kubernetes.io/projected/7b07956a-e99a-4361-bfc0-6605f61b5a56-kube-api-access-jpknf\") pod \"maas-api-key-cleanup-29686815-grwwc\" (UID: \"7b07956a-e99a-4361-bfc0-6605f61b5a56\") " pod="opendatahub/maas-api-key-cleanup-29686815-grwwc" Jun 11 20:15:00.330457 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:00.330425 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpknf\" (UniqueName: \"kubernetes.io/projected/7b07956a-e99a-4361-bfc0-6605f61b5a56-kube-api-access-jpknf\") pod \"maas-api-key-cleanup-29686815-grwwc\" (UID: \"7b07956a-e99a-4361-bfc0-6605f61b5a56\") " pod="opendatahub/maas-api-key-cleanup-29686815-grwwc" Jun 11 20:15:00.458544 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:00.458474 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686815-grwwc" Jun 11 20:15:00.584169 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:00.584148 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686815-grwwc"] Jun 11 20:15:00.586342 ip-10-0-142-46 kubenswrapper[2564]: W0611 20:15:00.586309 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b07956a_e99a_4361_bfc0_6605f61b5a56.slice/crio-518d2ae0ba8bc125c594e9301b0dee40b1338c5f1e84c8798bc87d35db6f53d3 WatchSource:0}: Error finding container 518d2ae0ba8bc125c594e9301b0dee40b1338c5f1e84c8798bc87d35db6f53d3: Status 404 returned error can't find the container with id 518d2ae0ba8bc125c594e9301b0dee40b1338c5f1e84c8798bc87d35db6f53d3 Jun 11 20:15:00.588161 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:00.588140 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 20:15:01.549104 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:01.549069 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686815-grwwc" event={"ID":"7b07956a-e99a-4361-bfc0-6605f61b5a56","Type":"ContainerStarted","Data":"518d2ae0ba8bc125c594e9301b0dee40b1338c5f1e84c8798bc87d35db6f53d3"} Jun 11 20:15:04.565060 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:04.565010 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686815-grwwc" event={"ID":"7b07956a-e99a-4361-bfc0-6605f61b5a56","Type":"ContainerStarted","Data":"a5bbbaff0eac7f0677e04e3646d844096ababc7801ebce3bc846cb5680b3830f"} Jun 11 20:15:04.584555 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:04.584498 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29686815-grwwc" podStartSLOduration=1.454484335 podStartE2EDuration="4.584482599s" totalImagesPullingTime="3.129998264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:15:04.583030747 +0000 UTC m=+1267.614747388" watchObservedRunningTime="2026-06-11 20:15:04.584482599 +0000 UTC m=+1267.616199239" Jun 11 20:15:05.570682 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:05.570650 2564 generic.go:356] "Generic (PLEG): container finished" podID="7b07956a-e99a-4361-bfc0-6605f61b5a56" containerID="a5bbbaff0eac7f0677e04e3646d844096ababc7801ebce3bc846cb5680b3830f" exitCode=0 Jun 11 20:15:05.571153 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:05.570743 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686815-grwwc" event={"ID":"7b07956a-e99a-4361-bfc0-6605f61b5a56","Type":"ContainerDied","Data":"a5bbbaff0eac7f0677e04e3646d844096ababc7801ebce3bc846cb5680b3830f"} Jun 11 20:15:06.702868 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:06.702844 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686815-grwwc" Jun 11 20:15:06.875975 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:06.875908 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpknf\" (UniqueName: \"kubernetes.io/projected/7b07956a-e99a-4361-bfc0-6605f61b5a56-kube-api-access-jpknf\") pod \"7b07956a-e99a-4361-bfc0-6605f61b5a56\" (UID: \"7b07956a-e99a-4361-bfc0-6605f61b5a56\") " Jun 11 20:15:06.878147 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:06.878122 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b07956a-e99a-4361-bfc0-6605f61b5a56-kube-api-access-jpknf" (OuterVolumeSpecName: "kube-api-access-jpknf") pod "7b07956a-e99a-4361-bfc0-6605f61b5a56" (UID: "7b07956a-e99a-4361-bfc0-6605f61b5a56"). InnerVolumeSpecName "kube-api-access-jpknf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:15:06.977243 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:06.977214 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpknf\" (UniqueName: \"kubernetes.io/projected/7b07956a-e99a-4361-bfc0-6605f61b5a56-kube-api-access-jpknf\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:15:07.580744 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:07.580716 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686815-grwwc" Jun 11 20:15:07.580744 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:07.580730 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686815-grwwc" event={"ID":"7b07956a-e99a-4361-bfc0-6605f61b5a56","Type":"ContainerDied","Data":"518d2ae0ba8bc125c594e9301b0dee40b1338c5f1e84c8798bc87d35db6f53d3"} Jun 11 20:15:07.580939 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:15:07.580776 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="518d2ae0ba8bc125c594e9301b0dee40b1338c5f1e84c8798bc87d35db6f53d3" Jun 11 20:30:00.138422 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:00.138337 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29686830-8sh9f"] Jun 11 20:30:00.140845 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:00.138676 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b07956a-e99a-4361-bfc0-6605f61b5a56" containerName="cleanup" Jun 11 20:30:00.140845 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:00.138687 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b07956a-e99a-4361-bfc0-6605f61b5a56" containerName="cleanup" Jun 11 20:30:00.140845 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:00.138761 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b07956a-e99a-4361-bfc0-6605f61b5a56" containerName="cleanup" Jun 11 20:30:00.141827 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:00.141809 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686830-8sh9f" Jun 11 20:30:00.144416 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:00.144390 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9gqk7\"" Jun 11 20:30:00.156844 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:00.156814 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686830-8sh9f"] Jun 11 20:30:00.173880 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:00.173847 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fx77\" (UniqueName: \"kubernetes.io/projected/6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d-kube-api-access-7fx77\") pod \"maas-api-key-cleanup-29686830-8sh9f\" (UID: \"6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d\") " pod="opendatahub/maas-api-key-cleanup-29686830-8sh9f" Jun 11 20:30:00.274443 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:00.274414 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fx77\" (UniqueName: \"kubernetes.io/projected/6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d-kube-api-access-7fx77\") pod \"maas-api-key-cleanup-29686830-8sh9f\" (UID: \"6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d\") " pod="opendatahub/maas-api-key-cleanup-29686830-8sh9f" Jun 11 20:30:00.284334 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:00.284301 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fx77\" (UniqueName: \"kubernetes.io/projected/6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d-kube-api-access-7fx77\") pod \"maas-api-key-cleanup-29686830-8sh9f\" (UID: \"6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d\") " pod="opendatahub/maas-api-key-cleanup-29686830-8sh9f" Jun 11 20:30:00.451809 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:00.451700 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686830-8sh9f" Jun 11 20:30:00.579879 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:00.579856 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686830-8sh9f"] Jun 11 20:30:00.581572 ip-10-0-142-46 kubenswrapper[2564]: W0611 20:30:00.581546 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b8aeb1d_7471_4a20_afb1_e7cde3a3c94d.slice/crio-40b06f0f301ce821552732f0a69856480e7a395d08a3d95dd8e2fb0fbdc7d2d3 WatchSource:0}: Error finding container 40b06f0f301ce821552732f0a69856480e7a395d08a3d95dd8e2fb0fbdc7d2d3: Status 404 returned error can't find the container with id 40b06f0f301ce821552732f0a69856480e7a395d08a3d95dd8e2fb0fbdc7d2d3 Jun 11 20:30:01.566190 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:01.566154 2564 generic.go:356] "Generic (PLEG): container finished" podID="6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d" containerID="1e70d0525032c311f7b5c4ef5e8e8b61c19c81691dd0e5c00af5d48140babc38" exitCode=0 Jun 11 20:30:01.566570 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:01.566247 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686830-8sh9f" event={"ID":"6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d","Type":"ContainerDied","Data":"1e70d0525032c311f7b5c4ef5e8e8b61c19c81691dd0e5c00af5d48140babc38"} Jun 11 20:30:01.566570 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:01.566312 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686830-8sh9f" event={"ID":"6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d","Type":"ContainerStarted","Data":"40b06f0f301ce821552732f0a69856480e7a395d08a3d95dd8e2fb0fbdc7d2d3"} Jun 11 20:30:02.700205 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:02.700180 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686830-8sh9f" Jun 11 20:30:02.794269 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:02.794243 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fx77\" (UniqueName: \"kubernetes.io/projected/6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d-kube-api-access-7fx77\") pod \"6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d\" (UID: \"6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d\") " Jun 11 20:30:02.796432 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:02.796406 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d-kube-api-access-7fx77" (OuterVolumeSpecName: "kube-api-access-7fx77") pod "6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d" (UID: "6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d"). InnerVolumeSpecName "kube-api-access-7fx77". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:30:02.895398 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:02.895335 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fx77\" (UniqueName: \"kubernetes.io/projected/6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d-kube-api-access-7fx77\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:30:03.575487 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:03.575459 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686830-8sh9f" Jun 11 20:30:03.575487 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:03.575482 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686830-8sh9f" event={"ID":"6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d","Type":"ContainerDied","Data":"40b06f0f301ce821552732f0a69856480e7a395d08a3d95dd8e2fb0fbdc7d2d3"} Jun 11 20:30:03.575694 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:30:03.575526 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40b06f0f301ce821552732f0a69856480e7a395d08a3d95dd8e2fb0fbdc7d2d3" Jun 11 20:32:34.836434 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.836396 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6"] Jun 11 20:32:34.836959 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.836940 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d" containerName="cleanup" Jun 11 20:32:34.837018 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.836963 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d" containerName="cleanup" Jun 11 20:32:34.837097 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.837084 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d" containerName="cleanup" Jun 11 20:32:34.839875 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.839852 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.842457 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.842431 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-cbf12515-openshift-default-dockercfg-z5dx6\"" Jun 11 20:32:34.842587 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.842508 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 20:32:34.853402 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.853376 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6"] Jun 11 20:32:34.878842 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.878812 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-workload-certs\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.878957 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.878851 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-envoy\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.878957 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.878897 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-credential-socket\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.878957 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.878946 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-podinfo\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.879085 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.878985 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istiod-ca-cert\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.879085 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.879046 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-data\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.879170 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.879139 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-workload-socket\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.879170 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.879163 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxm92\" (UniqueName: \"kubernetes.io/projected/243e9f2f-2571-4a2c-9a84-99712eb0e81a-kube-api-access-rxm92\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.879248 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.879186 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-token\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.979823 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.979778 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-workload-socket\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.979955 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.979827 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxm92\" (UniqueName: \"kubernetes.io/projected/243e9f2f-2571-4a2c-9a84-99712eb0e81a-kube-api-access-rxm92\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.979955 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.979853 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-token\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.979955 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.979912 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-workload-certs\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.979955 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.979937 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-envoy\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.980128 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.979966 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-credential-socket\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.980128 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.979997 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-podinfo\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.980128 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.980036 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istiod-ca-cert\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.980128 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.980061 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-data\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.980518 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.980269 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-workload-socket\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.980518 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.980416 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-credential-socket\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.980518 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.980443 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-workload-certs\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.980848 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.980531 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-data\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.980912 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.980859 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istiod-ca-cert\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.982430 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.982411 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-envoy\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.982568 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.982549 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-podinfo\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.988869 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.988843 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-token\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:34.989096 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:34.989067 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxm92\" (UniqueName: \"kubernetes.io/projected/243e9f2f-2571-4a2c-9a84-99712eb0e81a-kube-api-access-rxm92\") pod \"e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:35.154155 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:35.154081 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:35.289212 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:35.289189 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6"] Jun 11 20:32:35.291215 ip-10-0-142-46 kubenswrapper[2564]: W0611 20:32:35.291186 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod243e9f2f_2571_4a2c_9a84_99712eb0e81a.slice/crio-755defedf885f426b1aee8a98ac850599c20ca9beecce775ddc37f691b5cb13a WatchSource:0}: Error finding container 755defedf885f426b1aee8a98ac850599c20ca9beecce775ddc37f691b5cb13a: Status 404 returned error can't find the container with id 755defedf885f426b1aee8a98ac850599c20ca9beecce775ddc37f691b5cb13a Jun 11 20:32:35.293174 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:35.293157 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 20:32:36.261892 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:36.261854 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" event={"ID":"243e9f2f-2571-4a2c-9a84-99712eb0e81a","Type":"ContainerStarted","Data":"755defedf885f426b1aee8a98ac850599c20ca9beecce775ddc37f691b5cb13a"} Jun 11 20:32:38.204507 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:38.204466 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 11 20:32:38.204772 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:38.204544 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 11 20:32:38.204772 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:38.204569 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 11 20:32:38.276128 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:38.276097 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" event={"ID":"243e9f2f-2571-4a2c-9a84-99712eb0e81a","Type":"ContainerStarted","Data":"7a811f2a385a88919bb5ebe9a21c1d364dae47482a0fbf2bcb282ce69284dd87"} Jun 11 20:32:38.297157 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:38.297103 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" podStartSLOduration=1.386185893 podStartE2EDuration="4.297081661s" totalImagesPullingTime="2.910895768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:32:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:32:38.295189203 +0000 UTC m=+2321.326906014" watchObservedRunningTime="2026-06-11 20:32:38.297081661 +0000 UTC m=+2321.328798300" Jun 11 20:32:39.154972 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:39.154937 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:39.159679 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:39.159655 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:39.281092 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:39.281057 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:39.282132 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:39.282115 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:42.444539 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:42.444503 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6"] Jun 11 20:32:42.444972 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:42.444673 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" podUID="243e9f2f-2571-4a2c-9a84-99712eb0e81a" containerName="istio-proxy" containerID="cri-o://7a811f2a385a88919bb5ebe9a21c1d364dae47482a0fbf2bcb282ce69284dd87" gracePeriod=30 Jun 11 20:32:47.704501 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.704477 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:47.798475 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.798403 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istiod-ca-cert\") pod \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " Jun 11 20:32:47.798475 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.798436 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-workload-socket\") pod \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " Jun 11 20:32:47.798475 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.798460 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-podinfo\") pod \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " Jun 11 20:32:47.798721 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.798480 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxm92\" (UniqueName: \"kubernetes.io/projected/243e9f2f-2571-4a2c-9a84-99712eb0e81a-kube-api-access-rxm92\") pod \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " Jun 11 20:32:47.798721 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.798640 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-token\") pod \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " Jun 11 20:32:47.798721 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.798706 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-envoy\") pod \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " Jun 11 20:32:47.798922 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.798734 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "243e9f2f-2571-4a2c-9a84-99712eb0e81a" (UID: "243e9f2f-2571-4a2c-9a84-99712eb0e81a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:32:47.798922 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.798760 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-workload-certs\") pod \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " Jun 11 20:32:47.798922 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.798818 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-data\") pod \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " Jun 11 20:32:47.798922 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.798889 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-credential-socket\") pod \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\" (UID: \"243e9f2f-2571-4a2c-9a84-99712eb0e81a\") " Jun 11 20:32:47.798922 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.798895 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "243e9f2f-2571-4a2c-9a84-99712eb0e81a" (UID: "243e9f2f-2571-4a2c-9a84-99712eb0e81a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:32:47.799180 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.798965 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "243e9f2f-2571-4a2c-9a84-99712eb0e81a" (UID: "243e9f2f-2571-4a2c-9a84-99712eb0e81a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:32:47.799180 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.799134 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-data" (OuterVolumeSpecName: "istio-data") pod "243e9f2f-2571-4a2c-9a84-99712eb0e81a" (UID: "243e9f2f-2571-4a2c-9a84-99712eb0e81a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:32:47.799180 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.799145 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "243e9f2f-2571-4a2c-9a84-99712eb0e81a" (UID: "243e9f2f-2571-4a2c-9a84-99712eb0e81a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:32:47.799507 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.799213 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-credential-socket\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:32:47.799507 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.799230 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istiod-ca-cert\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:32:47.799507 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.799242 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-workload-socket\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:32:47.799507 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.799250 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-workload-certs\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:32:47.799507 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.799259 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-data\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:32:47.800921 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.800896 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/243e9f2f-2571-4a2c-9a84-99712eb0e81a-kube-api-access-rxm92" (OuterVolumeSpecName: "kube-api-access-rxm92") pod "243e9f2f-2571-4a2c-9a84-99712eb0e81a" (UID: "243e9f2f-2571-4a2c-9a84-99712eb0e81a"). InnerVolumeSpecName "kube-api-access-rxm92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:32:47.801032 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.800978 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-token" (OuterVolumeSpecName: "istio-token") pod "243e9f2f-2571-4a2c-9a84-99712eb0e81a" (UID: "243e9f2f-2571-4a2c-9a84-99712eb0e81a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:32:47.801383 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.801360 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "243e9f2f-2571-4a2c-9a84-99712eb0e81a" (UID: "243e9f2f-2571-4a2c-9a84-99712eb0e81a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 20:32:47.801383 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.801365 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "243e9f2f-2571-4a2c-9a84-99712eb0e81a" (UID: "243e9f2f-2571-4a2c-9a84-99712eb0e81a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 20:32:47.900537 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.900506 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-podinfo\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:32:47.900537 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.900530 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxm92\" (UniqueName: \"kubernetes.io/projected/243e9f2f-2571-4a2c-9a84-99712eb0e81a-kube-api-access-rxm92\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:32:47.900537 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.900541 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-token\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:32:47.900731 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:47.900549 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/243e9f2f-2571-4a2c-9a84-99712eb0e81a-istio-envoy\") on node \"ip-10-0-142-46.ec2.internal\" DevicePath \"\"" Jun 11 20:32:48.322616 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:48.322577 2564 generic.go:356] "Generic (PLEG): container finished" podID="243e9f2f-2571-4a2c-9a84-99712eb0e81a" containerID="7a811f2a385a88919bb5ebe9a21c1d364dae47482a0fbf2bcb282ce69284dd87" exitCode=0 Jun 11 20:32:48.322807 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:48.322620 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" Jun 11 20:32:48.322807 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:48.322626 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" event={"ID":"243e9f2f-2571-4a2c-9a84-99712eb0e81a","Type":"ContainerDied","Data":"7a811f2a385a88919bb5ebe9a21c1d364dae47482a0fbf2bcb282ce69284dd87"} Jun 11 20:32:48.322807 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:48.322678 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6" event={"ID":"243e9f2f-2571-4a2c-9a84-99712eb0e81a","Type":"ContainerDied","Data":"755defedf885f426b1aee8a98ac850599c20ca9beecce775ddc37f691b5cb13a"} Jun 11 20:32:48.322807 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:48.322701 2564 scope.go:117] "RemoveContainer" containerID="7a811f2a385a88919bb5ebe9a21c1d364dae47482a0fbf2bcb282ce69284dd87" Jun 11 20:32:48.331644 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:48.331629 2564 scope.go:117] "RemoveContainer" containerID="7a811f2a385a88919bb5ebe9a21c1d364dae47482a0fbf2bcb282ce69284dd87" Jun 11 20:32:48.331948 ip-10-0-142-46 kubenswrapper[2564]: E0611 20:32:48.331925 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a811f2a385a88919bb5ebe9a21c1d364dae47482a0fbf2bcb282ce69284dd87\": container with ID starting with 7a811f2a385a88919bb5ebe9a21c1d364dae47482a0fbf2bcb282ce69284dd87 not found: ID does not exist" containerID="7a811f2a385a88919bb5ebe9a21c1d364dae47482a0fbf2bcb282ce69284dd87" Jun 11 20:32:48.332028 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:48.331952 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a811f2a385a88919bb5ebe9a21c1d364dae47482a0fbf2bcb282ce69284dd87"} err="failed to get container status \"7a811f2a385a88919bb5ebe9a21c1d364dae47482a0fbf2bcb282ce69284dd87\": rpc error: code = NotFound desc = could not find container \"7a811f2a385a88919bb5ebe9a21c1d364dae47482a0fbf2bcb282ce69284dd87\": container with ID starting with 7a811f2a385a88919bb5ebe9a21c1d364dae47482a0fbf2bcb282ce69284dd87 not found: ID does not exist" Jun 11 20:32:48.343060 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:48.343037 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6"] Jun 11 20:32:48.349408 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:48.349382 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-cbf12515-openshift-default-5b7787df4d-dvcd6"] Jun 11 20:32:49.347709 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:49.347681 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="243e9f2f-2571-4a2c-9a84-99712eb0e81a" path="/var/lib/kubelet/pods/243e9f2f-2571-4a2c-9a84-99712eb0e81a/volumes" Jun 11 20:32:54.767422 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:54.767386 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cd8ccc46b-9r7wt_fc68f42a-338f-4bb5-b64b-2b5dadf85c15/authorino/0.log" Jun 11 20:32:59.821165 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:59.821133 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686815-grwwc_7b07956a-e99a-4361-bfc0-6605f61b5a56/cleanup/0.log" Jun 11 20:32:59.926065 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:32:59.926033 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686830-8sh9f_6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d/cleanup/0.log" Jun 11 20:33:00.542531 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:00.542504 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cd897d645-bl99m_cf4cbcb4-94d4-4972-aff2-cccf9ec21889/copy-manifests/0.log" Jun 11 20:33:00.548666 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:00.548643 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cd897d645-bl99m_cf4cbcb4-94d4-4972-aff2-cccf9ec21889/manager/0.log" Jun 11 20:33:00.778848 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:00.778820 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-c8qfp_0ba91a82-9684-4656-b19d-86e792fa64f5/postgres/0.log" Jun 11 20:33:02.028725 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:02.028677 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cd8ccc46b-9r7wt_fc68f42a-338f-4bb5-b64b-2b5dadf85c15/authorino/0.log" Jun 11 20:33:02.272778 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:02.272744 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wsrw2_7eee7395-52cc-45cb-b646-9d9ab953a9d3/manager/0.log" Jun 11 20:33:03.557803 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:03.557762 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d547749b-zf8v2_52deafb4-e9f0-42d5-92e2-b1aba9aee108/kube-auth-proxy/0.log" Jun 11 20:33:03.784415 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:03.784384 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-c42vw_42c8ac8d-38cc-4551-89bb-62a5a3d6d6fa/payload-pre-processing/0.log" Jun 11 20:33:08.901748 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:08.901714 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2fkbl/must-gather-v8s6j"] Jun 11 20:33:08.902136 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:08.902093 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="243e9f2f-2571-4a2c-9a84-99712eb0e81a" containerName="istio-proxy" Jun 11 20:33:08.902136 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:08.902106 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="243e9f2f-2571-4a2c-9a84-99712eb0e81a" containerName="istio-proxy" Jun 11 20:33:08.902217 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:08.902187 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="243e9f2f-2571-4a2c-9a84-99712eb0e81a" containerName="istio-proxy" Jun 11 20:33:08.912060 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:08.912030 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2fkbl/must-gather-v8s6j" Jun 11 20:33:08.913205 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:08.913178 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2fkbl/must-gather-v8s6j"] Jun 11 20:33:08.915065 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:08.915041 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2fkbl\"/\"kube-root-ca.crt\"" Jun 11 20:33:08.916144 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:08.916120 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2fkbl\"/\"openshift-service-ca.crt\"" Jun 11 20:33:08.916256 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:08.916155 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2fkbl\"/\"default-dockercfg-l2kwx\"" Jun 11 20:33:09.089831 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:09.089780 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9803a188-caa8-4e4b-978f-53cbaa81615c-must-gather-output\") pod \"must-gather-v8s6j\" (UID: \"9803a188-caa8-4e4b-978f-53cbaa81615c\") " pod="openshift-must-gather-2fkbl/must-gather-v8s6j" Jun 11 20:33:09.090032 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:09.089865 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqlgk\" (UniqueName: \"kubernetes.io/projected/9803a188-caa8-4e4b-978f-53cbaa81615c-kube-api-access-wqlgk\") pod \"must-gather-v8s6j\" (UID: \"9803a188-caa8-4e4b-978f-53cbaa81615c\") " pod="openshift-must-gather-2fkbl/must-gather-v8s6j" Jun 11 20:33:09.191384 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:09.191290 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqlgk\" (UniqueName: \"kubernetes.io/projected/9803a188-caa8-4e4b-978f-53cbaa81615c-kube-api-access-wqlgk\") pod \"must-gather-v8s6j\" (UID: \"9803a188-caa8-4e4b-978f-53cbaa81615c\") " pod="openshift-must-gather-2fkbl/must-gather-v8s6j" Jun 11 20:33:09.191543 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:09.191385 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9803a188-caa8-4e4b-978f-53cbaa81615c-must-gather-output\") pod \"must-gather-v8s6j\" (UID: \"9803a188-caa8-4e4b-978f-53cbaa81615c\") " pod="openshift-must-gather-2fkbl/must-gather-v8s6j" Jun 11 20:33:09.191708 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:09.191693 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9803a188-caa8-4e4b-978f-53cbaa81615c-must-gather-output\") pod \"must-gather-v8s6j\" (UID: \"9803a188-caa8-4e4b-978f-53cbaa81615c\") " pod="openshift-must-gather-2fkbl/must-gather-v8s6j" Jun 11 20:33:09.199631 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:09.199601 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqlgk\" (UniqueName: \"kubernetes.io/projected/9803a188-caa8-4e4b-978f-53cbaa81615c-kube-api-access-wqlgk\") pod \"must-gather-v8s6j\" (UID: \"9803a188-caa8-4e4b-978f-53cbaa81615c\") " pod="openshift-must-gather-2fkbl/must-gather-v8s6j" Jun 11 20:33:09.223750 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:09.223717 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2fkbl/must-gather-v8s6j" Jun 11 20:33:09.350964 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:09.350938 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2fkbl/must-gather-v8s6j"] Jun 11 20:33:09.353332 ip-10-0-142-46 kubenswrapper[2564]: W0611 20:33:09.353299 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9803a188_caa8_4e4b_978f_53cbaa81615c.slice/crio-6ca02350dd810674686c924cf2d04aa45661906cea4f9108dac9701004618188 WatchSource:0}: Error finding container 6ca02350dd810674686c924cf2d04aa45661906cea4f9108dac9701004618188: Status 404 returned error can't find the container with id 6ca02350dd810674686c924cf2d04aa45661906cea4f9108dac9701004618188 Jun 11 20:33:09.423392 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:09.423359 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2fkbl/must-gather-v8s6j" event={"ID":"9803a188-caa8-4e4b-978f-53cbaa81615c","Type":"ContainerStarted","Data":"6ca02350dd810674686c924cf2d04aa45661906cea4f9108dac9701004618188"} Jun 11 20:33:10.431348 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:10.431241 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2fkbl/must-gather-v8s6j" event={"ID":"9803a188-caa8-4e4b-978f-53cbaa81615c","Type":"ContainerStarted","Data":"972a2b86355020542fb8af14a76f2a718d6cdcf97c9e8bf6ffa591bc5a20de31"} Jun 11 20:33:10.431348 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:10.431298 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2fkbl/must-gather-v8s6j" event={"ID":"9803a188-caa8-4e4b-978f-53cbaa81615c","Type":"ContainerStarted","Data":"1eaf2ec85fe161ccfa23312d291e52b3e2b2ae20b929f00478498fab0e310632"} Jun 11 20:33:10.447402 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:10.447337 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2fkbl/must-gather-v8s6j" podStartSLOduration=1.646112569 podStartE2EDuration="2.447314059s" totalImagesPullingTime="801.20149ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:33:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:33:10.445399779 +0000 UTC m=+2353.477116419" watchObservedRunningTime="2026-06-11 20:33:10.447314059 +0000 UTC m=+2353.479030700" Jun 11 20:33:11.980414 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:11.980371 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r6c8g_2380f825-9675-4295-989c-da0d39abef7f/global-pull-secret-syncer/0.log" Jun 11 20:33:12.090964 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:12.090924 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-znbfc_69d115a5-e475-4cf9-a878-5eb234c91974/konnectivity-agent/0.log" Jun 11 20:33:12.178468 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:12.178435 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-46.ec2.internal_c8d2b0ae5364d0f6706b40cc63991a02/haproxy/0.log" Jun 11 20:33:17.579087 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:17.579049 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cd8ccc46b-9r7wt_fc68f42a-338f-4bb5-b64b-2b5dadf85c15/authorino/0.log" Jun 11 20:33:17.677396 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:17.677360 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wsrw2_7eee7395-52cc-45cb-b646-9d9ab953a9d3/manager/0.log" Jun 11 20:33:19.503828 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:19.503744 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f8d7364-0143-413b-9328-5ba53576291b/alertmanager/0.log" Jun 11 20:33:19.531414 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:19.531388 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f8d7364-0143-413b-9328-5ba53576291b/config-reloader/0.log" Jun 11 20:33:19.555377 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:19.555305 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f8d7364-0143-413b-9328-5ba53576291b/kube-rbac-proxy-web/0.log" Jun 11 20:33:19.574869 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:19.574746 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f8d7364-0143-413b-9328-5ba53576291b/kube-rbac-proxy/0.log" Jun 11 20:33:19.596134 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:19.596102 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f8d7364-0143-413b-9328-5ba53576291b/kube-rbac-proxy-metric/0.log" Jun 11 20:33:19.618101 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:19.618069 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f8d7364-0143-413b-9328-5ba53576291b/prom-label-proxy/0.log" Jun 11 20:33:19.641380 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:19.641350 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f8d7364-0143-413b-9328-5ba53576291b/init-config-reloader/0.log" Jun 11 20:33:19.782474 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:19.782394 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-759f689cdb-zx4xv_fbf05462-3c11-403c-bee4-dc50d82ab05d/metrics-server/0.log" Jun 11 20:33:19.954890 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:19.954837 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l5pjk_9615928b-9884-4a2e-8b27-3d2ca7f4b59d/node-exporter/0.log" Jun 11 20:33:19.976382 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:19.976309 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l5pjk_9615928b-9884-4a2e-8b27-3d2ca7f4b59d/kube-rbac-proxy/0.log" Jun 11 20:33:20.003004 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:20.002976 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l5pjk_9615928b-9884-4a2e-8b27-3d2ca7f4b59d/init-textfile/0.log" Jun 11 20:33:20.217255 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:20.217215 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea812eda-06b4-446c-84c7-590ab65d59c7/prometheus/0.log" Jun 11 20:33:20.237377 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:20.237318 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea812eda-06b4-446c-84c7-590ab65d59c7/config-reloader/0.log" Jun 11 20:33:20.258586 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:20.258559 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea812eda-06b4-446c-84c7-590ab65d59c7/thanos-sidecar/0.log" Jun 11 20:33:20.281675 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:20.281650 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea812eda-06b4-446c-84c7-590ab65d59c7/kube-rbac-proxy-web/0.log" Jun 11 20:33:20.305717 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:20.305687 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea812eda-06b4-446c-84c7-590ab65d59c7/kube-rbac-proxy/0.log" Jun 11 20:33:20.329548 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:20.329519 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea812eda-06b4-446c-84c7-590ab65d59c7/kube-rbac-proxy-thanos/0.log" Jun 11 20:33:20.354605 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:20.354579 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea812eda-06b4-446c-84c7-590ab65d59c7/init-config-reloader/0.log" Jun 11 20:33:20.432936 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:20.432848 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-thd84_8493dedb-4a7d-4f91-86ae-0e9818d1b3b2/prometheus-operator-admission-webhook/0.log" Jun 11 20:33:20.553757 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:20.553725 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-864bb64949-bjgkg_1fb80569-82a4-40ba-a2eb-c82860d4b05b/thanos-query/0.log" Jun 11 20:33:20.575020 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:20.574990 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-864bb64949-bjgkg_1fb80569-82a4-40ba-a2eb-c82860d4b05b/kube-rbac-proxy-web/0.log" Jun 11 20:33:20.595174 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:20.595149 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-864bb64949-bjgkg_1fb80569-82a4-40ba-a2eb-c82860d4b05b/kube-rbac-proxy/0.log" Jun 11 20:33:20.618769 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:20.618739 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-864bb64949-bjgkg_1fb80569-82a4-40ba-a2eb-c82860d4b05b/prom-label-proxy/0.log" Jun 11 20:33:20.639722 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:20.639692 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-864bb64949-bjgkg_1fb80569-82a4-40ba-a2eb-c82860d4b05b/kube-rbac-proxy-rules/0.log" Jun 11 20:33:20.663704 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:20.663670 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-864bb64949-bjgkg_1fb80569-82a4-40ba-a2eb-c82860d4b05b/kube-rbac-proxy-metrics/0.log" Jun 11 20:33:24.115831 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:24.115777 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr"] Jun 11 20:33:24.124693 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:24.124663 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" Jun 11 20:33:24.132408 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:24.132380 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr"] Jun 11 20:33:24.254668 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:24.254629 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e319759d-9099-4988-b579-e9af7610b561-sys\") pod \"perf-node-gather-daemonset-x4qpr\" (UID: \"e319759d-9099-4988-b579-e9af7610b561\") " pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" Jun 11 20:33:24.255142 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:24.255115 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjgfp\" (UniqueName: \"kubernetes.io/projected/e319759d-9099-4988-b579-e9af7610b561-kube-api-access-kjgfp\") pod \"perf-node-gather-daemonset-x4qpr\" (UID: \"e319759d-9099-4988-b579-e9af7610b561\") " pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" Jun 11 20:33:24.255385 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:24.255367 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e319759d-9099-4988-b579-e9af7610b561-podres\") pod \"perf-node-gather-daemonset-x4qpr\" (UID: \"e319759d-9099-4988-b579-e9af7610b561\") " pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" Jun 11 20:33:24.255605 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:24.255588 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e319759d-9099-4988-b579-e9af7610b561-proc\") pod \"perf-node-gather-daemonset-x4qpr\" (UID: \"e319759d-9099-4988-b579-e9af7610b561\") " pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" Jun 11 20:33:24.255767 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:24.255751 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e319759d-9099-4988-b579-e9af7610b561-lib-modules\") pod \"perf-node-gather-daemonset-x4qpr\" (UID: \"e319759d-9099-4988-b579-e9af7610b561\") " pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" Jun 11 20:33:24.356527 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:24.356487 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e319759d-9099-4988-b579-e9af7610b561-proc\") pod \"perf-node-gather-daemonset-x4qpr\" (UID: \"e319759d-9099-4988-b579-e9af7610b561\") " pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" Jun 11 20:33:24.356728 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:24.356537 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e319759d-9099-4988-b579-e9af7610b561-lib-modules\") pod \"perf-node-gather-daemonset-x4qpr\" (UID: \"e319759d-9099-4988-b579-e9af7610b561\") " pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" Jun 11 20:33:24.356728 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:24.356593 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e319759d-9099-4988-b579-e9af7610b561-sys\") pod \"perf-node-gather-daemonset-x4qpr\" (UID: \"e319759d-9099-4988-b579-e9af7610b561\") " pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" Jun 11 20:33:24.356728 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:24.356614 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e319759d-9099-4988-b579-e9af7610b561-proc\") pod \"perf-node-gather-daemonset-x4qpr\" (UID: \"e319759d-9099-4988-b579-e9af7610b561\") " pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" Jun 11 20:33:24.356728 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:24.356630 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjgfp\" (UniqueName: \"kubernetes.io/projected/e319759d-9099-4988-b579-e9af7610b561-kube-api-access-kjgfp\") pod \"perf-node-gather-daemonset-x4qpr\" (UID: \"e319759d-9099-4988-b579-e9af7610b561\") " pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" Jun 11 20:33:24.356728 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:24.356701 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e319759d-9099-4988-b579-e9af7610b561-sys\") pod \"perf-node-gather-daemonset-x4qpr\" (UID: \"e319759d-9099-4988-b579-e9af7610b561\") " pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" Jun 11 20:33:24.356728 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:24.356702 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e319759d-9099-4988-b579-e9af7610b561-podres\") pod \"perf-node-gather-daemonset-x4qpr\" (UID: \"e319759d-9099-4988-b579-e9af7610b561\") " pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" Jun 11 20:33:24.357094 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:24.356704 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e319759d-9099-4988-b579-e9af7610b561-lib-modules\") pod \"perf-node-gather-daemonset-x4qpr\" (UID: \"e319759d-9099-4988-b579-e9af7610b561\") " pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" Jun 11 20:33:24.357094 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:24.356852 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e319759d-9099-4988-b579-e9af7610b561-podres\") pod \"perf-node-gather-daemonset-x4qpr\" (UID: \"e319759d-9099-4988-b579-e9af7610b561\") " pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" Jun 11 20:33:24.365313 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:24.365265 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjgfp\" (UniqueName: \"kubernetes.io/projected/e319759d-9099-4988-b579-e9af7610b561-kube-api-access-kjgfp\") pod \"perf-node-gather-daemonset-x4qpr\" (UID: \"e319759d-9099-4988-b579-e9af7610b561\") " pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" Jun 11 20:33:24.439298 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:24.439220 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" Jun 11 20:33:24.632254 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:24.631365 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr"] Jun 11 20:33:24.635630 ip-10-0-142-46 kubenswrapper[2564]: W0611 20:33:24.635559 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode319759d_9099_4988_b579_e9af7610b561.slice/crio-96ec0a03b5dd2cb8591f37331972ae2dd521c71662b94d21186c699875b81586 WatchSource:0}: Error finding container 96ec0a03b5dd2cb8591f37331972ae2dd521c71662b94d21186c699875b81586: Status 404 returned error can't find the container with id 96ec0a03b5dd2cb8591f37331972ae2dd521c71662b94d21186c699875b81586 Jun 11 20:33:25.193244 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:25.193215 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dlkxw_72b1d900-e2b3-4a23-989b-42e796f1c820/dns/0.log" Jun 11 20:33:25.213846 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:25.213813 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dlkxw_72b1d900-e2b3-4a23-989b-42e796f1c820/kube-rbac-proxy/0.log" Jun 11 20:33:25.401638 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:25.401609 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rkxzl_9b7199ae-2384-40a9-ac35-f185dcce8701/dns-node-resolver/0.log" Jun 11 20:33:25.534339 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:25.534257 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" event={"ID":"e319759d-9099-4988-b579-e9af7610b561","Type":"ContainerStarted","Data":"a2237fe5aae2f39ae958937a9169605ab4658665209e0f1c1928f40f4a81df90"} Jun 11 20:33:25.534339 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:25.534309 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" event={"ID":"e319759d-9099-4988-b579-e9af7610b561","Type":"ContainerStarted","Data":"96ec0a03b5dd2cb8591f37331972ae2dd521c71662b94d21186c699875b81586"} Jun 11 20:33:25.534544 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:25.534365 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" Jun 11 20:33:25.551770 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:25.551711 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" podStartSLOduration=1.5516959959999999 podStartE2EDuration="1.551695996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 20:33:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:33:25.549439187 +0000 UTC m=+2368.581155828" watchObservedRunningTime="2026-06-11 20:33:25.551695996 +0000 UTC m=+2368.583412636" Jun 11 20:33:25.965084 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:25.965051 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bk68w_ad4cb0c0-3045-4129-a116-d02b9e1dfd57/node-ca/0.log" Jun 11 20:33:27.045428 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:27.045392 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d547749b-zf8v2_52deafb4-e9f0-42d5-92e2-b1aba9aee108/kube-auth-proxy/0.log" Jun 11 20:33:27.148159 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:27.148125 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-c42vw_42c8ac8d-38cc-4551-89bb-62a5a3d6d6fa/payload-pre-processing/0.log" Jun 11 20:33:27.884604 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:27.884570 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qfp6k_d96c8cfe-b03a-40be-9956-8d0477442dac/serve-healthcheck-canary/0.log" Jun 11 20:33:28.545694 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:28.545668 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l4cvq_351d8b60-ae26-4785-9900-5f29d126e407/kube-rbac-proxy/0.log" Jun 11 20:33:28.567432 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:28.567402 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l4cvq_351d8b60-ae26-4785-9900-5f29d126e407/exporter/0.log" Jun 11 20:33:28.588867 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:28.588841 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l4cvq_351d8b60-ae26-4785-9900-5f29d126e407/extractor/0.log" Jun 11 20:33:31.043266 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:31.043238 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686815-grwwc_7b07956a-e99a-4361-bfc0-6605f61b5a56/cleanup/0.log" Jun 11 20:33:31.065516 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:31.065488 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686830-8sh9f_6b8aeb1d-7471-4a20-afb1-e7cde3a3c94d/cleanup/0.log" Jun 11 20:33:31.347829 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:31.347772 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cd897d645-bl99m_cf4cbcb4-94d4-4972-aff2-cccf9ec21889/manager/0.log" Jun 11 20:33:31.368682 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:31.368657 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cd897d645-bl99m_cf4cbcb4-94d4-4972-aff2-cccf9ec21889/copy-manifests/0.log" Jun 11 20:33:31.442860 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:31.442830 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-c8qfp_0ba91a82-9684-4656-b19d-86e792fa64f5/postgres/0.log" Jun 11 20:33:31.553571 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:31.553536 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2fkbl/perf-node-gather-daemonset-x4qpr" Jun 11 20:33:33.033282 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:33.033216 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8999ff5c6-zllkt_6c75b55d-0ee4-4ba9-ba00-a577eb4b74fb/manager/0.log" Jun 11 20:33:37.638773 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:37.638742 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d547749b-zf8v2_52deafb4-e9f0-42d5-92e2-b1aba9aee108/kube-auth-proxy/0.log" Jun 11 20:33:37.719879 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:37.719759 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-c42vw_42c8ac8d-38cc-4551-89bb-62a5a3d6d6fa/payload-pre-processing/0.log" Jun 11 20:33:39.146426 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:39.146391 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d547749b-zf8v2_52deafb4-e9f0-42d5-92e2-b1aba9aee108/kube-auth-proxy/0.log" Jun 11 20:33:39.232973 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:39.232938 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-c42vw_42c8ac8d-38cc-4551-89bb-62a5a3d6d6fa/payload-pre-processing/0.log" Jun 11 20:33:40.485941 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:40.485910 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qff5g_b93e7c70-5b9e-4e86-9bbc-9e26931413d8/kube-multus-additional-cni-plugins/0.log" Jun 11 20:33:40.509240 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:40.509206 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qff5g_b93e7c70-5b9e-4e86-9bbc-9e26931413d8/egress-router-binary-copy/0.log" Jun 11 20:33:40.529908 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:40.529886 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qff5g_b93e7c70-5b9e-4e86-9bbc-9e26931413d8/cni-plugins/0.log" Jun 11 20:33:40.550826 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:40.550769 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qff5g_b93e7c70-5b9e-4e86-9bbc-9e26931413d8/bond-cni-plugin/0.log" Jun 11 20:33:40.570835 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:40.570811 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qff5g_b93e7c70-5b9e-4e86-9bbc-9e26931413d8/routeoverride-cni/0.log" Jun 11 20:33:40.590261 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:40.590228 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qff5g_b93e7c70-5b9e-4e86-9bbc-9e26931413d8/whereabouts-cni-bincopy/0.log" Jun 11 20:33:40.610676 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:40.610646 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qff5g_b93e7c70-5b9e-4e86-9bbc-9e26931413d8/whereabouts-cni/0.log" Jun 11 20:33:40.643922 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:40.643889 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bd2tp_2d92509a-3188-4c30-a2ee-882a29775c92/kube-multus/0.log" Jun 11 20:33:40.831814 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:40.831752 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z8x8n_66f02d7a-34af-41ed-b9d1-ebc61a648224/network-metrics-daemon/0.log" Jun 11 20:33:40.850438 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:40.850394 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z8x8n_66f02d7a-34af-41ed-b9d1-ebc61a648224/kube-rbac-proxy/0.log" Jun 11 20:33:40.957761 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:40.957730 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d547749b-zf8v2_52deafb4-e9f0-42d5-92e2-b1aba9aee108/kube-auth-proxy/0.log" Jun 11 20:33:41.035835 ip-10-0-142-46 kubenswrapper[2564]: I0611 20:33:41.035773 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-c42vw_42c8ac8d-38cc-4551-89bb-62a5a3d6d6fa/payload-pre-processing/0.log"