Jun 12 19:19:39.758033 ip-10-0-135-76 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 12 19:19:39.758044 ip-10-0-135-76 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 12 19:19:39.758051 ip-10-0-135-76 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 12 19:19:39.758262 ip-10-0-135-76 systemd[1]: Failed to start Kubernetes Kubelet. Jun 12 19:19:49.773798 ip-10-0-135-76 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 12 19:19:49.773813 ip-10-0-135-76 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 210e1268c4014680b4c39c8aec662409 -- Jun 12 19:22:29.225944 ip-10-0-135-76 systemd[1]: Starting Kubernetes Kubelet... Jun 12 19:22:29.623260 ip-10-0-135-76 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 19:22:29.623260 ip-10-0-135-76 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 12 19:22:29.623260 ip-10-0-135-76 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 19:22:29.623260 ip-10-0-135-76 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 12 19:22:29.623260 ip-10-0-135-76 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 19:22:29.624020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.623935 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 12 19:22:29.630011 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.629988 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 19:22:29.630011 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630011 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 19:22:29.630011 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630017 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 19:22:29.630161 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630020 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 19:22:29.630161 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630024 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 19:22:29.630161 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630027 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 19:22:29.630161 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630030 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 19:22:29.630161 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630033 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 19:22:29.630161 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630035 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 19:22:29.630161 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630039 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 19:22:29.630161 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630041 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 19:22:29.630161 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630044 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 19:22:29.630161 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630047 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 19:22:29.630161 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630051 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 19:22:29.630161 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630055 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 19:22:29.630161 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630058 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 19:22:29.630161 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630060 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 19:22:29.630161 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630063 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 19:22:29.630161 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630066 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 19:22:29.630161 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630069 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 19:22:29.630161 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630072 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 19:22:29.630161 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630074 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 19:22:29.630161 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630077 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 19:22:29.630654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630079 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 19:22:29.630654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630082 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 19:22:29.630654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630085 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 19:22:29.630654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630087 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 19:22:29.630654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630090 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 19:22:29.630654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630092 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 12 19:22:29.630654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630095 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 19:22:29.630654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630097 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 19:22:29.630654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630099 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 19:22:29.630654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630102 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 19:22:29.630654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630104 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 19:22:29.630654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630107 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 19:22:29.630654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630109 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 19:22:29.630654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630112 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 19:22:29.630654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630115 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 19:22:29.630654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630117 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 19:22:29.630654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630120 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 19:22:29.630654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630122 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 19:22:29.630654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630125 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 19:22:29.630654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630127 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 19:22:29.631143 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630130 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 19:22:29.631143 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630132 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 19:22:29.631143 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630134 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 19:22:29.631143 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630137 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 19:22:29.631143 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630139 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 19:22:29.631143 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630141 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 19:22:29.631143 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630145 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 19:22:29.631143 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630149 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 19:22:29.631143 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630152 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 19:22:29.631143 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630155 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 19:22:29.631143 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630158 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 19:22:29.631143 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630161 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 19:22:29.631143 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630164 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 19:22:29.631143 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630166 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 19:22:29.631143 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630169 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 19:22:29.631143 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630172 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 19:22:29.631143 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630175 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 19:22:29.631143 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630178 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 19:22:29.631143 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630185 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 19:22:29.631641 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630188 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 19:22:29.631641 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630190 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 19:22:29.631641 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630193 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 19:22:29.631641 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630195 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 19:22:29.631641 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630197 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 19:22:29.631641 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630200 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 19:22:29.631641 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630204 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 19:22:29.631641 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630207 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 19:22:29.631641 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630209 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 19:22:29.631641 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630212 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 19:22:29.631641 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630214 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 19:22:29.631641 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630217 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 19:22:29.631641 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630220 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 19:22:29.631641 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630223 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 19:22:29.631641 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630225 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 19:22:29.631641 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630228 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 19:22:29.631641 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630230 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 19:22:29.631641 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630232 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 19:22:29.631641 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630235 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 19:22:29.631641 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630237 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 19:22:29.632118 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630240 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 19:22:29.632118 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630245 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 19:22:29.632118 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630247 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 19:22:29.632118 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630250 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 19:22:29.632118 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630252 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 19:22:29.632118 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630254 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 19:22:29.632118 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630258 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 19:22:29.632118 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630260 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 19:22:29.632118 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630262 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 19:22:29.632118 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630265 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 19:22:29.632118 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630267 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 19:22:29.632118 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630270 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 19:22:29.632118 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630272 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 19:22:29.632118 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630275 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 19:22:29.632118 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630277 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 19:22:29.632118 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630279 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 19:22:29.632118 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.630282 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 19:22:29.632118 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631006 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 19:22:29.632118 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631018 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 19:22:29.632118 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631021 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 19:22:29.632591 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631024 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 19:22:29.632591 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631026 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 19:22:29.632591 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631029 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 19:22:29.632591 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631032 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 19:22:29.632591 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631034 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 19:22:29.632591 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631037 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 19:22:29.632591 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631040 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 19:22:29.632591 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631042 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 19:22:29.632591 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631045 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 19:22:29.632591 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631048 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 19:22:29.632591 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631050 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 19:22:29.632591 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631053 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 19:22:29.632591 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631055 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 19:22:29.632591 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631058 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 19:22:29.632591 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631061 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 19:22:29.632591 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631064 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 19:22:29.632591 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631066 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 19:22:29.632591 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631069 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 19:22:29.632591 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631072 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 19:22:29.632591 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631074 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 19:22:29.633106 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631077 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 19:22:29.633106 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631080 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 19:22:29.633106 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631083 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 19:22:29.633106 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631085 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 19:22:29.633106 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631088 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 19:22:29.633106 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631090 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 19:22:29.633106 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631093 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 19:22:29.633106 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631095 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 19:22:29.633106 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631098 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 19:22:29.633106 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631100 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 19:22:29.633106 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631104 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 19:22:29.633106 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631107 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 19:22:29.633106 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631110 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 19:22:29.633106 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631113 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 19:22:29.633106 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631115 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 19:22:29.633106 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631118 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 19:22:29.633106 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631120 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 19:22:29.633106 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631123 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 19:22:29.633106 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631125 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 19:22:29.633106 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631128 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 19:22:29.633621 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631131 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 19:22:29.633621 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631134 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 19:22:29.633621 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631137 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 19:22:29.633621 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631139 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 19:22:29.633621 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631142 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 19:22:29.633621 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631144 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 19:22:29.633621 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631147 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 19:22:29.633621 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631150 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 19:22:29.633621 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631153 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 12 19:22:29.633621 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631156 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 19:22:29.633621 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631158 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 19:22:29.633621 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631161 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 19:22:29.633621 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631163 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 19:22:29.633621 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631166 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 19:22:29.633621 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631169 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 19:22:29.633621 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631172 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 19:22:29.633621 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631175 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 19:22:29.633621 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631178 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 19:22:29.633621 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631181 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 19:22:29.633621 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631183 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 19:22:29.634112 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631185 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 19:22:29.634112 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631188 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 19:22:29.634112 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631192 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 19:22:29.634112 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631195 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 19:22:29.634112 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631197 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 19:22:29.634112 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631202 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 19:22:29.634112 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631206 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 19:22:29.634112 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631209 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 19:22:29.634112 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631212 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 19:22:29.634112 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631215 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 19:22:29.634112 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631218 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 19:22:29.634112 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631221 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 19:22:29.634112 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631224 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 19:22:29.634112 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631226 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 19:22:29.634112 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631229 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 19:22:29.634112 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631231 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 19:22:29.634112 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631235 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 19:22:29.634112 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631239 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 19:22:29.634112 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631242 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 19:22:29.634577 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631245 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 19:22:29.634577 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631248 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 19:22:29.634577 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631250 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 19:22:29.634577 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631253 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 19:22:29.634577 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631255 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 19:22:29.634577 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631258 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 19:22:29.634577 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631260 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 19:22:29.634577 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631263 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 19:22:29.634577 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631265 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 19:22:29.634577 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631268 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 19:22:29.634577 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631270 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 19:22:29.634577 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631273 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 19:22:29.634577 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631275 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 19:22:29.634577 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631278 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 19:22:29.634577 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631280 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 19:22:29.634577 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631284 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 19:22:29.634577 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631287 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 19:22:29.634577 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631680 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 19:22:29.634577 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631686 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 19:22:29.635046 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631689 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 19:22:29.635046 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631691 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 19:22:29.635046 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631694 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 19:22:29.635046 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631697 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 19:22:29.635046 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631700 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 19:22:29.635046 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631703 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 19:22:29.635046 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631706 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 19:22:29.635046 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631709 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 19:22:29.635046 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631711 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 19:22:29.635046 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631714 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 19:22:29.635046 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631717 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 19:22:29.635046 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631719 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 19:22:29.635046 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631722 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 19:22:29.635046 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631724 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 19:22:29.635046 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631728 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 19:22:29.635046 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631732 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 19:22:29.635046 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631735 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 19:22:29.635046 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631738 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 19:22:29.635046 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631741 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 19:22:29.635508 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631743 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 19:22:29.635508 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631746 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 19:22:29.635508 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631749 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 19:22:29.635508 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631751 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 19:22:29.635508 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631755 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 19:22:29.635508 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631759 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 19:22:29.635508 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631762 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 19:22:29.635508 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631765 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 19:22:29.635508 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631768 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 19:22:29.635508 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631771 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 19:22:29.635508 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631774 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 19:22:29.635508 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631777 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 19:22:29.635508 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631779 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 19:22:29.635508 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631782 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 19:22:29.635508 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631785 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 19:22:29.635508 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631787 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 19:22:29.635508 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631789 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 19:22:29.635508 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631792 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 19:22:29.635508 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631794 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 19:22:29.635508 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631797 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 19:22:29.635991 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631799 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 19:22:29.635991 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631801 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 19:22:29.635991 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631804 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 19:22:29.635991 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631807 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 19:22:29.635991 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631810 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 19:22:29.635991 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631813 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 19:22:29.635991 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631815 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 19:22:29.635991 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631817 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 19:22:29.635991 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631821 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 19:22:29.635991 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631823 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 19:22:29.635991 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631825 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 19:22:29.635991 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631828 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 19:22:29.635991 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631830 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 19:22:29.635991 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631833 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 19:22:29.635991 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631835 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 19:22:29.635991 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631838 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 19:22:29.635991 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631840 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 19:22:29.635991 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631843 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 19:22:29.635991 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631845 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 19:22:29.635991 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631848 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 19:22:29.636500 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631850 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 19:22:29.636500 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631855 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 19:22:29.636500 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631858 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 19:22:29.636500 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631860 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 19:22:29.636500 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631863 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 19:22:29.636500 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631865 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 19:22:29.636500 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631868 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 19:22:29.636500 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631871 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 19:22:29.636500 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631873 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 19:22:29.636500 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631877 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 19:22:29.636500 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631880 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 19:22:29.636500 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631882 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 19:22:29.636500 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631885 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 19:22:29.636500 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631887 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 19:22:29.636500 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631890 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 19:22:29.636500 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631892 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 19:22:29.636500 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631895 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 19:22:29.636500 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631898 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 19:22:29.636500 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631900 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 19:22:29.636500 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631902 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 19:22:29.636999 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631905 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 19:22:29.636999 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631908 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 19:22:29.636999 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631911 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 19:22:29.636999 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631913 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 19:22:29.636999 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631916 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 19:22:29.636999 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631918 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 19:22:29.636999 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631921 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 12 19:22:29.636999 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631923 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 19:22:29.636999 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631926 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 19:22:29.636999 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631928 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 19:22:29.636999 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631931 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 19:22:29.636999 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631933 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 19:22:29.636999 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631936 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 19:22:29.636999 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631940 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 19:22:29.636999 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631943 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 19:22:29.636999 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631945 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 19:22:29.636999 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631949 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 19:22:29.636999 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.631952 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 19:22:29.636999 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632021 2558 flags.go:64] FLAG: --address="0.0.0.0" Jun 12 19:22:29.636999 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632028 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632034 2558 flags.go:64] FLAG: --anonymous-auth="true" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632038 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632042 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632045 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632050 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632054 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632057 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632060 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632063 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632066 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632069 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632072 2558 flags.go:64] FLAG: --cgroup-root="" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632075 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632078 2558 flags.go:64] FLAG: --client-ca-file="" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632082 2558 flags.go:64] FLAG: --cloud-provider="external" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632085 2558 flags.go:64] FLAG: --cluster-dns="[]" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632089 2558 flags.go:64] FLAG: --cluster-domain="" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632092 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632095 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632098 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632102 2558 flags.go:64] FLAG: --container-log-max-files="5" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632105 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 12 19:22:29.637491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632108 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632111 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632113 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632121 2558 flags.go:64] FLAG: --contention-profiling="false" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632124 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632127 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632131 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632133 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632137 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632140 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632143 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632146 2558 flags.go:64] FLAG: --enable-load-reader="false" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632149 2558 flags.go:64] FLAG: --enable-server="true" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632151 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632155 2558 flags.go:64] FLAG: --event-burst="100" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632158 2558 flags.go:64] FLAG: --event-qps="50" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632161 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632163 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632166 2558 flags.go:64] FLAG: --eviction-hard="" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632170 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632172 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632175 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632178 2558 flags.go:64] FLAG: --eviction-soft="" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632180 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632183 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 12 19:22:29.638062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632186 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632189 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632192 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632195 2558 flags.go:64] FLAG: --fail-swap-on="true" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632198 2558 flags.go:64] FLAG: --feature-gates="" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632202 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632205 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632207 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632210 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632213 2558 flags.go:64] FLAG: --healthz-port="10248" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632219 2558 flags.go:64] FLAG: --help="false" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632222 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-135-76.ec2.internal" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632225 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632228 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632231 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632234 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632237 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632240 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632243 2558 flags.go:64] FLAG: --image-service-endpoint="" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632246 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632249 2558 flags.go:64] FLAG: --kube-api-burst="100" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632251 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632254 2558 flags.go:64] FLAG: --kube-api-qps="50" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632257 2558 flags.go:64] FLAG: --kube-reserved="" Jun 12 19:22:29.638764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632260 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632263 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632266 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632269 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632271 2558 flags.go:64] FLAG: --lock-file="" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632274 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632277 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632280 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632285 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632288 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632291 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632294 2558 flags.go:64] FLAG: --logging-format="text" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632296 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632300 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632302 2558 flags.go:64] FLAG: --manifest-url="" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632305 2558 flags.go:64] FLAG: --manifest-url-header="" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632309 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632312 2558 flags.go:64] FLAG: --max-open-files="1000000" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632319 2558 flags.go:64] FLAG: --max-pods="110" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632322 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632325 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632328 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632330 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632333 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632336 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 12 19:22:29.639357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632339 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632346 2558 flags.go:64] FLAG: --node-status-max-images="50" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632349 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632352 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632355 2558 flags.go:64] FLAG: --pod-cidr="" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632357 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632362 2558 flags.go:64] FLAG: --pod-manifest-path="" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632365 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632368 2558 flags.go:64] FLAG: --pods-per-core="0" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632371 2558 flags.go:64] FLAG: --port="10250" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632374 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632377 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-050f49239647b7100" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632381 2558 flags.go:64] FLAG: --qos-reserved="" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632384 2558 flags.go:64] FLAG: --read-only-port="10255" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632386 2558 flags.go:64] FLAG: --register-node="true" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632389 2558 flags.go:64] FLAG: --register-with-taints="" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632393 2558 flags.go:64] FLAG: --registry-burst="10" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632396 2558 flags.go:64] FLAG: --registry-qps="5" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632399 2558 flags.go:64] FLAG: --reserved-cpus="" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632402 2558 flags.go:64] FLAG: --reserved-memory="" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632405 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632408 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632411 2558 flags.go:64] FLAG: --rotate-certificates="false" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632414 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632417 2558 flags.go:64] FLAG: --runonce="false" Jun 12 19:22:29.640020 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632421 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632425 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632428 2558 flags.go:64] FLAG: --seccomp-default="false" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632431 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632434 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632436 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632440 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632443 2558 flags.go:64] FLAG: --storage-driver-password="root" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632445 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632448 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632451 2558 flags.go:64] FLAG: --storage-driver-user="root" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632454 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632457 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632460 2558 flags.go:64] FLAG: --system-cgroups="" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632463 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632468 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632471 2558 flags.go:64] FLAG: --tls-cert-file="" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632474 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632485 2558 flags.go:64] FLAG: --tls-min-version="" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632488 2558 flags.go:64] FLAG: --tls-private-key-file="" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632491 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632494 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632496 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632499 2558 flags.go:64] FLAG: --v="2" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632507 2558 flags.go:64] FLAG: --version="false" Jun 12 19:22:29.640639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632512 2558 flags.go:64] FLAG: --vmodule="" Jun 12 19:22:29.641247 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632515 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 12 19:22:29.641247 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632519 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 12 19:22:29.641247 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632650 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 19:22:29.641247 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632656 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 19:22:29.641247 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632660 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 19:22:29.641247 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632663 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 19:22:29.641247 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632668 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 19:22:29.641247 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632672 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 19:22:29.641247 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632675 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 19:22:29.641247 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632679 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 19:22:29.641247 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632682 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 19:22:29.641247 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632685 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 19:22:29.641247 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632688 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 19:22:29.641247 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632691 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 19:22:29.641247 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632693 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 19:22:29.641247 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632696 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 19:22:29.641247 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632698 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 19:22:29.641247 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632701 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 19:22:29.641247 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632704 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 19:22:29.641738 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632706 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 19:22:29.641738 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632709 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 19:22:29.641738 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632711 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 19:22:29.641738 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632714 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 19:22:29.641738 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632716 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 19:22:29.641738 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632719 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 19:22:29.641738 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632721 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 19:22:29.641738 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632724 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 19:22:29.641738 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632726 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 19:22:29.641738 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632729 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 19:22:29.641738 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632731 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 19:22:29.641738 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632733 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 19:22:29.641738 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632736 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 19:22:29.641738 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632739 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 19:22:29.641738 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632741 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 19:22:29.641738 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632744 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 19:22:29.641738 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632747 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 12 19:22:29.641738 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632749 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 19:22:29.641738 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632751 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 19:22:29.641738 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632755 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 19:22:29.642206 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632759 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 19:22:29.642206 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632761 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 19:22:29.642206 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632764 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 19:22:29.642206 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632766 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 19:22:29.642206 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632769 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 19:22:29.642206 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632771 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 19:22:29.642206 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632774 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 19:22:29.642206 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632776 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 19:22:29.642206 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632779 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 19:22:29.642206 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632781 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 19:22:29.642206 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632784 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 19:22:29.642206 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632787 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 19:22:29.642206 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632790 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 19:22:29.642206 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632793 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 19:22:29.642206 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632796 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 19:22:29.642206 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632799 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 19:22:29.642206 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632801 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 19:22:29.642206 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632804 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 19:22:29.642206 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632806 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 19:22:29.642677 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632809 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 19:22:29.642677 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632811 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 19:22:29.642677 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632814 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 19:22:29.642677 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632816 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 19:22:29.642677 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632819 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 19:22:29.642677 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632821 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 19:22:29.642677 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632823 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 19:22:29.642677 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632827 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 19:22:29.642677 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632829 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 19:22:29.642677 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632832 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 19:22:29.642677 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632834 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 19:22:29.642677 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632836 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 19:22:29.642677 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632841 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 19:22:29.642677 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632844 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 19:22:29.642677 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632847 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 19:22:29.642677 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632849 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 19:22:29.642677 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632852 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 19:22:29.642677 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632854 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 19:22:29.642677 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632857 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 19:22:29.642677 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632859 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 19:22:29.643171 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632862 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 19:22:29.643171 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632864 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 19:22:29.643171 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632867 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 19:22:29.643171 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632869 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 19:22:29.643171 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632872 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 19:22:29.643171 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632874 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 19:22:29.643171 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632877 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 19:22:29.643171 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632879 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 19:22:29.643171 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632882 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 19:22:29.643171 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632884 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 19:22:29.643171 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632886 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 19:22:29.643171 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632889 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 19:22:29.643171 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632891 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 19:22:29.643171 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632893 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 19:22:29.643171 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632896 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 19:22:29.643171 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632899 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 19:22:29.643171 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632901 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 19:22:29.643171 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632903 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 19:22:29.643171 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632906 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 19:22:29.643171 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632908 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 19:22:29.643654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632911 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 19:22:29.643654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632914 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 19:22:29.643654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.632916 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 19:22:29.643654 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.632922 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 19:22:29.643654 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.639525 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 12 19:22:29.643654 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.639540 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 12 19:22:29.643654 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.640405 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 12 19:22:29.643654 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.640413 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 12 19:22:29.643654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640486 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 19:22:29.643654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640492 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 19:22:29.643654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640496 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 19:22:29.643654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640499 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 19:22:29.643654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640502 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 19:22:29.643654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640505 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 19:22:29.643654 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640508 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 19:22:29.644024 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640511 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 19:22:29.644024 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640514 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 19:22:29.644024 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640517 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 19:22:29.644024 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640519 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 19:22:29.644024 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640522 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 19:22:29.644024 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640525 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 19:22:29.644024 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640528 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 19:22:29.644024 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640531 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 19:22:29.644024 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640533 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 19:22:29.644024 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640536 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 19:22:29.644024 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640538 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 19:22:29.644024 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640541 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 19:22:29.644024 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640544 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 19:22:29.644024 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640546 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 19:22:29.644024 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640549 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 19:22:29.644024 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640551 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 19:22:29.644024 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640554 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 19:22:29.644024 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640557 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 19:22:29.644024 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640559 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 19:22:29.644024 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640562 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 19:22:29.644493 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640564 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 19:22:29.644493 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640567 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 19:22:29.644493 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640570 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 19:22:29.644493 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640573 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 19:22:29.644493 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640576 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 19:22:29.644493 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640579 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 19:22:29.644493 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640581 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 19:22:29.644493 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640584 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 19:22:29.644493 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640586 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 19:22:29.644493 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640590 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 19:22:29.644493 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640594 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 19:22:29.644493 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640597 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 19:22:29.644493 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640601 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 19:22:29.644493 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640621 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 19:22:29.644493 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640624 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 19:22:29.644493 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640627 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 19:22:29.644493 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640629 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 19:22:29.644493 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640632 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 19:22:29.644493 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640634 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 19:22:29.644977 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640637 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 19:22:29.644977 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640640 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 19:22:29.644977 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640643 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 19:22:29.644977 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640645 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 19:22:29.644977 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640648 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 19:22:29.644977 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640651 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 19:22:29.644977 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640654 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 19:22:29.644977 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640657 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 19:22:29.644977 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640659 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 19:22:29.644977 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640662 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 19:22:29.644977 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640665 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 19:22:29.644977 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640668 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 19:22:29.644977 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640671 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 19:22:29.644977 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640674 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 19:22:29.644977 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640678 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 19:22:29.644977 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640681 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 19:22:29.644977 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640684 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 12 19:22:29.644977 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640687 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 19:22:29.644977 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640690 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 19:22:29.645447 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640693 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 19:22:29.645447 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640695 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 19:22:29.645447 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640698 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 19:22:29.645447 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640700 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 19:22:29.645447 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640702 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 19:22:29.645447 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640705 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 19:22:29.645447 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640708 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 19:22:29.645447 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640710 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 19:22:29.645447 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640713 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 19:22:29.645447 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640715 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 19:22:29.645447 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640718 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 19:22:29.645447 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640720 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 19:22:29.645447 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640723 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 19:22:29.645447 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640725 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 19:22:29.645447 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640728 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 19:22:29.645447 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640730 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 19:22:29.645447 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640732 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 19:22:29.645447 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640735 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 19:22:29.645447 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640737 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 19:22:29.645447 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640740 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 19:22:29.645947 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640742 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 19:22:29.645947 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640744 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 19:22:29.645947 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640747 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 19:22:29.645947 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640749 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 19:22:29.645947 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640752 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 19:22:29.645947 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640755 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 19:22:29.645947 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640758 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 19:22:29.645947 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640760 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 19:22:29.645947 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640763 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 19:22:29.645947 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640766 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 19:22:29.645947 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640768 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 19:22:29.645947 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640771 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 19:22:29.645947 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640773 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 19:22:29.645947 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640775 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 19:22:29.645947 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.640780 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 19:22:29.646316 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640926 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 19:22:29.646316 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640931 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 19:22:29.646316 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640935 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 19:22:29.646316 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640938 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 19:22:29.646316 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640941 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 19:22:29.646316 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640944 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 19:22:29.646316 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640948 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 19:22:29.646316 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640951 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 19:22:29.646316 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640954 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 19:22:29.646316 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640957 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 19:22:29.646316 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640960 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 19:22:29.646316 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640963 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 19:22:29.646316 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640966 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 19:22:29.646316 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640968 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 19:22:29.646316 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640971 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 19:22:29.646316 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640974 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 19:22:29.646316 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640977 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 19:22:29.646316 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640979 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 19:22:29.646316 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640982 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 19:22:29.646791 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640984 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 19:22:29.646791 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640987 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 19:22:29.646791 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640989 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 19:22:29.646791 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.640992 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 19:22:29.646791 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641000 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 19:22:29.646791 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641002 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 19:22:29.646791 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641005 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 19:22:29.646791 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641008 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 19:22:29.646791 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641010 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 19:22:29.646791 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641013 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 19:22:29.646791 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641015 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 19:22:29.646791 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641017 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 19:22:29.646791 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641020 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 19:22:29.646791 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641022 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 19:22:29.646791 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641025 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 19:22:29.646791 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641027 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 19:22:29.646791 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641030 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 19:22:29.646791 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641033 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 19:22:29.646791 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641036 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 19:22:29.647236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641039 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 19:22:29.647236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641041 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 19:22:29.647236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641044 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 19:22:29.647236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641046 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 19:22:29.647236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641048 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 19:22:29.647236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641051 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 19:22:29.647236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641053 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 19:22:29.647236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641056 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 19:22:29.647236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641058 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 19:22:29.647236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641060 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 19:22:29.647236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641063 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 19:22:29.647236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641065 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 19:22:29.647236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641067 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 19:22:29.647236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641070 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 19:22:29.647236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641072 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 19:22:29.647236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641075 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 19:22:29.647236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641077 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 19:22:29.647236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641079 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 19:22:29.647236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641087 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 19:22:29.647236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641089 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 19:22:29.647729 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641092 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 19:22:29.647729 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641095 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 19:22:29.647729 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641097 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 19:22:29.647729 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641100 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 19:22:29.647729 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641102 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 19:22:29.647729 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641104 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 19:22:29.647729 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641107 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 19:22:29.647729 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641109 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 19:22:29.647729 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641112 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 19:22:29.647729 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641114 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 19:22:29.647729 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641116 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 19:22:29.647729 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641119 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 19:22:29.647729 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641121 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 19:22:29.647729 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641131 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 19:22:29.647729 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641134 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 19:22:29.647729 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641136 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 19:22:29.647729 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641139 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 19:22:29.647729 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641141 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 19:22:29.647729 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641143 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 19:22:29.647729 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641146 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 19:22:29.648216 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641148 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 19:22:29.648216 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641151 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 19:22:29.648216 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641153 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 19:22:29.648216 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641156 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 19:22:29.648216 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641158 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 19:22:29.648216 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641161 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 19:22:29.648216 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641163 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 19:22:29.648216 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641166 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 19:22:29.648216 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641168 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 19:22:29.648216 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641170 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 19:22:29.648216 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641173 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 19:22:29.648216 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641181 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 19:22:29.648216 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641188 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 19:22:29.648216 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641190 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 19:22:29.648216 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641193 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 19:22:29.648216 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641196 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 19:22:29.648216 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641198 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 19:22:29.648216 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641200 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 19:22:29.648216 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641203 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 12 19:22:29.648216 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641205 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 19:22:29.648732 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:29.641207 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 19:22:29.648732 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.641212 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 19:22:29.648732 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.641322 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jun 12 19:22:29.648732 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.643425 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 12 19:22:29.648732 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.644549 2558 server.go:1019] "Starting client certificate rotation" Jun 12 19:22:29.648732 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.644664 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 19:22:29.648732 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.644704 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 19:22:29.648732 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.647895 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 19:22:29.650998 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.650979 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 19:22:29.670684 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.670654 2558 log.go:25] "Validated CRI v1 runtime API" Jun 12 19:22:29.673912 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.673896 2558 log.go:25] "Validated CRI v1 image API" Jun 12 19:22:29.674677 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.674657 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 12 19:22:29.676989 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.676970 2558 fs.go:135] Filesystem UUIDs: map[6cabb2cb-f270-4092-8e50-d73c2e3d909b:/dev/nvme0n1p3 6cd3d0c6-9ca7-42c8-a5a5-b8f8babd5cc0:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 12 19:22:29.677053 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.676989 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 12 19:22:29.682537 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.682516 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 19:22:29.683011 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.682900 2558 manager.go:216] Machine: {Timestamp:2026-06-12 19:22:29.681448354 +0000 UTC m=+0.342140309 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096126 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28ead7c2093886c86fb3bff5819e6f SystemUUID:ec28ead7-c209-3886-c86f-b3bff5819e6f BootID:210e1268-c401-4680-b4c3-9c8aec662409 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:85:5e:4d:b8:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:85:5e:4d:b8:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:58:ba:fd:b5:fd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 12 19:22:29.683011 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.683007 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 12 19:22:29.683140 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.683129 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 12 19:22:29.686279 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.686249 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 12 19:22:29.686412 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.686281 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-76.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 12 19:22:29.687171 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.687160 2558 topology_manager.go:138] "Creating topology manager with none policy" Jun 12 19:22:29.687203 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.687173 2558 container_manager_linux.go:309] "Creating device plugin manager" Jun 12 19:22:29.687203 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.687180 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 19:22:29.687912 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.687902 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 19:22:29.689055 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.689043 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 12 19:22:29.692209 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.692196 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 12 19:22:29.692326 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.692317 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 12 19:22:29.692409 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.692348 2558 kubelet.go:486] "Attempting to sync node with API server" Jun 12 19:22:29.692409 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.692357 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 12 19:22:29.692409 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.692377 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 12 19:22:29.692409 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.692388 2558 kubelet.go:398] "Adding apiserver pod source" Jun 12 19:22:29.692409 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.692402 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 12 19:22:29.692840 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.692815 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 19:22:29.692873 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.692853 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 19:22:29.698685 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.698664 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 12 19:22:29.700479 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.700465 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 12 19:22:29.700532 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.700497 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 12 19:22:29.701001 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.700991 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 12 19:22:29.701067 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.701006 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 12 19:22:29.701067 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.701012 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 12 19:22:29.701067 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.701018 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 12 19:22:29.701067 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.701027 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 12 19:22:29.701067 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.701032 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 12 19:22:29.701067 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.701064 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 12 19:22:29.701067 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.701070 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 12 19:22:29.701257 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.701078 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 12 19:22:29.701257 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.701083 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 12 19:22:29.701257 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.701090 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 12 19:22:29.701257 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.701098 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 12 19:22:29.701821 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.701810 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 12 19:22:29.701821 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.701820 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 12 19:22:29.702072 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:29.702048 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-76.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 12 19:22:29.702126 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:29.702055 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 12 19:22:29.704861 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.704841 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nfsmg" Jun 12 19:22:29.704957 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.704886 2558 server.go:1268] "Started kubelet" Jun 12 19:22:29.705015 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.704965 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 12 19:22:29.705110 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.705060 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 12 19:22:29.705167 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.705149 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 12 19:22:29.706070 ip-10-0-135-76 systemd[1]: Started Kubernetes Kubelet. Jun 12 19:22:29.706996 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.706982 2558 server.go:310] "Adding debug handlers to kubelet server" Jun 12 19:22:29.707134 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.707120 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 12 19:22:29.710903 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.710885 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nfsmg" Jun 12 19:22:29.712233 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:29.712213 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 12 19:22:29.714171 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.714154 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 12 19:22:29.714244 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.714175 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 12 19:22:29.714713 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:29.714322 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-76.ec2.internal\" not found" Jun 12 19:22:29.714788 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.714738 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 12 19:22:29.714788 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.714740 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 12 19:22:29.714788 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.714763 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 12 19:22:29.714938 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.714886 2558 reconstruct.go:97] "Volume reconstruction finished" Jun 12 19:22:29.714938 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.714893 2558 reconciler.go:29] "Reconciler: start to sync state" Jun 12 19:22:29.714938 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.714901 2558 factory.go:55] Registering systemd factory Jun 12 19:22:29.714938 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.714917 2558 factory.go:223] Registration of the systemd container factory successfully Jun 12 19:22:29.715176 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.715159 2558 factory.go:153] Registering CRI-O factory Jun 12 19:22:29.715176 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.715177 2558 factory.go:223] Registration of the crio container factory successfully Jun 12 19:22:29.715293 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.715229 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 12 19:22:29.715293 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.715255 2558 factory.go:103] Registering Raw factory Jun 12 19:22:29.715293 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.715269 2558 manager.go:1196] Started watching for new ooms in manager Jun 12 19:22:29.715627 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.715596 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-76.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 12 19:22:29.715726 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.715713 2558 manager.go:349] Starting recovery of all containers Jun 12 19:22:29.718732 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:29.715413 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-76.ec2.internal.18b86bc5c059b971 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-76.ec2.internal,UID:ip-10-0-135-76.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-76.ec2.internal,},FirstTimestamp:2026-06-12 19:22:29.704866161 +0000 UTC m=+0.365558115,LastTimestamp:2026-06-12 19:22:29.704866161 +0000 UTC m=+0.365558115,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-76.ec2.internal,}" Jun 12 19:22:29.724480 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.724456 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 19:22:29.726930 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.726915 2558 manager.go:354] Recovery completed Jun 12 19:22:29.728440 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:29.728423 2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-76.ec2.internal\" not found" node="ip-10-0-135-76.ec2.internal" Jun 12 19:22:29.731312 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.731300 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:22:29.733555 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.733537 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:22:29.733660 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.733573 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:22:29.733660 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.733588 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:22:29.734365 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.734352 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 12 19:22:29.734365 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.734363 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 12 19:22:29.734463 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.734367 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:22:29.734463 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.734379 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 12 19:22:29.735136 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.735118 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:22:29.735202 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.735152 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:22:29.735202 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.735185 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:22:29.735316 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.735303 2558 policy_none.go:49] "None policy: Start" Jun 12 19:22:29.735350 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.735324 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 12 19:22:29.735350 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.735337 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 12 19:22:29.736152 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.736142 2558 policy_none.go:47] "Start" Jun 12 19:22:29.773363 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.773344 2558 manager.go:337] "Starting Device Plugin manager" Jun 12 19:22:29.786956 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:29.773404 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 12 19:22:29.786956 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.773415 2558 server.go:87] "Starting device plugin registration server" Jun 12 19:22:29.786956 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.773736 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 12 19:22:29.786956 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.773748 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 12 19:22:29.786956 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.773818 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 12 19:22:29.786956 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.773896 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 12 19:22:29.786956 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.773903 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 12 19:22:29.786956 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:29.774526 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 12 19:22:29.786956 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:29.774572 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-76.ec2.internal\" not found" Jun 12 19:22:29.786956 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.784559 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 12 19:22:29.786956 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.785859 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 12 19:22:29.786956 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.785895 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 12 19:22:29.786956 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.785920 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jun 12 19:22:29.786956 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:29.785987 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 12 19:22:29.788503 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.788482 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 19:22:29.874817 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.874712 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:22:29.876978 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.876960 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:22:29.877087 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.876997 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:22:29.877087 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.877011 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:22:29.877087 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.877033 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-76.ec2.internal" Jun 12 19:22:29.885867 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.885849 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-76.ec2.internal" Jun 12 19:22:29.885867 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:29.885873 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-76.ec2.internal\": node \"ip-10-0-135-76.ec2.internal\" not found" Jun 12 19:22:29.886079 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.886064 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-76.ec2.internal"] Jun 12 19:22:29.886124 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.886119 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:22:29.887598 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.887579 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:22:29.887685 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.887623 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:22:29.887685 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.887633 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:22:29.888724 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.888712 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:22:29.888893 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.888875 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal" Jun 12 19:22:29.888942 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.888903 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:22:29.889492 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.889476 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:22:29.889562 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.889481 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:22:29.889562 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.889532 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:22:29.889562 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.889544 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:22:29.889562 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.889505 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:22:29.889704 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.889573 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:22:29.890838 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.890823 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-76.ec2.internal" Jun 12 19:22:29.890891 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.890855 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:22:29.891573 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.891560 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:22:29.891639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.891587 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:22:29.891639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.891597 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:22:29.906739 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:29.906716 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-76.ec2.internal\" not found" Jun 12 19:22:29.911250 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:29.911235 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-76.ec2.internal\" not found" node="ip-10-0-135-76.ec2.internal" Jun 12 19:22:29.915450 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:29.915435 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-76.ec2.internal\" not found" node="ip-10-0-135-76.ec2.internal" Jun 12 19:22:29.916507 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.916492 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7214cad85fb5cf585612f0e29bb8de97-config\") pod \"kube-apiserver-proxy-ip-10-0-135-76.ec2.internal\" (UID: \"7214cad85fb5cf585612f0e29bb8de97\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-76.ec2.internal" Jun 12 19:22:29.916558 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.916515 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7c496f0235050f441e84d7bc2bf2eab6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal\" (UID: \"7c496f0235050f441e84d7bc2bf2eab6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal" Jun 12 19:22:29.916558 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:29.916539 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c496f0235050f441e84d7bc2bf2eab6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal\" (UID: \"7c496f0235050f441e84d7bc2bf2eab6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal" Jun 12 19:22:30.006807 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:30.006771 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-76.ec2.internal\" not found" Jun 12 19:22:30.017018 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.016990 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7214cad85fb5cf585612f0e29bb8de97-config\") pod \"kube-apiserver-proxy-ip-10-0-135-76.ec2.internal\" (UID: \"7214cad85fb5cf585612f0e29bb8de97\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-76.ec2.internal" Jun 12 19:22:30.017133 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.017028 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7c496f0235050f441e84d7bc2bf2eab6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal\" (UID: \"7c496f0235050f441e84d7bc2bf2eab6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal" Jun 12 19:22:30.017133 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.017053 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c496f0235050f441e84d7bc2bf2eab6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal\" (UID: \"7c496f0235050f441e84d7bc2bf2eab6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal" Jun 12 19:22:30.017133 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.017093 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7214cad85fb5cf585612f0e29bb8de97-config\") pod \"kube-apiserver-proxy-ip-10-0-135-76.ec2.internal\" (UID: \"7214cad85fb5cf585612f0e29bb8de97\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-76.ec2.internal" Jun 12 19:22:30.017133 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.017120 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7c496f0235050f441e84d7bc2bf2eab6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal\" (UID: \"7c496f0235050f441e84d7bc2bf2eab6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal" Jun 12 19:22:30.017280 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.017107 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c496f0235050f441e84d7bc2bf2eab6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal\" (UID: \"7c496f0235050f441e84d7bc2bf2eab6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal" Jun 12 19:22:30.107862 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:30.107824 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-76.ec2.internal\" not found" Jun 12 19:22:30.208554 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:30.208477 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-76.ec2.internal\" not found" Jun 12 19:22:30.213697 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.213662 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal" Jun 12 19:22:30.218330 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.218314 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-76.ec2.internal" Jun 12 19:22:30.309718 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:30.309519 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-76.ec2.internal\" not found" Jun 12 19:22:30.410084 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:30.410061 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-76.ec2.internal\" not found" Jun 12 19:22:30.510618 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:30.510575 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-76.ec2.internal\" not found" Jun 12 19:22:30.537970 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.537945 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 19:22:30.556644 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.556600 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 19:22:30.615199 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.615171 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-76.ec2.internal" Jun 12 19:22:30.631583 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.631563 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 19:22:30.632447 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.632432 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal" Jun 12 19:22:30.644071 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.644050 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 12 19:22:30.644255 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.644223 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 19:22:30.644255 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.644233 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 19:22:30.644255 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.644224 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 19:22:30.644459 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.644252 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 19:22:30.644459 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:30.644263 2558 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://a069988098f5b426c9b4aa04f0d3d9d5-835d16377cb81df5.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.135.76:52012->100.57.210.81:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal" Jun 12 19:22:30.693405 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.693370 2558 apiserver.go:52] "Watching apiserver" Jun 12 19:22:30.709845 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.709435 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 12 19:22:30.711446 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.711417 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-vkjc9","openshift-dns/node-resolver-xfm4h","openshift-image-registry/node-ca-kvspx","openshift-multus/multus-4wt2m","openshift-network-diagnostics/network-check-target-mww4t","openshift-network-operator/iptables-alerter-9pbbd","kube-system/global-pull-secret-syncer-j8228","kube-system/kube-apiserver-proxy-ip-10-0-135-76.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm","openshift-cluster-node-tuning-operator/tuned-frvtc","openshift-multus/multus-additional-cni-plugins-wdl8m","openshift-multus/network-metrics-daemon-k6wxl","openshift-ovn-kubernetes/ovnkube-node-r4ck7"] Jun 12 19:22:30.712794 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.712770 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vkjc9" Jun 12 19:22:30.714342 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.714066 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xfm4h" Jun 12 19:22:30.714547 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.714531 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 12 19:22:30.715361 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.715187 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-11 19:17:29 +0000 UTC" deadline="2028-01-07 07:52:05.435101172 +0000 UTC" Jun 12 19:22:30.715361 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.715231 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13764h29m34.719873682s" Jun 12 19:22:30.716087 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.715714 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 12 19:22:30.716852 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.716541 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 12 19:22:30.716852 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.716702 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wr4fj\"" Jun 12 19:22:30.717219 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.717200 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.717790 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.717771 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zfqd8\"" Jun 12 19:22:30.717992 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.717973 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 12 19:22:30.718089 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.718007 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 12 19:22:30.718961 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.718946 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:30.719029 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:30.719008 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6wxl" podUID="6ab368bb-96f3-41d1-9e60-6f404ee5802a" Jun 12 19:22:30.720253 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720239 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.720491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720471 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-cni-netd\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.720619 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720519 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-run-ovn\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.720619 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720550 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-log-socket\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.720619 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720568 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-cni-bin\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.720619 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720582 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.720619 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720597 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7069475a-78c9-4feb-a9b4-f4099f73a3d7-env-overrides\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.720774 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720644 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7069475a-78c9-4feb-a9b4-f4099f73a3d7-ovnkube-script-lib\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.720774 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720666 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-kubelet\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.720774 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720680 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-run-netns\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.720774 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720694 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-var-lib-openvswitch\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.720774 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720708 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.720774 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720759 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7069475a-78c9-4feb-a9b4-f4099f73a3d7-ovnkube-config\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.720972 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720800 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7069475a-78c9-4feb-a9b4-f4099f73a3d7-ovn-node-metrics-cert\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.720972 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720827 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2813bc5-36e5-4b5e-a3b4-19aeafb3f656-konnectivity-ca\") pod \"konnectivity-agent-vkjc9\" (UID: \"d2813bc5-36e5-4b5e-a3b4-19aeafb3f656\") " pod="kube-system/konnectivity-agent-vkjc9" Jun 12 19:22:30.720972 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720848 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/330b534e-744d-45f2-9c04-255693d72982-hosts-file\") pod \"node-resolver-xfm4h\" (UID: \"330b534e-744d-45f2-9c04-255693d72982\") " pod="openshift-dns/node-resolver-xfm4h" Jun 12 19:22:30.720972 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720871 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbp87\" (UniqueName: \"kubernetes.io/projected/330b534e-744d-45f2-9c04-255693d72982-kube-api-access-wbp87\") pod \"node-resolver-xfm4h\" (UID: \"330b534e-744d-45f2-9c04-255693d72982\") " pod="openshift-dns/node-resolver-xfm4h" Jun 12 19:22:30.720972 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720893 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-systemd-units\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.720972 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720915 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-run-openvswitch\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.720972 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720936 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnqfj\" (UniqueName: \"kubernetes.io/projected/7069475a-78c9-4feb-a9b4-f4099f73a3d7-kube-api-access-xnqfj\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.720972 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720961 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2813bc5-36e5-4b5e-a3b4-19aeafb3f656-agent-certs\") pod \"konnectivity-agent-vkjc9\" (UID: \"d2813bc5-36e5-4b5e-a3b4-19aeafb3f656\") " pod="kube-system/konnectivity-agent-vkjc9" Jun 12 19:22:30.721213 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.720987 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/330b534e-744d-45f2-9c04-255693d72982-tmp-dir\") pod \"node-resolver-xfm4h\" (UID: \"330b534e-744d-45f2-9c04-255693d72982\") " pod="openshift-dns/node-resolver-xfm4h" Jun 12 19:22:30.721213 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.721008 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-slash\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.721213 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.721029 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-run-systemd\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.721213 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.721047 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-etc-openvswitch\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.721213 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.721061 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-node-log\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.721432 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.721383 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9pbbd" Jun 12 19:22:30.722547 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.722528 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:30.722648 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:30.722580 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8228" podUID="41a1faa1-36af-4860-ad2c-d355620f8ec0" Jun 12 19:22:30.723681 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.723666 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:30.723766 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:30.723712 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mww4t" podUID="dc6a1d8d-5158-42f3-90ab-df432dd6ef0a" Jun 12 19:22:30.724900 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.724881 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.726192 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.726173 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.726523 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.726419 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 12 19:22:30.727456 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.727437 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.727564 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.727547 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 12 19:22:30.727712 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.727574 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 12 19:22:30.727712 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.727638 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 12 19:22:30.727894 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.727878 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 12 19:22:30.727952 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.727879 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 12 19:22:30.727952 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.727942 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 12 19:22:30.728073 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.727877 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 12 19:22:30.728073 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.727978 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 12 19:22:30.728198 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.728183 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wkzd6\"" Jun 12 19:22:30.728810 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.728719 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 12 19:22:30.728810 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.728750 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 12 19:22:30.728974 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.728959 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kvspx" Jun 12 19:22:30.731875 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.731859 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tl6nd\"" Jun 12 19:22:30.732309 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.732294 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 12 19:22:30.732397 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.732380 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 12 19:22:30.732665 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.732631 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 12 19:22:30.732665 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.732645 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 12 19:22:30.732777 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.732694 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 12 19:22:30.732777 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.732696 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 12 19:22:30.733036 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.733018 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q885r\"" Jun 12 19:22:30.733036 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.733031 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rlmh6\"" Jun 12 19:22:30.733150 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.733134 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 12 19:22:30.733150 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.733144 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ndq5l\"" Jun 12 19:22:30.733243 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.733212 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 12 19:22:30.733243 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.733233 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-894wk\"" Jun 12 19:22:30.733339 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.733246 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 12 19:22:30.733339 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.733260 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 12 19:22:30.733339 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.733266 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 12 19:22:30.733339 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.733324 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9jf4p\"" Jun 12 19:22:30.737710 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.737693 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 12 19:22:30.740433 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.740415 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 19:22:30.769094 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.769065 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zfjpn" Jun 12 19:22:30.780917 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:30.780890 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c496f0235050f441e84d7bc2bf2eab6.slice/crio-949fe207814ab2b9541b1fd2741e11747345e49efce3351132869358e3023f06 WatchSource:0}: Error finding container 949fe207814ab2b9541b1fd2741e11747345e49efce3351132869358e3023f06: Status 404 returned error can't find the container with id 949fe207814ab2b9541b1fd2741e11747345e49efce3351132869358e3023f06 Jun 12 19:22:30.781114 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:30.781094 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7214cad85fb5cf585612f0e29bb8de97.slice/crio-e7beab7d8eee8ea103372ce703fcb3e356ee2e8dcb84fe0a08cbc2971441c8f8 WatchSource:0}: Error finding container e7beab7d8eee8ea103372ce703fcb3e356ee2e8dcb84fe0a08cbc2971441c8f8: Status 404 returned error can't find the container with id e7beab7d8eee8ea103372ce703fcb3e356ee2e8dcb84fe0a08cbc2971441c8f8 Jun 12 19:22:30.784011 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.783985 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zfjpn" Jun 12 19:22:30.786012 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.785994 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 19:22:30.790376 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.790338 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-76.ec2.internal" event={"ID":"7214cad85fb5cf585612f0e29bb8de97","Type":"ContainerStarted","Data":"e7beab7d8eee8ea103372ce703fcb3e356ee2e8dcb84fe0a08cbc2971441c8f8"} Jun 12 19:22:30.791652 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.791626 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal" event={"ID":"7c496f0235050f441e84d7bc2bf2eab6","Type":"ContainerStarted","Data":"949fe207814ab2b9541b1fd2741e11747345e49efce3351132869358e3023f06"} Jun 12 19:22:30.815666 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.815651 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 12 19:22:30.822073 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822048 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-host-var-lib-cni-bin\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.822168 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822080 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-run-systemd\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.822168 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822100 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41a1faa1-36af-4860-ad2c-d355620f8ec0-kubelet-config\") pod \"global-pull-secret-syncer-j8228\" (UID: \"41a1faa1-36af-4860-ad2c-d355620f8ec0\") " pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:30.822168 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822116 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-cni-binary-copy\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.822168 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822134 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-host-run-k8s-cni-cncf-io\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.822168 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822157 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-host-var-lib-kubelet\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.822334 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822171 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-run-systemd\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.822334 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822180 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a3407af-1617-4eaf-b76b-cee74b3ef99d-system-cni-dir\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.822334 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822213 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-cni-bin\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.822334 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822234 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55643173-952d-4b6c-bdb8-4577576de242-registration-dir\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.822334 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822278 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r54w\" (UniqueName: \"kubernetes.io/projected/f71a8194-9226-4248-b129-cc4d766eeaef-kube-api-access-6r54w\") pod \"iptables-alerter-9pbbd\" (UID: \"f71a8194-9226-4248-b129-cc4d766eeaef\") " pod="openshift-network-operator/iptables-alerter-9pbbd" Jun 12 19:22:30.822334 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822296 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-sysctl-d\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.822334 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822301 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-cni-bin\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.822334 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822315 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-host\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.822334 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822331 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-host-var-lib-cni-multus\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.822599 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822345 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n56qt\" (UniqueName: \"kubernetes.io/projected/511e63fc-f11c-4ad3-a034-e1676b53dece-kube-api-access-n56qt\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.822599 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822370 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-kubelet\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.822599 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822391 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-run-netns\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.822599 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822407 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55643173-952d-4b6c-bdb8-4577576de242-socket-dir\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.822599 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822420 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55643173-952d-4b6c-bdb8-4577576de242-device-dir\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.822599 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822436 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-sysctl-conf\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.822599 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822457 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-run-netns\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.822599 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822459 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-host-run-netns\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.822599 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822490 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh76z\" (UniqueName: \"kubernetes.io/projected/3d5ca329-7e77-4d1a-9066-4f2e999eed4f-kube-api-access-sh76z\") pod \"node-ca-kvspx\" (UID: \"3d5ca329-7e77-4d1a-9066-4f2e999eed4f\") " pod="openshift-image-registry/node-ca-kvspx" Jun 12 19:22:30.822599 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822517 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/330b534e-744d-45f2-9c04-255693d72982-hosts-file\") pod \"node-resolver-xfm4h\" (UID: \"330b534e-744d-45f2-9c04-255693d72982\") " pod="openshift-dns/node-resolver-xfm4h" Jun 12 19:22:30.822599 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822533 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-systemd-units\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.822599 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822495 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-kubelet\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.822599 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822547 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-run\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.822599 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822585 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-systemd-units\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.822599 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822596 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-sys\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.823128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822619 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/330b534e-744d-45f2-9c04-255693d72982-hosts-file\") pod \"node-resolver-xfm4h\" (UID: \"330b534e-744d-45f2-9c04-255693d72982\") " pod="openshift-dns/node-resolver-xfm4h" Jun 12 19:22:30.823128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822647 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-os-release\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.823128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822673 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2813bc5-36e5-4b5e-a3b4-19aeafb3f656-agent-certs\") pod \"konnectivity-agent-vkjc9\" (UID: \"d2813bc5-36e5-4b5e-a3b4-19aeafb3f656\") " pod="kube-system/konnectivity-agent-vkjc9" Jun 12 19:22:30.823128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822690 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/330b534e-744d-45f2-9c04-255693d72982-tmp-dir\") pod \"node-resolver-xfm4h\" (UID: \"330b534e-744d-45f2-9c04-255693d72982\") " pod="openshift-dns/node-resolver-xfm4h" Jun 12 19:22:30.823128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822706 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-cni-netd\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.823128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822722 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-hostroot\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.823128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822737 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtz74\" (UniqueName: \"kubernetes.io/projected/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-kube-api-access-xtz74\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.823128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822751 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-run-ovn\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.823128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822767 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.823128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822782 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7069475a-78c9-4feb-a9b4-f4099f73a3d7-ovnkube-script-lib\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.823128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822826 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f71a8194-9226-4248-b129-cc4d766eeaef-iptables-alerter-script\") pod \"iptables-alerter-9pbbd\" (UID: \"f71a8194-9226-4248-b129-cc4d766eeaef\") " pod="openshift-network-operator/iptables-alerter-9pbbd" Jun 12 19:22:30.823128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822840 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-run-ovn\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.823128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822855 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41a1faa1-36af-4860-ad2c-d355620f8ec0-dbus\") pod \"global-pull-secret-syncer-j8228\" (UID: \"41a1faa1-36af-4860-ad2c-d355620f8ec0\") " pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:30.823128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822879 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-kubernetes\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.823128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822886 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-cni-netd\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.823128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822842 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.823128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822902 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-multus-socket-dir-parent\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.823869 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822929 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7069475a-78c9-4feb-a9b4-f4099f73a3d7-ovn-node-metrics-cert\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.823869 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822954 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/330b534e-744d-45f2-9c04-255693d72982-tmp-dir\") pod \"node-resolver-xfm4h\" (UID: \"330b534e-744d-45f2-9c04-255693d72982\") " pod="openshift-dns/node-resolver-xfm4h" Jun 12 19:22:30.823869 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.822979 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-lib-modules\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.823869 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823102 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-multus-cni-dir\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.823869 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823140 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-etc-openvswitch\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.823869 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823102 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 12 19:22:30.823869 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823166 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-node-log\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.823869 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823191 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnqfj\" (UniqueName: \"kubernetes.io/projected/7069475a-78c9-4feb-a9b4-f4099f73a3d7-kube-api-access-xnqfj\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.823869 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823187 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-etc-openvswitch\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.823869 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823219 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a3407af-1617-4eaf-b76b-cee74b3ef99d-cnibin\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.823869 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823241 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a3407af-1617-4eaf-b76b-cee74b3ef99d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.823869 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823241 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-node-log\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.823869 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823264 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86rzp\" (UniqueName: \"kubernetes.io/projected/2a3407af-1617-4eaf-b76b-cee74b3ef99d-kube-api-access-86rzp\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.823869 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823301 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-log-socket\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.823869 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823329 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f71a8194-9226-4248-b129-cc4d766eeaef-host-slash\") pod \"iptables-alerter-9pbbd\" (UID: \"f71a8194-9226-4248-b129-cc4d766eeaef\") " pod="openshift-network-operator/iptables-alerter-9pbbd" Jun 12 19:22:30.823869 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823346 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7069475a-78c9-4feb-a9b4-f4099f73a3d7-ovnkube-script-lib\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.823869 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823349 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-log-socket\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.824510 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823352 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-modprobe-d\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.824510 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823441 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-system-cni-dir\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.824510 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823469 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7069475a-78c9-4feb-a9b4-f4099f73a3d7-ovnkube-config\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.824510 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823485 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/511e63fc-f11c-4ad3-a034-e1676b53dece-tmp\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.824510 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823500 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-multus-daemon-config\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.824510 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823514 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plk5b\" (UniqueName: \"kubernetes.io/projected/6ab368bb-96f3-41d1-9e60-6f404ee5802a-kube-api-access-plk5b\") pod \"network-metrics-daemon-k6wxl\" (UID: \"6ab368bb-96f3-41d1-9e60-6f404ee5802a\") " pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:30.824510 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823530 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a3407af-1617-4eaf-b76b-cee74b3ef99d-cni-binary-copy\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.824510 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823551 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbp87\" (UniqueName: \"kubernetes.io/projected/330b534e-744d-45f2-9c04-255693d72982-kube-api-access-wbp87\") pod \"node-resolver-xfm4h\" (UID: \"330b534e-744d-45f2-9c04-255693d72982\") " pod="openshift-dns/node-resolver-xfm4h" Jun 12 19:22:30.824510 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823586 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-run-openvswitch\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.824510 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823655 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55643173-952d-4b6c-bdb8-4577576de242-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.824510 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823665 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-run-openvswitch\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.824510 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823690 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-sysconfig\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.824510 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823714 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-systemd\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.824510 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823736 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-multus-conf-dir\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.824510 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823755 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-host-run-multus-certs\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.824510 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823777 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs\") pod \"network-metrics-daemon-k6wxl\" (UID: \"6ab368bb-96f3-41d1-9e60-6f404ee5802a\") " pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:30.824510 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823803 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-slash\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.825051 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823825 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48d6b\" (UniqueName: \"kubernetes.io/projected/55643173-952d-4b6c-bdb8-4577576de242-kube-api-access-48d6b\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.825051 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823834 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-slash\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.825051 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823845 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a3407af-1617-4eaf-b76b-cee74b3ef99d-os-release\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.825051 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823869 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a3407af-1617-4eaf-b76b-cee74b3ef99d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.825051 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823893 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a3407af-1617-4eaf-b76b-cee74b3ef99d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.825051 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823914 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3d5ca329-7e77-4d1a-9066-4f2e999eed4f-serviceca\") pod \"node-ca-kvspx\" (UID: \"3d5ca329-7e77-4d1a-9066-4f2e999eed4f\") " pod="openshift-image-registry/node-ca-kvspx" Jun 12 19:22:30.825051 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823931 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7069475a-78c9-4feb-a9b4-f4099f73a3d7-env-overrides\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.825051 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823948 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55643173-952d-4b6c-bdb8-4577576de242-etc-selinux\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.825051 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823948 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7069475a-78c9-4feb-a9b4-f4099f73a3d7-ovnkube-config\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.825051 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823971 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55643173-952d-4b6c-bdb8-4577576de242-sys-fs\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.825051 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823986 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret\") pod \"global-pull-secret-syncer-j8228\" (UID: \"41a1faa1-36af-4860-ad2c-d355620f8ec0\") " pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:30.825051 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.823999 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-tuned\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.825051 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.824016 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-cnibin\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.825051 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.824036 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgcjg\" (UniqueName: \"kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg\") pod \"network-check-target-mww4t\" (UID: \"dc6a1d8d-5158-42f3-90ab-df432dd6ef0a\") " pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:30.825051 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.824052 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-var-lib-openvswitch\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.825051 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.824070 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.825498 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.824107 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-var-lib-kubelet\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.825498 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.824115 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-var-lib-openvswitch\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.825498 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.824128 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-etc-kubernetes\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.825498 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.824110 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7069475a-78c9-4feb-a9b4-f4099f73a3d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.825498 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.824157 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d5ca329-7e77-4d1a-9066-4f2e999eed4f-host\") pod \"node-ca-kvspx\" (UID: \"3d5ca329-7e77-4d1a-9066-4f2e999eed4f\") " pod="openshift-image-registry/node-ca-kvspx" Jun 12 19:22:30.825498 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.824183 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2813bc5-36e5-4b5e-a3b4-19aeafb3f656-konnectivity-ca\") pod \"konnectivity-agent-vkjc9\" (UID: \"d2813bc5-36e5-4b5e-a3b4-19aeafb3f656\") " pod="kube-system/konnectivity-agent-vkjc9" Jun 12 19:22:30.825498 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.824300 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7069475a-78c9-4feb-a9b4-f4099f73a3d7-env-overrides\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.825498 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.824549 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2813bc5-36e5-4b5e-a3b4-19aeafb3f656-konnectivity-ca\") pod \"konnectivity-agent-vkjc9\" (UID: \"d2813bc5-36e5-4b5e-a3b4-19aeafb3f656\") " pod="kube-system/konnectivity-agent-vkjc9" Jun 12 19:22:30.826753 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.826738 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7069475a-78c9-4feb-a9b4-f4099f73a3d7-ovn-node-metrics-cert\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.826838 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.826824 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2813bc5-36e5-4b5e-a3b4-19aeafb3f656-agent-certs\") pod \"konnectivity-agent-vkjc9\" (UID: \"d2813bc5-36e5-4b5e-a3b4-19aeafb3f656\") " pod="kube-system/konnectivity-agent-vkjc9" Jun 12 19:22:30.836009 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.835988 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnqfj\" (UniqueName: \"kubernetes.io/projected/7069475a-78c9-4feb-a9b4-f4099f73a3d7-kube-api-access-xnqfj\") pod \"ovnkube-node-r4ck7\" (UID: \"7069475a-78c9-4feb-a9b4-f4099f73a3d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:30.837785 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.837769 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbp87\" (UniqueName: \"kubernetes.io/projected/330b534e-744d-45f2-9c04-255693d72982-kube-api-access-wbp87\") pod \"node-resolver-xfm4h\" (UID: \"330b534e-744d-45f2-9c04-255693d72982\") " pod="openshift-dns/node-resolver-xfm4h" Jun 12 19:22:30.924754 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.924722 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n56qt\" (UniqueName: \"kubernetes.io/projected/511e63fc-f11c-4ad3-a034-e1676b53dece-kube-api-access-n56qt\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.924754 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.924757 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55643173-952d-4b6c-bdb8-4577576de242-socket-dir\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.925033 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.924775 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55643173-952d-4b6c-bdb8-4577576de242-device-dir\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.925033 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.924792 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-sysctl-conf\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.925033 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.924812 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-host-run-netns\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.925033 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.924836 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh76z\" (UniqueName: \"kubernetes.io/projected/3d5ca329-7e77-4d1a-9066-4f2e999eed4f-kube-api-access-sh76z\") pod \"node-ca-kvspx\" (UID: \"3d5ca329-7e77-4d1a-9066-4f2e999eed4f\") " pod="openshift-image-registry/node-ca-kvspx" Jun 12 19:22:30.925033 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.924872 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55643173-952d-4b6c-bdb8-4577576de242-device-dir\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.925033 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.924891 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-host-run-netns\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.925033 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.924935 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-run\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.925033 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.924964 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-sys\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.925033 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.924978 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-sysctl-conf\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.925033 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.924960 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55643173-952d-4b6c-bdb8-4577576de242-socket-dir\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.925033 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925014 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-sys\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.925033 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.924985 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-os-release\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.925033 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925026 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-os-release\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.925509 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925054 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-hostroot\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.925509 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925004 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-run\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.925509 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925084 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtz74\" (UniqueName: \"kubernetes.io/projected/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-kube-api-access-xtz74\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.925509 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925114 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f71a8194-9226-4248-b129-cc4d766eeaef-iptables-alerter-script\") pod \"iptables-alerter-9pbbd\" (UID: \"f71a8194-9226-4248-b129-cc4d766eeaef\") " pod="openshift-network-operator/iptables-alerter-9pbbd" Jun 12 19:22:30.925509 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925122 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-hostroot\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.925509 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925137 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41a1faa1-36af-4860-ad2c-d355620f8ec0-dbus\") pod \"global-pull-secret-syncer-j8228\" (UID: \"41a1faa1-36af-4860-ad2c-d355620f8ec0\") " pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:30.925509 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925158 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-kubernetes\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.925509 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925180 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-multus-socket-dir-parent\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.925509 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925202 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41a1faa1-36af-4860-ad2c-d355620f8ec0-dbus\") pod \"global-pull-secret-syncer-j8228\" (UID: \"41a1faa1-36af-4860-ad2c-d355620f8ec0\") " pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:30.925509 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925235 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-multus-socket-dir-parent\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.925509 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925229 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-kubernetes\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.925509 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925267 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-lib-modules\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.925509 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925313 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-multus-cni-dir\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.925509 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925354 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-lib-modules\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.925509 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925363 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a3407af-1617-4eaf-b76b-cee74b3ef99d-cnibin\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.925509 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925395 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-multus-cni-dir\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.925509 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925390 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a3407af-1617-4eaf-b76b-cee74b3ef99d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.925509 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925402 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2a3407af-1617-4eaf-b76b-cee74b3ef99d-cnibin\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.926357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925423 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86rzp\" (UniqueName: \"kubernetes.io/projected/2a3407af-1617-4eaf-b76b-cee74b3ef99d-kube-api-access-86rzp\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.926357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925444 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f71a8194-9226-4248-b129-cc4d766eeaef-host-slash\") pod \"iptables-alerter-9pbbd\" (UID: \"f71a8194-9226-4248-b129-cc4d766eeaef\") " pod="openshift-network-operator/iptables-alerter-9pbbd" Jun 12 19:22:30.926357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925459 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-modprobe-d\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.926357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925472 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-system-cni-dir\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.926357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925486 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/511e63fc-f11c-4ad3-a034-e1676b53dece-tmp\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.926357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925500 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-multus-daemon-config\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.926357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925511 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f71a8194-9226-4248-b129-cc4d766eeaef-host-slash\") pod \"iptables-alerter-9pbbd\" (UID: \"f71a8194-9226-4248-b129-cc4d766eeaef\") " pod="openshift-network-operator/iptables-alerter-9pbbd" Jun 12 19:22:30.926357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925525 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plk5b\" (UniqueName: \"kubernetes.io/projected/6ab368bb-96f3-41d1-9e60-6f404ee5802a-kube-api-access-plk5b\") pod \"network-metrics-daemon-k6wxl\" (UID: \"6ab368bb-96f3-41d1-9e60-6f404ee5802a\") " pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:30.926357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925541 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-system-cni-dir\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.926357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925548 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a3407af-1617-4eaf-b76b-cee74b3ef99d-cni-binary-copy\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.926357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925583 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55643173-952d-4b6c-bdb8-4577576de242-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.926357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925595 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-modprobe-d\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.926357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925627 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-sysconfig\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.926357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925651 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-systemd\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.926357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925659 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55643173-952d-4b6c-bdb8-4577576de242-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.926357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925672 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-multus-conf-dir\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.926357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925700 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-sysconfig\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.927075 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925754 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-systemd\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.927075 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925754 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f71a8194-9226-4248-b129-cc4d766eeaef-iptables-alerter-script\") pod \"iptables-alerter-9pbbd\" (UID: \"f71a8194-9226-4248-b129-cc4d766eeaef\") " pod="openshift-network-operator/iptables-alerter-9pbbd" Jun 12 19:22:30.927075 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925799 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-host-run-multus-certs\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.927075 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925836 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs\") pod \"network-metrics-daemon-k6wxl\" (UID: \"6ab368bb-96f3-41d1-9e60-6f404ee5802a\") " pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:30.927075 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925866 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-multus-conf-dir\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.927075 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925868 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48d6b\" (UniqueName: \"kubernetes.io/projected/55643173-952d-4b6c-bdb8-4577576de242-kube-api-access-48d6b\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.927075 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925902 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a3407af-1617-4eaf-b76b-cee74b3ef99d-os-release\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.927075 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925925 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a3407af-1617-4eaf-b76b-cee74b3ef99d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.927075 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925950 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a3407af-1617-4eaf-b76b-cee74b3ef99d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.927075 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925974 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3d5ca329-7e77-4d1a-9066-4f2e999eed4f-serviceca\") pod \"node-ca-kvspx\" (UID: \"3d5ca329-7e77-4d1a-9066-4f2e999eed4f\") " pod="openshift-image-registry/node-ca-kvspx" Jun 12 19:22:30.927075 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925981 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2a3407af-1617-4eaf-b76b-cee74b3ef99d-os-release\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.927075 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.925998 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55643173-952d-4b6c-bdb8-4577576de242-etc-selinux\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.927075 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926013 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2a3407af-1617-4eaf-b76b-cee74b3ef99d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.927075 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926027 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55643173-952d-4b6c-bdb8-4577576de242-sys-fs\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.927075 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926052 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret\") pod \"global-pull-secret-syncer-j8228\" (UID: \"41a1faa1-36af-4860-ad2c-d355620f8ec0\") " pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:30.927075 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926077 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2a3407af-1617-4eaf-b76b-cee74b3ef99d-cni-binary-copy\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.927075 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926091 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-host-run-multus-certs\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.927632 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:30.926135 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:22:30.927632 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926150 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55643173-952d-4b6c-bdb8-4577576de242-etc-selinux\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.927632 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:30.926155 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:22:30.927632 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:30.926195 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret podName:41a1faa1-36af-4860-ad2c-d355620f8ec0 nodeName:}" failed. No retries permitted until 2026-06-12 19:22:31.426174798 +0000 UTC m=+2.086866754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret") pod "global-pull-secret-syncer-j8228" (UID: "41a1faa1-36af-4860-ad2c-d355620f8ec0") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:22:30.927632 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926198 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55643173-952d-4b6c-bdb8-4577576de242-sys-fs\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.927632 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:30.926225 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs podName:6ab368bb-96f3-41d1-9e60-6f404ee5802a nodeName:}" failed. No retries permitted until 2026-06-12 19:22:31.426208878 +0000 UTC m=+2.086900818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs") pod "network-metrics-daemon-k6wxl" (UID: "6ab368bb-96f3-41d1-9e60-6f404ee5802a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:22:30.927632 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926256 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-multus-daemon-config\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.927632 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926259 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-tuned\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.927632 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926299 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-cnibin\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.927632 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926335 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgcjg\" (UniqueName: \"kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg\") pod \"network-check-target-mww4t\" (UID: \"dc6a1d8d-5158-42f3-90ab-df432dd6ef0a\") " pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:30.927632 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926360 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-var-lib-kubelet\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.927632 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926389 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2a3407af-1617-4eaf-b76b-cee74b3ef99d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.927632 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926390 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-etc-kubernetes\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.927632 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926422 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-etc-kubernetes\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.927632 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926434 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d5ca329-7e77-4d1a-9066-4f2e999eed4f-host\") pod \"node-ca-kvspx\" (UID: \"3d5ca329-7e77-4d1a-9066-4f2e999eed4f\") " pod="openshift-image-registry/node-ca-kvspx" Jun 12 19:22:30.927632 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926436 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3d5ca329-7e77-4d1a-9066-4f2e999eed4f-serviceca\") pod \"node-ca-kvspx\" (UID: \"3d5ca329-7e77-4d1a-9066-4f2e999eed4f\") " pod="openshift-image-registry/node-ca-kvspx" Jun 12 19:22:30.927632 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926460 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-host-var-lib-cni-bin\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.928138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926469 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-var-lib-kubelet\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.928138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926493 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d5ca329-7e77-4d1a-9066-4f2e999eed4f-host\") pod \"node-ca-kvspx\" (UID: \"3d5ca329-7e77-4d1a-9066-4f2e999eed4f\") " pod="openshift-image-registry/node-ca-kvspx" Jun 12 19:22:30.928138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926511 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41a1faa1-36af-4860-ad2c-d355620f8ec0-kubelet-config\") pod \"global-pull-secret-syncer-j8228\" (UID: \"41a1faa1-36af-4860-ad2c-d355620f8ec0\") " pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:30.928138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926538 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-cni-binary-copy\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.928138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926513 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-host-var-lib-cni-bin\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.928138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926563 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-host-run-k8s-cni-cncf-io\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.928138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926571 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41a1faa1-36af-4860-ad2c-d355620f8ec0-kubelet-config\") pod \"global-pull-secret-syncer-j8228\" (UID: \"41a1faa1-36af-4860-ad2c-d355620f8ec0\") " pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:30.928138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926586 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-host-var-lib-kubelet\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.928138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926632 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a3407af-1617-4eaf-b76b-cee74b3ef99d-system-cni-dir\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.928138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926637 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-host-run-k8s-cni-cncf-io\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.928138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926662 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55643173-952d-4b6c-bdb8-4577576de242-registration-dir\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.928138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926687 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r54w\" (UniqueName: \"kubernetes.io/projected/f71a8194-9226-4248-b129-cc4d766eeaef-kube-api-access-6r54w\") pod \"iptables-alerter-9pbbd\" (UID: \"f71a8194-9226-4248-b129-cc4d766eeaef\") " pod="openshift-network-operator/iptables-alerter-9pbbd" Jun 12 19:22:30.928138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926690 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2a3407af-1617-4eaf-b76b-cee74b3ef99d-system-cni-dir\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.928138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926662 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-host-var-lib-kubelet\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.928138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926710 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55643173-952d-4b6c-bdb8-4577576de242-registration-dir\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.928138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926714 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-sysctl-d\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.928138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926822 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-sysctl-d\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.928671 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926826 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-host\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.928671 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926874 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/511e63fc-f11c-4ad3-a034-e1676b53dece-host\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.928671 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926374 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-cnibin\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.928671 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926982 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-host-var-lib-cni-multus\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.928671 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.926994 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-cni-binary-copy\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.928671 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.927021 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-host-var-lib-cni-multus\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.928671 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.927162 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2a3407af-1617-4eaf-b76b-cee74b3ef99d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:30.928671 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.927921 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/511e63fc-f11c-4ad3-a034-e1676b53dece-tmp\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.928671 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.928263 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/511e63fc-f11c-4ad3-a034-e1676b53dece-etc-tuned\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.936064 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.936041 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n56qt\" (UniqueName: \"kubernetes.io/projected/511e63fc-f11c-4ad3-a034-e1676b53dece-kube-api-access-n56qt\") pod \"tuned-frvtc\" (UID: \"511e63fc-f11c-4ad3-a034-e1676b53dece\") " pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:30.936851 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.936825 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r54w\" (UniqueName: \"kubernetes.io/projected/f71a8194-9226-4248-b129-cc4d766eeaef-kube-api-access-6r54w\") pod \"iptables-alerter-9pbbd\" (UID: \"f71a8194-9226-4248-b129-cc4d766eeaef\") " pod="openshift-network-operator/iptables-alerter-9pbbd" Jun 12 19:22:30.937902 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.937885 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plk5b\" (UniqueName: \"kubernetes.io/projected/6ab368bb-96f3-41d1-9e60-6f404ee5802a-kube-api-access-plk5b\") pod \"network-metrics-daemon-k6wxl\" (UID: \"6ab368bb-96f3-41d1-9e60-6f404ee5802a\") " pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:30.942916 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:30.942899 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:22:30.942916 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:30.942918 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:22:30.943021 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:30.942928 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hgcjg for pod openshift-network-diagnostics/network-check-target-mww4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:22:30.943021 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:30.942987 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg podName:dc6a1d8d-5158-42f3-90ab-df432dd6ef0a nodeName:}" failed. No retries permitted until 2026-06-12 19:22:31.442969124 +0000 UTC m=+2.103661065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hgcjg" (UniqueName: "kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg") pod "network-check-target-mww4t" (UID: "dc6a1d8d-5158-42f3-90ab-df432dd6ef0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:22:30.948842 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.948822 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh76z\" (UniqueName: \"kubernetes.io/projected/3d5ca329-7e77-4d1a-9066-4f2e999eed4f-kube-api-access-sh76z\") pod \"node-ca-kvspx\" (UID: \"3d5ca329-7e77-4d1a-9066-4f2e999eed4f\") " pod="openshift-image-registry/node-ca-kvspx" Jun 12 19:22:30.948959 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.948940 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtz74\" (UniqueName: \"kubernetes.io/projected/5f3c2d7b-2199-4bfe-b371-9c278e9c4e71-kube-api-access-xtz74\") pod \"multus-4wt2m\" (UID: \"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71\") " pod="openshift-multus/multus-4wt2m" Jun 12 19:22:30.950491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.950465 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48d6b\" (UniqueName: \"kubernetes.io/projected/55643173-952d-4b6c-bdb8-4577576de242-kube-api-access-48d6b\") pod \"aws-ebs-csi-driver-node-k7jxm\" (UID: \"55643173-952d-4b6c-bdb8-4577576de242\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:30.950894 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:30.950879 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86rzp\" (UniqueName: \"kubernetes.io/projected/2a3407af-1617-4eaf-b76b-cee74b3ef99d-kube-api-access-86rzp\") pod \"multus-additional-cni-plugins-wdl8m\" (UID: \"2a3407af-1617-4eaf-b76b-cee74b3ef99d\") " pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:31.031273 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.031186 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vkjc9" Jun 12 19:22:31.042967 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:31.042936 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2813bc5_36e5_4b5e_a3b4_19aeafb3f656.slice/crio-1012458076eba0b5f95c98580428053099b210f8341d9aa1c4805b68dc9649a9 WatchSource:0}: Error finding container 1012458076eba0b5f95c98580428053099b210f8341d9aa1c4805b68dc9649a9: Status 404 returned error can't find the container with id 1012458076eba0b5f95c98580428053099b210f8341d9aa1c4805b68dc9649a9 Jun 12 19:22:31.046921 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.046899 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xfm4h" Jun 12 19:22:31.053587 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:31.053561 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod330b534e_744d_45f2_9c04_255693d72982.slice/crio-f4a65d0bc436c6c3fde99797382fa41ac4a501b0cc77ab2a0a8fbb787aa8e7b6 WatchSource:0}: Error finding container f4a65d0bc436c6c3fde99797382fa41ac4a501b0cc77ab2a0a8fbb787aa8e7b6: Status 404 returned error can't find the container with id f4a65d0bc436c6c3fde99797382fa41ac4a501b0cc77ab2a0a8fbb787aa8e7b6 Jun 12 19:22:31.066046 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.066019 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:31.072953 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:31.072930 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7069475a_78c9_4feb_a9b4_f4099f73a3d7.slice/crio-fd53ae88c2e3c5dc953f2a806f6031bc109aabd31e331b5d81b8a74f36d0baeb WatchSource:0}: Error finding container fd53ae88c2e3c5dc953f2a806f6031bc109aabd31e331b5d81b8a74f36d0baeb: Status 404 returned error can't find the container with id fd53ae88c2e3c5dc953f2a806f6031bc109aabd31e331b5d81b8a74f36d0baeb Jun 12 19:22:31.082305 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.082286 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" Jun 12 19:22:31.090236 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.090219 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9pbbd" Jun 12 19:22:31.090362 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:31.090339 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55643173_952d_4b6c_bdb8_4577576de242.slice/crio-95fb317ed931216578c891688be6b69cc41d3070d52da3dffed89f3eccfab0a2 WatchSource:0}: Error finding container 95fb317ed931216578c891688be6b69cc41d3070d52da3dffed89f3eccfab0a2: Status 404 returned error can't find the container with id 95fb317ed931216578c891688be6b69cc41d3070d52da3dffed89f3eccfab0a2 Jun 12 19:22:31.096769 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.096746 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-frvtc" Jun 12 19:22:31.097206 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:31.097184 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf71a8194_9226_4248_b129_cc4d766eeaef.slice/crio-7c8730fca559cffdc99b85e48ec5eebafcacec8c44dfddb985816b7eea0beb95 WatchSource:0}: Error finding container 7c8730fca559cffdc99b85e48ec5eebafcacec8c44dfddb985816b7eea0beb95: Status 404 returned error can't find the container with id 7c8730fca559cffdc99b85e48ec5eebafcacec8c44dfddb985816b7eea0beb95 Jun 12 19:22:31.101113 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.101075 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wdl8m" Jun 12 19:22:31.104430 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:31.104407 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod511e63fc_f11c_4ad3_a034_e1676b53dece.slice/crio-9fb5579807af18e6b87fbc00e1845c8d4740240a6f06999aeb632b0b9dfc562a WatchSource:0}: Error finding container 9fb5579807af18e6b87fbc00e1845c8d4740240a6f06999aeb632b0b9dfc562a: Status 404 returned error can't find the container with id 9fb5579807af18e6b87fbc00e1845c8d4740240a6f06999aeb632b0b9dfc562a Jun 12 19:22:31.107167 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.107111 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4wt2m" Jun 12 19:22:31.109414 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:31.109353 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a3407af_1617_4eaf_b76b_cee74b3ef99d.slice/crio-d10bcd9b88d40a9fd8e24dd40f86b69fe01165dd03cfe6001091d70cff3116c7 WatchSource:0}: Error finding container d10bcd9b88d40a9fd8e24dd40f86b69fe01165dd03cfe6001091d70cff3116c7: Status 404 returned error can't find the container with id d10bcd9b88d40a9fd8e24dd40f86b69fe01165dd03cfe6001091d70cff3116c7 Jun 12 19:22:31.111732 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.111719 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kvspx" Jun 12 19:22:31.115420 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:31.115396 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f3c2d7b_2199_4bfe_b371_9c278e9c4e71.slice/crio-067e5011a2c9b2b17d8773ec15afa1798bf6a2e295270917c09110e2f425f110 WatchSource:0}: Error finding container 067e5011a2c9b2b17d8773ec15afa1798bf6a2e295270917c09110e2f425f110: Status 404 returned error can't find the container with id 067e5011a2c9b2b17d8773ec15afa1798bf6a2e295270917c09110e2f425f110 Jun 12 19:22:31.121315 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:22:31.120186 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d5ca329_7e77_4d1a_9066_4f2e999eed4f.slice/crio-6421f30e4445c3c289396307dad4c651bbc22b2e94052bc8b1d732621ce1820f WatchSource:0}: Error finding container 6421f30e4445c3c289396307dad4c651bbc22b2e94052bc8b1d732621ce1820f: Status 404 returned error can't find the container with id 6421f30e4445c3c289396307dad4c651bbc22b2e94052bc8b1d732621ce1820f Jun 12 19:22:31.432553 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.432472 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs\") pod \"network-metrics-daemon-k6wxl\" (UID: \"6ab368bb-96f3-41d1-9e60-6f404ee5802a\") " pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:31.432553 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.432524 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret\") pod \"global-pull-secret-syncer-j8228\" (UID: \"41a1faa1-36af-4860-ad2c-d355620f8ec0\") " pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:31.432790 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:31.432695 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:22:31.432790 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:31.432755 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret podName:41a1faa1-36af-4860-ad2c-d355620f8ec0 nodeName:}" failed. No retries permitted until 2026-06-12 19:22:32.432738032 +0000 UTC m=+3.093429989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret") pod "global-pull-secret-syncer-j8228" (UID: "41a1faa1-36af-4860-ad2c-d355620f8ec0") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:22:31.433184 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:31.433160 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:22:31.433296 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:31.433243 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs podName:6ab368bb-96f3-41d1-9e60-6f404ee5802a nodeName:}" failed. No retries permitted until 2026-06-12 19:22:32.433225577 +0000 UTC m=+3.093917524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs") pod "network-metrics-daemon-k6wxl" (UID: "6ab368bb-96f3-41d1-9e60-6f404ee5802a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:22:31.533461 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.533421 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgcjg\" (UniqueName: \"kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg\") pod \"network-check-target-mww4t\" (UID: \"dc6a1d8d-5158-42f3-90ab-df432dd6ef0a\") " pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:31.533658 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:31.533636 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:22:31.533726 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:31.533661 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:22:31.533726 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:31.533674 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hgcjg for pod openshift-network-diagnostics/network-check-target-mww4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:22:31.533829 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:31.533732 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg podName:dc6a1d8d-5158-42f3-90ab-df432dd6ef0a nodeName:}" failed. No retries permitted until 2026-06-12 19:22:32.533715067 +0000 UTC m=+3.194407022 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hgcjg" (UniqueName: "kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg") pod "network-check-target-mww4t" (UID: "dc6a1d8d-5158-42f3-90ab-df432dd6ef0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:22:31.561506 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.561474 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 19:22:31.789213 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.789172 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 19:17:30 +0000 UTC" deadline="2028-01-10 21:50:35.171266235 +0000 UTC" Jun 12 19:22:31.789213 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.789210 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13850h28m3.38206065s" Jun 12 19:22:31.822225 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.822184 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdl8m" event={"ID":"2a3407af-1617-4eaf-b76b-cee74b3ef99d","Type":"ContainerStarted","Data":"d10bcd9b88d40a9fd8e24dd40f86b69fe01165dd03cfe6001091d70cff3116c7"} Jun 12 19:22:31.828272 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.827982 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9pbbd" event={"ID":"f71a8194-9226-4248-b129-cc4d766eeaef","Type":"ContainerStarted","Data":"7c8730fca559cffdc99b85e48ec5eebafcacec8c44dfddb985816b7eea0beb95"} Jun 12 19:22:31.847704 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.847645 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" event={"ID":"55643173-952d-4b6c-bdb8-4577576de242","Type":"ContainerStarted","Data":"95fb317ed931216578c891688be6b69cc41d3070d52da3dffed89f3eccfab0a2"} Jun 12 19:22:31.858512 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.858477 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xfm4h" event={"ID":"330b534e-744d-45f2-9c04-255693d72982","Type":"ContainerStarted","Data":"f4a65d0bc436c6c3fde99797382fa41ac4a501b0cc77ab2a0a8fbb787aa8e7b6"} Jun 12 19:22:31.876985 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.876947 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kvspx" event={"ID":"3d5ca329-7e77-4d1a-9066-4f2e999eed4f","Type":"ContainerStarted","Data":"6421f30e4445c3c289396307dad4c651bbc22b2e94052bc8b1d732621ce1820f"} Jun 12 19:22:31.898019 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.897963 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4wt2m" event={"ID":"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71","Type":"ContainerStarted","Data":"067e5011a2c9b2b17d8773ec15afa1798bf6a2e295270917c09110e2f425f110"} Jun 12 19:22:31.906811 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.906772 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-frvtc" event={"ID":"511e63fc-f11c-4ad3-a034-e1676b53dece","Type":"ContainerStarted","Data":"9fb5579807af18e6b87fbc00e1845c8d4740240a6f06999aeb632b0b9dfc562a"} Jun 12 19:22:31.917653 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.917599 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" event={"ID":"7069475a-78c9-4feb-a9b4-f4099f73a3d7","Type":"ContainerStarted","Data":"fd53ae88c2e3c5dc953f2a806f6031bc109aabd31e331b5d81b8a74f36d0baeb"} Jun 12 19:22:31.942960 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:31.942909 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vkjc9" event={"ID":"d2813bc5-36e5-4b5e-a3b4-19aeafb3f656","Type":"ContainerStarted","Data":"1012458076eba0b5f95c98580428053099b210f8341d9aa1c4805b68dc9649a9"} Jun 12 19:22:32.106296 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:32.106205 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 19:22:32.254774 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:32.254745 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 19:22:32.443292 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:32.442674 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs\") pod \"network-metrics-daemon-k6wxl\" (UID: \"6ab368bb-96f3-41d1-9e60-6f404ee5802a\") " pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:32.443292 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:32.442727 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret\") pod \"global-pull-secret-syncer-j8228\" (UID: \"41a1faa1-36af-4860-ad2c-d355620f8ec0\") " pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:32.443292 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:32.442902 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:22:32.443292 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:32.442965 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret podName:41a1faa1-36af-4860-ad2c-d355620f8ec0 nodeName:}" failed. No retries permitted until 2026-06-12 19:22:34.442947697 +0000 UTC m=+5.103639642 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret") pod "global-pull-secret-syncer-j8228" (UID: "41a1faa1-36af-4860-ad2c-d355620f8ec0") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:22:32.443628 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:32.443495 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:22:32.443628 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:32.443543 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs podName:6ab368bb-96f3-41d1-9e60-6f404ee5802a nodeName:}" failed. No retries permitted until 2026-06-12 19:22:34.44352785 +0000 UTC m=+5.104219799 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs") pod "network-metrics-daemon-k6wxl" (UID: "6ab368bb-96f3-41d1-9e60-6f404ee5802a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:22:32.543639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:32.543582 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgcjg\" (UniqueName: \"kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg\") pod \"network-check-target-mww4t\" (UID: \"dc6a1d8d-5158-42f3-90ab-df432dd6ef0a\") " pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:32.543814 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:32.543748 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:22:32.543814 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:32.543771 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:22:32.543814 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:32.543782 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hgcjg for pod openshift-network-diagnostics/network-check-target-mww4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:22:32.544075 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:32.543837 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg podName:dc6a1d8d-5158-42f3-90ab-df432dd6ef0a nodeName:}" failed. No retries permitted until 2026-06-12 19:22:34.543820045 +0000 UTC m=+5.204512000 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hgcjg" (UniqueName: "kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg") pod "network-check-target-mww4t" (UID: "dc6a1d8d-5158-42f3-90ab-df432dd6ef0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:22:32.634862 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:32.634829 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 19:22:32.787169 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:32.787133 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:32.787355 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:32.787281 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6wxl" podUID="6ab368bb-96f3-41d1-9e60-6f404ee5802a" Jun 12 19:22:32.787729 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:32.787707 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:32.787842 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:32.787797 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mww4t" podUID="dc6a1d8d-5158-42f3-90ab-df432dd6ef0a" Jun 12 19:22:32.787919 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:32.787898 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:32.788002 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:32.787984 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8228" podUID="41a1faa1-36af-4860-ad2c-d355620f8ec0" Jun 12 19:22:32.790000 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:32.789973 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 19:17:30 +0000 UTC" deadline="2028-01-22 04:39:55.465059336 +0000 UTC" Jun 12 19:22:32.790000 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:32.790004 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14121h17m22.675061812s" Jun 12 19:22:34.464198 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:34.464154 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs\") pod \"network-metrics-daemon-k6wxl\" (UID: \"6ab368bb-96f3-41d1-9e60-6f404ee5802a\") " pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:34.464707 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:34.464222 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret\") pod \"global-pull-secret-syncer-j8228\" (UID: \"41a1faa1-36af-4860-ad2c-d355620f8ec0\") " pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:34.464707 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:34.464376 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:22:34.464707 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:34.464437 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret podName:41a1faa1-36af-4860-ad2c-d355620f8ec0 nodeName:}" failed. No retries permitted until 2026-06-12 19:22:38.464419019 +0000 UTC m=+9.125110978 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret") pod "global-pull-secret-syncer-j8228" (UID: "41a1faa1-36af-4860-ad2c-d355620f8ec0") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:22:34.464994 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:34.464864 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:22:34.464994 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:34.464913 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs podName:6ab368bb-96f3-41d1-9e60-6f404ee5802a nodeName:}" failed. No retries permitted until 2026-06-12 19:22:38.464898383 +0000 UTC m=+9.125590330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs") pod "network-metrics-daemon-k6wxl" (UID: "6ab368bb-96f3-41d1-9e60-6f404ee5802a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:22:34.564938 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:34.564894 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgcjg\" (UniqueName: \"kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg\") pod \"network-check-target-mww4t\" (UID: \"dc6a1d8d-5158-42f3-90ab-df432dd6ef0a\") " pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:34.565116 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:34.565086 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:22:34.565116 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:34.565107 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:22:34.565218 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:34.565121 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hgcjg for pod openshift-network-diagnostics/network-check-target-mww4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:22:34.565218 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:34.565180 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg podName:dc6a1d8d-5158-42f3-90ab-df432dd6ef0a nodeName:}" failed. No retries permitted until 2026-06-12 19:22:38.565162919 +0000 UTC m=+9.225854862 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hgcjg" (UniqueName: "kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg") pod "network-check-target-mww4t" (UID: "dc6a1d8d-5158-42f3-90ab-df432dd6ef0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:22:34.786331 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:34.786289 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:34.786480 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:34.786417 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8228" podUID="41a1faa1-36af-4860-ad2c-d355620f8ec0" Jun 12 19:22:34.787045 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:34.786780 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:34.787045 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:34.786878 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6wxl" podUID="6ab368bb-96f3-41d1-9e60-6f404ee5802a" Jun 12 19:22:34.787045 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:34.786933 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:34.787045 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:34.787003 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mww4t" podUID="dc6a1d8d-5158-42f3-90ab-df432dd6ef0a" Jun 12 19:22:36.787149 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:36.787110 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:36.787149 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:36.787145 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:36.787633 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:36.787121 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:36.787633 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:36.787255 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6wxl" podUID="6ab368bb-96f3-41d1-9e60-6f404ee5802a" Jun 12 19:22:36.787633 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:36.787382 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mww4t" podUID="dc6a1d8d-5158-42f3-90ab-df432dd6ef0a" Jun 12 19:22:36.787633 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:36.787489 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8228" podUID="41a1faa1-36af-4860-ad2c-d355620f8ec0" Jun 12 19:22:38.501253 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:38.500602 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs\") pod \"network-metrics-daemon-k6wxl\" (UID: \"6ab368bb-96f3-41d1-9e60-6f404ee5802a\") " pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:38.501253 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:38.500671 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret\") pod \"global-pull-secret-syncer-j8228\" (UID: \"41a1faa1-36af-4860-ad2c-d355620f8ec0\") " pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:38.501253 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:38.500807 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:22:38.501253 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:38.500852 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret podName:41a1faa1-36af-4860-ad2c-d355620f8ec0 nodeName:}" failed. No retries permitted until 2026-06-12 19:22:46.500840027 +0000 UTC m=+17.161531968 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret") pod "global-pull-secret-syncer-j8228" (UID: "41a1faa1-36af-4860-ad2c-d355620f8ec0") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:22:38.501253 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:38.501176 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:22:38.501253 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:38.501218 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs podName:6ab368bb-96f3-41d1-9e60-6f404ee5802a nodeName:}" failed. No retries permitted until 2026-06-12 19:22:46.501206054 +0000 UTC m=+17.161898014 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs") pod "network-metrics-daemon-k6wxl" (UID: "6ab368bb-96f3-41d1-9e60-6f404ee5802a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:22:38.601176 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:38.601139 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgcjg\" (UniqueName: \"kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg\") pod \"network-check-target-mww4t\" (UID: \"dc6a1d8d-5158-42f3-90ab-df432dd6ef0a\") " pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:38.601333 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:38.601301 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:22:38.601333 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:38.601323 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:22:38.601333 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:38.601335 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hgcjg for pod openshift-network-diagnostics/network-check-target-mww4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:22:38.601430 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:38.601399 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg podName:dc6a1d8d-5158-42f3-90ab-df432dd6ef0a nodeName:}" failed. No retries permitted until 2026-06-12 19:22:46.601382204 +0000 UTC m=+17.262074145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hgcjg" (UniqueName: "kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg") pod "network-check-target-mww4t" (UID: "dc6a1d8d-5158-42f3-90ab-df432dd6ef0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:22:38.786813 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:38.786727 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:38.786966 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:38.786850 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8228" podUID="41a1faa1-36af-4860-ad2c-d355620f8ec0" Jun 12 19:22:38.787038 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:38.786864 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:38.787423 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:38.787152 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:38.787423 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:38.787265 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mww4t" podUID="dc6a1d8d-5158-42f3-90ab-df432dd6ef0a" Jun 12 19:22:38.787423 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:38.787389 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6wxl" podUID="6ab368bb-96f3-41d1-9e60-6f404ee5802a" Jun 12 19:22:40.786788 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:40.786755 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:40.787226 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:40.786877 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mww4t" podUID="dc6a1d8d-5158-42f3-90ab-df432dd6ef0a" Jun 12 19:22:40.787294 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:40.787256 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:40.787387 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:40.787356 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8228" podUID="41a1faa1-36af-4860-ad2c-d355620f8ec0" Jun 12 19:22:40.787507 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:40.787423 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:40.787507 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:40.787492 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6wxl" podUID="6ab368bb-96f3-41d1-9e60-6f404ee5802a" Jun 12 19:22:42.786883 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:42.786849 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:42.787278 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:42.786949 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:42.787278 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:42.786961 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8228" podUID="41a1faa1-36af-4860-ad2c-d355620f8ec0" Jun 12 19:22:42.787278 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:42.786977 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:42.787278 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:42.787067 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6wxl" podUID="6ab368bb-96f3-41d1-9e60-6f404ee5802a" Jun 12 19:22:42.787278 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:42.787140 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mww4t" podUID="dc6a1d8d-5158-42f3-90ab-df432dd6ef0a" Jun 12 19:22:44.786518 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:44.786480 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:44.787009 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:44.786522 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:44.787009 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:44.786522 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:44.787009 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:44.786673 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mww4t" podUID="dc6a1d8d-5158-42f3-90ab-df432dd6ef0a" Jun 12 19:22:44.787009 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:44.786763 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6wxl" podUID="6ab368bb-96f3-41d1-9e60-6f404ee5802a" Jun 12 19:22:44.787009 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:44.786854 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8228" podUID="41a1faa1-36af-4860-ad2c-d355620f8ec0" Jun 12 19:22:46.557735 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:46.557704 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs\") pod \"network-metrics-daemon-k6wxl\" (UID: \"6ab368bb-96f3-41d1-9e60-6f404ee5802a\") " pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:46.558212 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:46.557752 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret\") pod \"global-pull-secret-syncer-j8228\" (UID: \"41a1faa1-36af-4860-ad2c-d355620f8ec0\") " pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:46.558212 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:46.557868 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:22:46.558212 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:46.557872 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:22:46.558212 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:46.557939 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret podName:41a1faa1-36af-4860-ad2c-d355620f8ec0 nodeName:}" failed. No retries permitted until 2026-06-12 19:23:02.55791841 +0000 UTC m=+33.218610368 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret") pod "global-pull-secret-syncer-j8228" (UID: "41a1faa1-36af-4860-ad2c-d355620f8ec0") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:22:46.558212 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:46.557959 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs podName:6ab368bb-96f3-41d1-9e60-6f404ee5802a nodeName:}" failed. No retries permitted until 2026-06-12 19:23:02.557949874 +0000 UTC m=+33.218641819 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs") pod "network-metrics-daemon-k6wxl" (UID: "6ab368bb-96f3-41d1-9e60-6f404ee5802a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:22:46.658720 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:46.658688 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgcjg\" (UniqueName: \"kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg\") pod \"network-check-target-mww4t\" (UID: \"dc6a1d8d-5158-42f3-90ab-df432dd6ef0a\") " pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:46.658880 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:46.658830 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:22:46.658880 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:46.658845 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:22:46.658880 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:46.658854 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hgcjg for pod openshift-network-diagnostics/network-check-target-mww4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:22:46.659033 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:46.658909 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg podName:dc6a1d8d-5158-42f3-90ab-df432dd6ef0a nodeName:}" failed. No retries permitted until 2026-06-12 19:23:02.658891971 +0000 UTC m=+33.319583929 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hgcjg" (UniqueName: "kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg") pod "network-check-target-mww4t" (UID: "dc6a1d8d-5158-42f3-90ab-df432dd6ef0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:22:46.786182 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:46.786136 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:46.786182 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:46.786179 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:46.786427 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:46.786179 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:46.786427 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:46.786256 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mww4t" podUID="dc6a1d8d-5158-42f3-90ab-df432dd6ef0a" Jun 12 19:22:46.786427 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:46.786354 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6wxl" podUID="6ab368bb-96f3-41d1-9e60-6f404ee5802a" Jun 12 19:22:46.786545 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:46.786431 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8228" podUID="41a1faa1-36af-4860-ad2c-d355620f8ec0" Jun 12 19:22:48.786475 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:48.786438 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:48.786475 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:48.786477 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:48.786990 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:48.786548 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:48.786990 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:48.786555 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mww4t" podUID="dc6a1d8d-5158-42f3-90ab-df432dd6ef0a" Jun 12 19:22:48.786990 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:48.786628 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8228" podUID="41a1faa1-36af-4860-ad2c-d355620f8ec0" Jun 12 19:22:48.786990 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:48.786708 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6wxl" podUID="6ab368bb-96f3-41d1-9e60-6f404ee5802a" Jun 12 19:22:50.787159 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:50.787113 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:50.787159 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:50.787154 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:50.787642 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:50.787158 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:50.787642 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:50.787237 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mww4t" podUID="dc6a1d8d-5158-42f3-90ab-df432dd6ef0a" Jun 12 19:22:50.787642 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:50.787296 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8228" podUID="41a1faa1-36af-4860-ad2c-d355620f8ec0" Jun 12 19:22:50.787642 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:50.787384 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6wxl" podUID="6ab368bb-96f3-41d1-9e60-6f404ee5802a" Jun 12 19:22:51.996142 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:51.995765 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vkjc9" event={"ID":"d2813bc5-36e5-4b5e-a3b4-19aeafb3f656","Type":"ContainerStarted","Data":"c6fbf7c3bafb6eeed3da577ce242ac2a12a4f9f8c611e613641370ccd84f683b"} Jun 12 19:22:51.997305 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:51.997280 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-76.ec2.internal" event={"ID":"7214cad85fb5cf585612f0e29bb8de97","Type":"ContainerStarted","Data":"e9962fa5bf173bdaa26abbe48c38cc263148e9d0e6df54eee387fde5562f960d"} Jun 12 19:22:51.998765 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:51.998676 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" event={"ID":"55643173-952d-4b6c-bdb8-4577576de242","Type":"ContainerStarted","Data":"a6f3d94e46ec1803d68afda99a14377545406656b35a4ede0cffc8b2757c0c57"} Jun 12 19:22:52.000139 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:52.000120 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4wt2m" event={"ID":"5f3c2d7b-2199-4bfe-b371-9c278e9c4e71","Type":"ContainerStarted","Data":"cf0e198591118b7896d3d7dea74c416f616bc6299ec54b91381f66493cf29737"} Jun 12 19:22:52.004451 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:52.004417 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-frvtc" event={"ID":"511e63fc-f11c-4ad3-a034-e1676b53dece","Type":"ContainerStarted","Data":"3eedeca7f95e7ecf9923e74812d42e57e8a44cce09febf1fac8144307533eb3e"} Jun 12 19:22:52.008057 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:52.008041 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4ck7_7069475a-78c9-4feb-a9b4-f4099f73a3d7/ovn-acl-logging/0.log" Jun 12 19:22:52.008349 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:52.008333 2558 generic.go:356] "Generic (PLEG): container finished" podID="7069475a-78c9-4feb-a9b4-f4099f73a3d7" containerID="eca7df0ca75ebadc502f2182a80f6f074000a39588dea52e0e0797ba56121294" exitCode=1 Jun 12 19:22:52.008411 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:52.008358 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" event={"ID":"7069475a-78c9-4feb-a9b4-f4099f73a3d7","Type":"ContainerStarted","Data":"37d19842263a8b38b11faaa29aee1cf37d6233ce9da8189bb2319394dbaa44ed"} Jun 12 19:22:52.008411 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:52.008400 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" event={"ID":"7069475a-78c9-4feb-a9b4-f4099f73a3d7","Type":"ContainerDied","Data":"eca7df0ca75ebadc502f2182a80f6f074000a39588dea52e0e0797ba56121294"} Jun 12 19:22:52.008475 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:52.008428 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" event={"ID":"7069475a-78c9-4feb-a9b4-f4099f73a3d7","Type":"ContainerStarted","Data":"84f20fd86dda0f40cc25c95d0bc7ab92aaa3d988fd84a0dfcd4502ec9e65eb51"} Jun 12 19:22:52.030597 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:52.030550 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vkjc9" podStartSLOduration=2.575421452 podStartE2EDuration="23.030537847s" totalImagesPullingTime="20.455116395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:22:52.030521281 +0000 UTC m=+22.691213245" watchObservedRunningTime="2026-06-12 19:22:52.030537847 +0000 UTC m=+22.691229809" Jun 12 19:22:52.048645 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:52.047435 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-76.ec2.internal" podStartSLOduration=22.047415265 podStartE2EDuration="22.047415265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:22:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:22:52.046230036 +0000 UTC m=+22.706922000" watchObservedRunningTime="2026-06-12 19:22:52.047415265 +0000 UTC m=+22.708107230" Jun 12 19:22:52.090478 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:52.090411 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-frvtc" podStartSLOduration=1.759638874 podStartE2EDuration="22.090390627s" totalImagesPullingTime="20.330751753s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:22:52.070301477 +0000 UTC m=+22.730993440" watchObservedRunningTime="2026-06-12 19:22:52.090390627 +0000 UTC m=+22.751082591" Jun 12 19:22:52.091168 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:52.091129 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4wt2m" podStartSLOduration=1.706887566 podStartE2EDuration="22.091112075s" totalImagesPullingTime="20.384224509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:22:52.090147684 +0000 UTC m=+22.750839646" watchObservedRunningTime="2026-06-12 19:22:52.091112075 +0000 UTC m=+22.751804039" Jun 12 19:22:52.786279 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:52.786093 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:52.786452 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:52.786096 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:52.786452 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:52.786375 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mww4t" podUID="dc6a1d8d-5158-42f3-90ab-df432dd6ef0a" Jun 12 19:22:52.786452 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:52.786096 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:52.786580 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:52.786456 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8228" podUID="41a1faa1-36af-4860-ad2c-d355620f8ec0" Jun 12 19:22:52.786580 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:52.786520 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6wxl" podUID="6ab368bb-96f3-41d1-9e60-6f404ee5802a" Jun 12 19:22:53.011563 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.011527 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xfm4h" event={"ID":"330b534e-744d-45f2-9c04-255693d72982","Type":"ContainerStarted","Data":"ca275b8f338b658ab1744439c9e81f3710d9b3812d02491d3ee320a1e2064ea7"} Jun 12 19:22:53.013016 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.012994 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kvspx" event={"ID":"3d5ca329-7e77-4d1a-9066-4f2e999eed4f","Type":"ContainerStarted","Data":"ca10a08a1f96993975a7248bc7c7bef8601946dab32d2e57bc8926af9597a0bd"} Jun 12 19:22:53.015773 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.015755 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4ck7_7069475a-78c9-4feb-a9b4-f4099f73a3d7/ovn-acl-logging/0.log" Jun 12 19:22:53.016105 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.016086 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" event={"ID":"7069475a-78c9-4feb-a9b4-f4099f73a3d7","Type":"ContainerStarted","Data":"db7e3c3c33104d9122112e0ae679759a9c0ef5054798a5b41c59e069c0ec6c02"} Jun 12 19:22:53.016176 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.016161 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" event={"ID":"7069475a-78c9-4feb-a9b4-f4099f73a3d7","Type":"ContainerStarted","Data":"6691469cc217fb37d5fa2db5c452c74faf137f736fe23d67de67dce69584549c"} Jun 12 19:22:53.016230 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.016216 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" event={"ID":"7069475a-78c9-4feb-a9b4-f4099f73a3d7","Type":"ContainerStarted","Data":"c2e258c8409e2700b75c1dea5168c0fa49e3994187c99f1b984d977e07a777ce"} Jun 12 19:22:53.017485 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.017467 2558 generic.go:356] "Generic (PLEG): container finished" podID="7c496f0235050f441e84d7bc2bf2eab6" containerID="8bf21bfba0bcba846a97f0ba8ca99965e4648d87821a42cffd234714c3bc2b68" exitCode=0 Jun 12 19:22:53.017557 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.017522 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal" event={"ID":"7c496f0235050f441e84d7bc2bf2eab6","Type":"ContainerDied","Data":"8bf21bfba0bcba846a97f0ba8ca99965e4648d87821a42cffd234714c3bc2b68"} Jun 12 19:22:53.017736 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.017720 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal" Jun 12 19:22:53.018954 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.018936 2558 generic.go:356] "Generic (PLEG): container finished" podID="2a3407af-1617-4eaf-b76b-cee74b3ef99d" containerID="7599d7543e333720851b5f97f3e78f459b83e4d683c7bb108919da7fdcf631cc" exitCode=0 Jun 12 19:22:53.019049 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.018962 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdl8m" event={"ID":"2a3407af-1617-4eaf-b76b-cee74b3ef99d","Type":"ContainerDied","Data":"7599d7543e333720851b5f97f3e78f459b83e4d683c7bb108919da7fdcf631cc"} Jun 12 19:22:53.020210 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.020192 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9pbbd" event={"ID":"f71a8194-9226-4248-b129-cc4d766eeaef","Type":"ContainerStarted","Data":"26e8441e4b3397e68fe1c4f8f97dc7d1794b19fa99ebe24fb85650572b9100b2"} Jun 12 19:22:53.028470 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.028428 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xfm4h" podStartSLOduration=3.5782549599999998 podStartE2EDuration="24.028417416s" totalImagesPullingTime="20.450162456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:22:53.028158943 +0000 UTC m=+23.688850905" watchObservedRunningTime="2026-06-12 19:22:53.028417416 +0000 UTC m=+23.689109379" Jun 12 19:22:53.032672 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.032602 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 19:22:53.033241 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.033224 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal"] Jun 12 19:22:53.074800 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.074755 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9pbbd" podStartSLOduration=3.736946724 podStartE2EDuration="24.074739953s" totalImagesPullingTime="20.337793229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:22:53.074309076 +0000 UTC m=+23.735001039" watchObservedRunningTime="2026-06-12 19:22:53.074739953 +0000 UTC m=+23.735431915" Jun 12 19:22:53.098297 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.098257 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kvspx" podStartSLOduration=2.719481204 podStartE2EDuration="23.098242577s" totalImagesPullingTime="20.378761373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:22:53.097838915 +0000 UTC m=+23.758530879" watchObservedRunningTime="2026-06-12 19:22:53.098242577 +0000 UTC m=+23.758934540" Jun 12 19:22:53.240446 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.240418 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 12 19:22:53.787145 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.786976 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-12T19:22:53.240438168Z","UUID":"59036e5e-a58c-4d86-a3db-d20f125ead7c","Handler":null,"Name":"","Endpoint":""} Jun 12 19:22:53.788782 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.788750 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 12 19:22:53.788918 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:53.788802 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 12 19:22:54.025551 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:54.025517 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal" event={"ID":"7c496f0235050f441e84d7bc2bf2eab6","Type":"ContainerStarted","Data":"eda8231de2ebf94b71e1ee1d7e03bb6c6cb879fe67422ed81aeab2e7d40e8169"} Jun 12 19:22:54.028194 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:54.028110 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" event={"ID":"55643173-952d-4b6c-bdb8-4577576de242","Type":"ContainerStarted","Data":"a6b138ac66211f1a1570f4459c6aa84b825067a5d2b25d9adbb5c2ee853afe94"} Jun 12 19:22:54.045568 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:54.045464 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-76.ec2.internal" podStartSLOduration=1.045444729 podStartE2EDuration="1.045444729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:22:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:22:54.045402448 +0000 UTC m=+24.706094432" watchObservedRunningTime="2026-06-12 19:22:54.045444729 +0000 UTC m=+24.706136692" Jun 12 19:22:54.786280 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:54.786248 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:54.786468 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:54.786340 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:54.786468 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:54.786440 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8228" podUID="41a1faa1-36af-4860-ad2c-d355620f8ec0" Jun 12 19:22:54.786468 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:54.786340 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mww4t" podUID="dc6a1d8d-5158-42f3-90ab-df432dd6ef0a" Jun 12 19:22:54.786468 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:54.786348 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:54.786687 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:54.786555 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6wxl" podUID="6ab368bb-96f3-41d1-9e60-6f404ee5802a" Jun 12 19:22:55.033914 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:55.033883 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4ck7_7069475a-78c9-4feb-a9b4-f4099f73a3d7/ovn-acl-logging/0.log" Jun 12 19:22:55.034454 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:55.034285 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" event={"ID":"7069475a-78c9-4feb-a9b4-f4099f73a3d7","Type":"ContainerStarted","Data":"6d4202040d0a01483b75c9b12af4099c63d975338b10b5be71bb05db4fe318b1"} Jun 12 19:22:55.036621 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:55.036534 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" event={"ID":"55643173-952d-4b6c-bdb8-4577576de242","Type":"ContainerStarted","Data":"e3bb17d1fd68a0255d9dd89e912172528dc6b81b9e94d5abba68793a9d10f949"} Jun 12 19:22:55.057236 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:55.057190 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7jxm" podStartSLOduration=3.529238774 podStartE2EDuration="26.057173887s" totalImagesPullingTime="22.527935113s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:22:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:22:55.056640072 +0000 UTC m=+25.717332036" watchObservedRunningTime="2026-06-12 19:22:55.057173887 +0000 UTC m=+25.717865847" Jun 12 19:22:56.627367 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:56.627331 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vkjc9" Jun 12 19:22:56.628332 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:56.628164 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vkjc9" Jun 12 19:22:56.786911 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:56.786877 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:56.787080 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:56.786879 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:56.787080 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:56.786999 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mww4t" podUID="dc6a1d8d-5158-42f3-90ab-df432dd6ef0a" Jun 12 19:22:56.787080 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:56.787018 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:56.787198 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:56.787139 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8228" podUID="41a1faa1-36af-4860-ad2c-d355620f8ec0" Jun 12 19:22:56.787258 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:56.787238 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6wxl" podUID="6ab368bb-96f3-41d1-9e60-6f404ee5802a" Jun 12 19:22:57.041109 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:57.041077 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vkjc9" Jun 12 19:22:57.041640 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:57.041598 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vkjc9" Jun 12 19:22:58.046452 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:58.046379 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4ck7_7069475a-78c9-4feb-a9b4-f4099f73a3d7/ovn-acl-logging/0.log" Jun 12 19:22:58.046938 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:58.046718 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" event={"ID":"7069475a-78c9-4feb-a9b4-f4099f73a3d7","Type":"ContainerStarted","Data":"43661dbf96a15270e37c9d3d7bb12f1c0164d7d92d9842c408d39ac4845db7dd"} Jun 12 19:22:58.047191 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:58.047176 2558 scope.go:117] "RemoveContainer" containerID="eca7df0ca75ebadc502f2182a80f6f074000a39588dea52e0e0797ba56121294" Jun 12 19:22:58.786496 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:58.786311 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:22:58.786658 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:58.786315 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:22:58.786658 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:58.786564 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mww4t" podUID="dc6a1d8d-5158-42f3-90ab-df432dd6ef0a" Jun 12 19:22:58.786720 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:58.786669 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8228" podUID="41a1faa1-36af-4860-ad2c-d355620f8ec0" Jun 12 19:22:58.786720 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:58.786338 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:22:58.786805 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:22:58.786750 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6wxl" podUID="6ab368bb-96f3-41d1-9e60-6f404ee5802a" Jun 12 19:22:59.058739 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:59.058646 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4ck7_7069475a-78c9-4feb-a9b4-f4099f73a3d7/ovn-acl-logging/0.log" Jun 12 19:22:59.060153 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:59.059646 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" event={"ID":"7069475a-78c9-4feb-a9b4-f4099f73a3d7","Type":"ContainerStarted","Data":"6bfa6de02f008e7d09c7256d853ea5fa6dd8c16521d6ad267d4c5717c165d414"} Jun 12 19:22:59.060153 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:59.059870 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:59.060153 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:59.059960 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:59.060153 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:59.060078 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:59.063112 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:59.063086 2558 generic.go:356] "Generic (PLEG): container finished" podID="2a3407af-1617-4eaf-b76b-cee74b3ef99d" containerID="d857b5cb0c14d9f8e397f3df7f5758c680c6cc7edc9324cf750088bb11d59eb2" exitCode=0 Jun 12 19:22:59.063247 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:59.063193 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdl8m" event={"ID":"2a3407af-1617-4eaf-b76b-cee74b3ef99d","Type":"ContainerDied","Data":"d857b5cb0c14d9f8e397f3df7f5758c680c6cc7edc9324cf750088bb11d59eb2"} Jun 12 19:22:59.079376 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:59.079344 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:59.079536 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:59.079522 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:22:59.091461 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:22:59.091412 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" podStartSLOduration=9.571521104 podStartE2EDuration="30.09139495s" totalImagesPullingTime="20.519873846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:22:59.09128652 +0000 UTC m=+29.751978483" watchObservedRunningTime="2026-06-12 19:22:59.09139495 +0000 UTC m=+29.752086913" Jun 12 19:23:00.042979 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:00.042944 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j8228"] Jun 12 19:23:00.043139 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:00.043086 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:23:00.043236 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:00.043204 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8228" podUID="41a1faa1-36af-4860-ad2c-d355620f8ec0" Jun 12 19:23:00.043600 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:00.043578 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mww4t"] Jun 12 19:23:00.043850 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:00.043691 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:23:00.043850 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:00.043775 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mww4t" podUID="dc6a1d8d-5158-42f3-90ab-df432dd6ef0a" Jun 12 19:23:00.044979 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:00.044959 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k6wxl"] Jun 12 19:23:00.045080 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:00.045067 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:23:00.045188 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:00.045168 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6wxl" podUID="6ab368bb-96f3-41d1-9e60-6f404ee5802a" Jun 12 19:23:00.067500 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:00.067465 2558 generic.go:356] "Generic (PLEG): container finished" podID="2a3407af-1617-4eaf-b76b-cee74b3ef99d" containerID="b00be1d656aef0f28ff5b5b3d11b9da8472f5090b29338bb1ea29bac5c7943bd" exitCode=0 Jun 12 19:23:00.068322 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:00.067546 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdl8m" event={"ID":"2a3407af-1617-4eaf-b76b-cee74b3ef99d","Type":"ContainerDied","Data":"b00be1d656aef0f28ff5b5b3d11b9da8472f5090b29338bb1ea29bac5c7943bd"} Jun 12 19:23:01.072303 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:01.072048 2558 generic.go:356] "Generic (PLEG): container finished" podID="2a3407af-1617-4eaf-b76b-cee74b3ef99d" containerID="c5fa20601e2fe927d51ca9a32a2559a76a663d2361b550a64f91ca3f3a7629f9" exitCode=0 Jun 12 19:23:01.072716 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:01.072126 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdl8m" event={"ID":"2a3407af-1617-4eaf-b76b-cee74b3ef99d","Type":"ContainerDied","Data":"c5fa20601e2fe927d51ca9a32a2559a76a663d2361b550a64f91ca3f3a7629f9"} Jun 12 19:23:01.787639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:01.786211 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:23:01.787639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:01.786228 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:23:01.787639 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:01.786340 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8228" podUID="41a1faa1-36af-4860-ad2c-d355620f8ec0" Jun 12 19:23:01.787639 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:01.786412 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6wxl" podUID="6ab368bb-96f3-41d1-9e60-6f404ee5802a" Jun 12 19:23:01.787639 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:01.786470 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:23:01.787639 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:01.786535 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mww4t" podUID="dc6a1d8d-5158-42f3-90ab-df432dd6ef0a" Jun 12 19:23:02.578193 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:02.578150 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs\") pod \"network-metrics-daemon-k6wxl\" (UID: \"6ab368bb-96f3-41d1-9e60-6f404ee5802a\") " pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:23:02.578630 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:02.578216 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret\") pod \"global-pull-secret-syncer-j8228\" (UID: \"41a1faa1-36af-4860-ad2c-d355620f8ec0\") " pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:23:02.578630 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:02.578309 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:23:02.578630 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:02.578348 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:23:02.578630 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:02.578385 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs podName:6ab368bb-96f3-41d1-9e60-6f404ee5802a nodeName:}" failed. No retries permitted until 2026-06-12 19:23:34.578366086 +0000 UTC m=+65.239058027 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs") pod "network-metrics-daemon-k6wxl" (UID: "6ab368bb-96f3-41d1-9e60-6f404ee5802a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:23:02.578630 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:02.578408 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret podName:41a1faa1-36af-4860-ad2c-d355620f8ec0 nodeName:}" failed. No retries permitted until 2026-06-12 19:23:34.57839148 +0000 UTC m=+65.239083420 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret") pod "global-pull-secret-syncer-j8228" (UID: "41a1faa1-36af-4860-ad2c-d355620f8ec0") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:23:02.679383 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:02.679343 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgcjg\" (UniqueName: \"kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg\") pod \"network-check-target-mww4t\" (UID: \"dc6a1d8d-5158-42f3-90ab-df432dd6ef0a\") " pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:23:02.679550 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:02.679530 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:23:02.679591 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:02.679562 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:23:02.679591 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:02.679575 2558 projected.go:196] Error preparing data for projected volume kube-api-access-hgcjg for pod openshift-network-diagnostics/network-check-target-mww4t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:23:02.679704 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:02.679659 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg podName:dc6a1d8d-5158-42f3-90ab-df432dd6ef0a nodeName:}" failed. No retries permitted until 2026-06-12 19:23:34.679639889 +0000 UTC m=+65.340331865 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hgcjg" (UniqueName: "kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg") pod "network-check-target-mww4t" (UID: "dc6a1d8d-5158-42f3-90ab-df432dd6ef0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:23:03.786426 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:03.786390 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:23:03.786898 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:03.786390 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:23:03.786898 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:03.786521 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mww4t" podUID="dc6a1d8d-5158-42f3-90ab-df432dd6ef0a" Jun 12 19:23:03.786898 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:03.786538 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:23:03.786898 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:03.786683 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6wxl" podUID="6ab368bb-96f3-41d1-9e60-6f404ee5802a" Jun 12 19:23:03.786898 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:03.786776 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j8228" podUID="41a1faa1-36af-4860-ad2c-d355620f8ec0" Jun 12 19:23:04.627185 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.627155 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-76.ec2.internal" event="NodeReady" Jun 12 19:23:04.627462 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.627308 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 12 19:23:04.675682 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.675649 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6q46h"] Jun 12 19:23:04.678138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.678111 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:04.678913 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.678891 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7hjk5"] Jun 12 19:23:04.680437 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.680418 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7hjk5" Jun 12 19:23:04.680866 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.680844 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 12 19:23:04.680967 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.680918 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 12 19:23:04.681059 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.681042 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v5pbt\"" Jun 12 19:23:04.683320 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.683205 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 12 19:23:04.683320 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.683216 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pdrvc\"" Jun 12 19:23:04.683320 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.683234 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 12 19:23:04.683888 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.683871 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 12 19:23:04.690762 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.690735 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6q46h"] Jun 12 19:23:04.692889 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.692867 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7hjk5"] Jun 12 19:23:04.697874 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.697840 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xcz4h"] Jun 12 19:23:04.699875 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.699853 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:04.702684 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.702653 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 12 19:23:04.702786 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.702742 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ggsnt\"" Jun 12 19:23:04.702925 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.702851 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 12 19:23:04.702992 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.702928 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 12 19:23:04.703230 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.703207 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 12 19:23:04.711403 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.711375 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xcz4h"] Jun 12 19:23:04.795066 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.795032 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-tmp-dir\") pod \"dns-default-6q46h\" (UID: \"7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c\") " pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:04.795532 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.795088 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-config-volume\") pod \"dns-default-6q46h\" (UID: \"7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c\") " pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:04.795532 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.795113 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6vw7\" (UniqueName: \"kubernetes.io/projected/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-kube-api-access-s6vw7\") pod \"dns-default-6q46h\" (UID: \"7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c\") " pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:04.795532 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.795206 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-metrics-tls\") pod \"dns-default-6q46h\" (UID: \"7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c\") " pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:04.795532 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.795240 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89059048-04a1-41d4-b539-5bff3d33fcc0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:04.795532 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.795261 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4d8r\" (UniqueName: \"kubernetes.io/projected/89059048-04a1-41d4-b539-5bff3d33fcc0-kube-api-access-x4d8r\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:04.795532 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.795315 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89059048-04a1-41d4-b539-5bff3d33fcc0-crio-socket\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:04.795532 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.795334 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89059048-04a1-41d4-b539-5bff3d33fcc0-data-volume\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:04.795532 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.795358 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c4a6d5d-705b-47a0-8baa-8055c7214270-cert\") pod \"ingress-canary-7hjk5\" (UID: \"5c4a6d5d-705b-47a0-8baa-8055c7214270\") " pod="openshift-ingress-canary/ingress-canary-7hjk5" Jun 12 19:23:04.795532 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.795386 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89059048-04a1-41d4-b539-5bff3d33fcc0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:04.795532 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.795414 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqgv9\" (UniqueName: \"kubernetes.io/projected/5c4a6d5d-705b-47a0-8baa-8055c7214270-kube-api-access-wqgv9\") pod \"ingress-canary-7hjk5\" (UID: \"5c4a6d5d-705b-47a0-8baa-8055c7214270\") " pod="openshift-ingress-canary/ingress-canary-7hjk5" Jun 12 19:23:04.896586 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.896495 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-tmp-dir\") pod \"dns-default-6q46h\" (UID: \"7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c\") " pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:04.896586 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.896562 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-config-volume\") pod \"dns-default-6q46h\" (UID: \"7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c\") " pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:04.896586 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.896583 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6vw7\" (UniqueName: \"kubernetes.io/projected/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-kube-api-access-s6vw7\") pod \"dns-default-6q46h\" (UID: \"7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c\") " pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:04.896880 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.896636 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-metrics-tls\") pod \"dns-default-6q46h\" (UID: \"7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c\") " pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:04.896880 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.896658 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89059048-04a1-41d4-b539-5bff3d33fcc0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:04.896880 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.896682 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4d8r\" (UniqueName: \"kubernetes.io/projected/89059048-04a1-41d4-b539-5bff3d33fcc0-kube-api-access-x4d8r\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:04.896880 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.896725 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89059048-04a1-41d4-b539-5bff3d33fcc0-crio-socket\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:04.896880 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.896747 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89059048-04a1-41d4-b539-5bff3d33fcc0-data-volume\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:04.896880 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:04.896759 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:23:04.896880 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.896776 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c4a6d5d-705b-47a0-8baa-8055c7214270-cert\") pod \"ingress-canary-7hjk5\" (UID: \"5c4a6d5d-705b-47a0-8baa-8055c7214270\") " pod="openshift-ingress-canary/ingress-canary-7hjk5" Jun 12 19:23:04.896880 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.896804 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89059048-04a1-41d4-b539-5bff3d33fcc0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:04.896880 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:04.896820 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-metrics-tls podName:7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c nodeName:}" failed. No retries permitted until 2026-06-12 19:23:05.396800627 +0000 UTC m=+36.057492595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-metrics-tls") pod "dns-default-6q46h" (UID: "7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c") : secret "dns-default-metrics-tls" not found Jun 12 19:23:04.896880 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.896856 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqgv9\" (UniqueName: \"kubernetes.io/projected/5c4a6d5d-705b-47a0-8baa-8055c7214270-kube-api-access-wqgv9\") pod \"ingress-canary-7hjk5\" (UID: \"5c4a6d5d-705b-47a0-8baa-8055c7214270\") " pod="openshift-ingress-canary/ingress-canary-7hjk5" Jun 12 19:23:04.896880 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:04.896874 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 19:23:04.897267 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:04.896909 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89059048-04a1-41d4-b539-5bff3d33fcc0-insights-runtime-extractor-tls podName:89059048-04a1-41d4-b539-5bff3d33fcc0 nodeName:}" failed. No retries permitted until 2026-06-12 19:23:05.396897259 +0000 UTC m=+36.057589203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89059048-04a1-41d4-b539-5bff3d33fcc0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xcz4h" (UID: "89059048-04a1-41d4-b539-5bff3d33fcc0") : secret "insights-runtime-extractor-tls" not found Jun 12 19:23:04.897267 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.896909 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-tmp-dir\") pod \"dns-default-6q46h\" (UID: \"7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c\") " pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:04.897267 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:04.896944 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 19:23:04.897267 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:04.896996 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89059048-04a1-41d4-b539-5bff3d33fcc0-kube-rbac-proxy-cm podName:89059048-04a1-41d4-b539-5bff3d33fcc0 nodeName:}" failed. No retries permitted until 2026-06-12 19:23:05.396986533 +0000 UTC m=+36.057678476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/89059048-04a1-41d4-b539-5bff3d33fcc0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xcz4h" (UID: "89059048-04a1-41d4-b539-5bff3d33fcc0") : configmap "kube-rbac-proxy" not found Jun 12 19:23:04.897267 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.897078 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89059048-04a1-41d4-b539-5bff3d33fcc0-crio-socket\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:04.897267 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.897212 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-config-volume\") pod \"dns-default-6q46h\" (UID: \"7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c\") " pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:04.897554 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.897309 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89059048-04a1-41d4-b539-5bff3d33fcc0-data-volume\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:04.902005 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.901981 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c4a6d5d-705b-47a0-8baa-8055c7214270-cert\") pod \"ingress-canary-7hjk5\" (UID: \"5c4a6d5d-705b-47a0-8baa-8055c7214270\") " pod="openshift-ingress-canary/ingress-canary-7hjk5" Jun 12 19:23:04.907563 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.907537 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6vw7\" (UniqueName: \"kubernetes.io/projected/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-kube-api-access-s6vw7\") pod \"dns-default-6q46h\" (UID: \"7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c\") " pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:04.907803 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.907787 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4d8r\" (UniqueName: \"kubernetes.io/projected/89059048-04a1-41d4-b539-5bff3d33fcc0-kube-api-access-x4d8r\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:04.908069 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:04.908049 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqgv9\" (UniqueName: \"kubernetes.io/projected/5c4a6d5d-705b-47a0-8baa-8055c7214270-kube-api-access-wqgv9\") pod \"ingress-canary-7hjk5\" (UID: \"5c4a6d5d-705b-47a0-8baa-8055c7214270\") " pod="openshift-ingress-canary/ingress-canary-7hjk5" Jun 12 19:23:05.000327 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:05.000290 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7hjk5" Jun 12 19:23:05.400131 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:05.400087 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-metrics-tls\") pod \"dns-default-6q46h\" (UID: \"7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c\") " pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:05.400337 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:05.400150 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89059048-04a1-41d4-b539-5bff3d33fcc0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:05.400337 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:05.400194 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89059048-04a1-41d4-b539-5bff3d33fcc0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:05.400337 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:05.400230 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:23:05.400337 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:05.400287 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 19:23:05.400337 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:05.400308 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-metrics-tls podName:7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c nodeName:}" failed. No retries permitted until 2026-06-12 19:23:06.400287873 +0000 UTC m=+37.060979836 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-metrics-tls") pod "dns-default-6q46h" (UID: "7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c") : secret "dns-default-metrics-tls" not found Jun 12 19:23:05.400337 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:05.400293 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 19:23:05.400652 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:05.400351 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89059048-04a1-41d4-b539-5bff3d33fcc0-kube-rbac-proxy-cm podName:89059048-04a1-41d4-b539-5bff3d33fcc0 nodeName:}" failed. No retries permitted until 2026-06-12 19:23:06.400333347 +0000 UTC m=+37.061025304 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/89059048-04a1-41d4-b539-5bff3d33fcc0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xcz4h" (UID: "89059048-04a1-41d4-b539-5bff3d33fcc0") : configmap "kube-rbac-proxy" not found Jun 12 19:23:05.400652 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:05.400384 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89059048-04a1-41d4-b539-5bff3d33fcc0-insights-runtime-extractor-tls podName:89059048-04a1-41d4-b539-5bff3d33fcc0 nodeName:}" failed. No retries permitted until 2026-06-12 19:23:06.400367039 +0000 UTC m=+37.061058981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89059048-04a1-41d4-b539-5bff3d33fcc0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xcz4h" (UID: "89059048-04a1-41d4-b539-5bff3d33fcc0") : secret "insights-runtime-extractor-tls" not found Jun 12 19:23:05.690580 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:05.690557 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7hjk5"] Jun 12 19:23:05.710661 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:23:05.710634 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c4a6d5d_705b_47a0_8baa_8055c7214270.slice/crio-3cfbc22345cf456de8b1d1ac8bae991e5b913890f00c630e1cf22496faae3d88 WatchSource:0}: Error finding container 3cfbc22345cf456de8b1d1ac8bae991e5b913890f00c630e1cf22496faae3d88: Status 404 returned error can't find the container with id 3cfbc22345cf456de8b1d1ac8bae991e5b913890f00c630e1cf22496faae3d88 Jun 12 19:23:05.786569 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:05.786540 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:23:05.786716 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:05.786587 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:23:05.786716 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:05.786539 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:23:05.789568 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:05.789546 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 19:23:05.789710 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:05.789583 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 19:23:05.789710 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:05.789584 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 19:23:05.790523 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:05.790509 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5lk9h\"" Jun 12 19:23:05.790683 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:05.790660 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 19:23:05.790683 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:05.790678 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xsgr9\"" Jun 12 19:23:06.091842 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.091805 2558 generic.go:356] "Generic (PLEG): container finished" podID="2a3407af-1617-4eaf-b76b-cee74b3ef99d" containerID="5aa06f42d6b3e80d9c54d187402f1dc43500760f8793e48d5d89190b21199e02" exitCode=0 Jun 12 19:23:06.092236 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.091884 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdl8m" event={"ID":"2a3407af-1617-4eaf-b76b-cee74b3ef99d","Type":"ContainerDied","Data":"5aa06f42d6b3e80d9c54d187402f1dc43500760f8793e48d5d89190b21199e02"} Jun 12 19:23:06.093033 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.092999 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7hjk5" event={"ID":"5c4a6d5d-705b-47a0-8baa-8055c7214270","Type":"ContainerStarted","Data":"3cfbc22345cf456de8b1d1ac8bae991e5b913890f00c630e1cf22496faae3d88"} Jun 12 19:23:06.406753 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.406724 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-metrics-tls\") pod \"dns-default-6q46h\" (UID: \"7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c\") " pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:06.406914 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.406758 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89059048-04a1-41d4-b539-5bff3d33fcc0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:06.406914 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.406823 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89059048-04a1-41d4-b539-5bff3d33fcc0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:06.406914 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:06.406885 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:23:06.407086 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:06.406920 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 19:23:06.407086 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:06.406957 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 19:23:06.407086 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:06.406960 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-metrics-tls podName:7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c nodeName:}" failed. No retries permitted until 2026-06-12 19:23:08.406938486 +0000 UTC m=+39.067630443 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-metrics-tls") pod "dns-default-6q46h" (UID: "7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c") : secret "dns-default-metrics-tls" not found Jun 12 19:23:06.407086 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:06.407019 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89059048-04a1-41d4-b539-5bff3d33fcc0-kube-rbac-proxy-cm podName:89059048-04a1-41d4-b539-5bff3d33fcc0 nodeName:}" failed. No retries permitted until 2026-06-12 19:23:08.407001224 +0000 UTC m=+39.067693184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/89059048-04a1-41d4-b539-5bff3d33fcc0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xcz4h" (UID: "89059048-04a1-41d4-b539-5bff3d33fcc0") : configmap "kube-rbac-proxy" not found Jun 12 19:23:06.407086 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:06.407037 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89059048-04a1-41d4-b539-5bff3d33fcc0-insights-runtime-extractor-tls podName:89059048-04a1-41d4-b539-5bff3d33fcc0 nodeName:}" failed. No retries permitted until 2026-06-12 19:23:08.407026706 +0000 UTC m=+39.067718648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89059048-04a1-41d4-b539-5bff3d33fcc0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xcz4h" (UID: "89059048-04a1-41d4-b539-5bff3d33fcc0") : secret "insights-runtime-extractor-tls" not found Jun 12 19:23:06.479292 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.479259 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-qqf69"] Jun 12 19:23:06.500791 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.500762 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-qqf69"] Jun 12 19:23:06.500943 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.500886 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-qqf69" Jun 12 19:23:06.504054 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.503995 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 12 19:23:06.504054 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.504008 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xnl6w\"" Jun 12 19:23:06.504054 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.504016 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 12 19:23:06.504308 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.504098 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 12 19:23:06.504308 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.504178 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 12 19:23:06.608839 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.608796 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/80f303f2-2113-41af-95b0-4921203ab8d4-signing-cabundle\") pod \"service-ca-7b994bc59-qqf69\" (UID: \"80f303f2-2113-41af-95b0-4921203ab8d4\") " pod="openshift-service-ca/service-ca-7b994bc59-qqf69" Jun 12 19:23:06.609027 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.608989 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbfjq\" (UniqueName: \"kubernetes.io/projected/80f303f2-2113-41af-95b0-4921203ab8d4-kube-api-access-rbfjq\") pod \"service-ca-7b994bc59-qqf69\" (UID: \"80f303f2-2113-41af-95b0-4921203ab8d4\") " pod="openshift-service-ca/service-ca-7b994bc59-qqf69" Jun 12 19:23:06.609077 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.609058 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/80f303f2-2113-41af-95b0-4921203ab8d4-signing-key\") pod \"service-ca-7b994bc59-qqf69\" (UID: \"80f303f2-2113-41af-95b0-4921203ab8d4\") " pod="openshift-service-ca/service-ca-7b994bc59-qqf69" Jun 12 19:23:06.710204 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.710162 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbfjq\" (UniqueName: \"kubernetes.io/projected/80f303f2-2113-41af-95b0-4921203ab8d4-kube-api-access-rbfjq\") pod \"service-ca-7b994bc59-qqf69\" (UID: \"80f303f2-2113-41af-95b0-4921203ab8d4\") " pod="openshift-service-ca/service-ca-7b994bc59-qqf69" Jun 12 19:23:06.710388 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.710234 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/80f303f2-2113-41af-95b0-4921203ab8d4-signing-key\") pod \"service-ca-7b994bc59-qqf69\" (UID: \"80f303f2-2113-41af-95b0-4921203ab8d4\") " pod="openshift-service-ca/service-ca-7b994bc59-qqf69" Jun 12 19:23:06.710388 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.710289 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/80f303f2-2113-41af-95b0-4921203ab8d4-signing-cabundle\") pod \"service-ca-7b994bc59-qqf69\" (UID: \"80f303f2-2113-41af-95b0-4921203ab8d4\") " pod="openshift-service-ca/service-ca-7b994bc59-qqf69" Jun 12 19:23:06.711140 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.711114 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/80f303f2-2113-41af-95b0-4921203ab8d4-signing-cabundle\") pod \"service-ca-7b994bc59-qqf69\" (UID: \"80f303f2-2113-41af-95b0-4921203ab8d4\") " pod="openshift-service-ca/service-ca-7b994bc59-qqf69" Jun 12 19:23:06.714081 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.714051 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/80f303f2-2113-41af-95b0-4921203ab8d4-signing-key\") pod \"service-ca-7b994bc59-qqf69\" (UID: \"80f303f2-2113-41af-95b0-4921203ab8d4\") " pod="openshift-service-ca/service-ca-7b994bc59-qqf69" Jun 12 19:23:06.719598 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.719577 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbfjq\" (UniqueName: \"kubernetes.io/projected/80f303f2-2113-41af-95b0-4921203ab8d4-kube-api-access-rbfjq\") pod \"service-ca-7b994bc59-qqf69\" (UID: \"80f303f2-2113-41af-95b0-4921203ab8d4\") " pod="openshift-service-ca/service-ca-7b994bc59-qqf69" Jun 12 19:23:06.811568 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.811477 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-qqf69" Jun 12 19:23:06.960151 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:06.960116 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-qqf69"] Jun 12 19:23:06.963344 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:23:06.963316 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f303f2_2113_41af_95b0_4921203ab8d4.slice/crio-86fe9ab7c47a59b440e6ee278d6d63388530744e4d0fee23988082812ed30321 WatchSource:0}: Error finding container 86fe9ab7c47a59b440e6ee278d6d63388530744e4d0fee23988082812ed30321: Status 404 returned error can't find the container with id 86fe9ab7c47a59b440e6ee278d6d63388530744e4d0fee23988082812ed30321 Jun 12 19:23:07.098553 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:07.098457 2558 generic.go:356] "Generic (PLEG): container finished" podID="2a3407af-1617-4eaf-b76b-cee74b3ef99d" containerID="a156ad18c2d710a05a60f5b2249544ede04561c95dbd1a47d16c6293e229ac3a" exitCode=0 Jun 12 19:23:07.098553 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:07.098546 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdl8m" event={"ID":"2a3407af-1617-4eaf-b76b-cee74b3ef99d","Type":"ContainerDied","Data":"a156ad18c2d710a05a60f5b2249544ede04561c95dbd1a47d16c6293e229ac3a"} Jun 12 19:23:07.099802 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:07.099773 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-qqf69" event={"ID":"80f303f2-2113-41af-95b0-4921203ab8d4","Type":"ContainerStarted","Data":"86fe9ab7c47a59b440e6ee278d6d63388530744e4d0fee23988082812ed30321"} Jun 12 19:23:07.209025 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:07.208981 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xfm4h_330b534e-744d-45f2-9c04-255693d72982/dns-node-resolver/0.log" Jun 12 19:23:08.107691 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:08.107406 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdl8m" event={"ID":"2a3407af-1617-4eaf-b76b-cee74b3ef99d","Type":"ContainerStarted","Data":"593999dea2e6c07c0a30f7e60c075c2660b5015ac2be478503ed3264fbe4fdf3"} Jun 12 19:23:08.109078 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:08.109046 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7hjk5" event={"ID":"5c4a6d5d-705b-47a0-8baa-8055c7214270","Type":"ContainerStarted","Data":"dcd83b142b5584d5ede286048ce9d1f9ad2f8523c64f78ff91705142ee45dc8a"} Jun 12 19:23:08.135021 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:08.134906 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wdl8m" podStartSLOduration=6.474341874 podStartE2EDuration="38.134886827s" totalImagesPullingTime="31.660544953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:22:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:08.133407341 +0000 UTC m=+38.794099305" watchObservedRunningTime="2026-06-12 19:23:08.134886827 +0000 UTC m=+38.795578791" Jun 12 19:23:08.150201 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:08.150142 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7hjk5" podStartSLOduration=1.9737905489999998 podStartE2EDuration="4.150125752s" totalImagesPullingTime="2.176335203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:23:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:08.149544377 +0000 UTC m=+38.810236340" watchObservedRunningTime="2026-06-12 19:23:08.150125752 +0000 UTC m=+38.810817716" Jun 12 19:23:08.182293 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:08.182222 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kvspx_3d5ca329-7e77-4d1a-9066-4f2e999eed4f/node-ca/0.log" Jun 12 19:23:08.427991 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:08.427953 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-metrics-tls\") pod \"dns-default-6q46h\" (UID: \"7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c\") " pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:08.427991 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:08.427986 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89059048-04a1-41d4-b539-5bff3d33fcc0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:08.428194 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:08.428022 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89059048-04a1-41d4-b539-5bff3d33fcc0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:08.428194 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:08.428088 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 19:23:08.428194 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:08.428108 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 19:23:08.428194 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:08.428121 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:23:08.428194 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:08.428164 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89059048-04a1-41d4-b539-5bff3d33fcc0-kube-rbac-proxy-cm podName:89059048-04a1-41d4-b539-5bff3d33fcc0 nodeName:}" failed. No retries permitted until 2026-06-12 19:23:12.428144559 +0000 UTC m=+43.088836523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/89059048-04a1-41d4-b539-5bff3d33fcc0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xcz4h" (UID: "89059048-04a1-41d4-b539-5bff3d33fcc0") : configmap "kube-rbac-proxy" not found Jun 12 19:23:08.428194 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:08.428181 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-metrics-tls podName:7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c nodeName:}" failed. No retries permitted until 2026-06-12 19:23:12.428174641 +0000 UTC m=+43.088866582 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-metrics-tls") pod "dns-default-6q46h" (UID: "7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c") : secret "dns-default-metrics-tls" not found Jun 12 19:23:08.428194 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:08.428192 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89059048-04a1-41d4-b539-5bff3d33fcc0-insights-runtime-extractor-tls podName:89059048-04a1-41d4-b539-5bff3d33fcc0 nodeName:}" failed. No retries permitted until 2026-06-12 19:23:12.428186513 +0000 UTC m=+43.088878453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89059048-04a1-41d4-b539-5bff3d33fcc0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xcz4h" (UID: "89059048-04a1-41d4-b539-5bff3d33fcc0") : secret "insights-runtime-extractor-tls" not found Jun 12 19:23:08.781882 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:08.781850 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7hjk5_5c4a6d5d-705b-47a0-8baa-8055c7214270/serve-healthcheck-canary/0.log" Jun 12 19:23:10.116783 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:10.116705 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-qqf69" event={"ID":"80f303f2-2113-41af-95b0-4921203ab8d4","Type":"ContainerStarted","Data":"4cf95ef269aa1ab7b8ba1d93adff8ffd57f3996f185bc3ff7f8c5cf40a325413"} Jun 12 19:23:10.134590 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:10.134540 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-qqf69" podStartSLOduration=1.331816954 podStartE2EDuration="4.134522307s" totalImagesPullingTime="2.802705353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:23:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:10.133977557 +0000 UTC m=+40.794669520" watchObservedRunningTime="2026-06-12 19:23:10.134522307 +0000 UTC m=+40.795214269" Jun 12 19:23:12.462872 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:12.462834 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89059048-04a1-41d4-b539-5bff3d33fcc0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:12.463275 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:12.462911 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-metrics-tls\") pod \"dns-default-6q46h\" (UID: \"7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c\") " pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:12.463275 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:12.462929 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89059048-04a1-41d4-b539-5bff3d33fcc0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:12.463275 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:12.463014 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 19:23:12.463275 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:12.463091 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89059048-04a1-41d4-b539-5bff3d33fcc0-insights-runtime-extractor-tls podName:89059048-04a1-41d4-b539-5bff3d33fcc0 nodeName:}" failed. No retries permitted until 2026-06-12 19:23:20.463070141 +0000 UTC m=+51.123762085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/89059048-04a1-41d4-b539-5bff3d33fcc0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xcz4h" (UID: "89059048-04a1-41d4-b539-5bff3d33fcc0") : secret "insights-runtime-extractor-tls" not found Jun 12 19:23:12.463275 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:12.463018 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:23:12.463275 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:12.463168 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-metrics-tls podName:7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c nodeName:}" failed. No retries permitted until 2026-06-12 19:23:20.463152001 +0000 UTC m=+51.123843947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-metrics-tls") pod "dns-default-6q46h" (UID: "7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c") : secret "dns-default-metrics-tls" not found Jun 12 19:23:12.463460 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:12.463441 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89059048-04a1-41d4-b539-5bff3d33fcc0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:20.522819 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:20.522772 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-metrics-tls\") pod \"dns-default-6q46h\" (UID: \"7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c\") " pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:20.523294 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:20.522849 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89059048-04a1-41d4-b539-5bff3d33fcc0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:20.526580 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:20.526546 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c-metrics-tls\") pod \"dns-default-6q46h\" (UID: \"7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c\") " pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:20.526716 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:20.526595 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89059048-04a1-41d4-b539-5bff3d33fcc0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xcz4h\" (UID: \"89059048-04a1-41d4-b539-5bff3d33fcc0\") " pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:20.590422 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:20.590376 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:20.610346 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:20.610310 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xcz4h" Jun 12 19:23:20.768924 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:20.768874 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6q46h"] Jun 12 19:23:20.773390 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:23:20.773329 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd2e7d7_64e1_4c2f_9ca8_a956a8ed9e8c.slice/crio-f6700221e6dd8c686f82d7ec32d687a7ae65b281dc8596b676c56b47b033fe1f WatchSource:0}: Error finding container f6700221e6dd8c686f82d7ec32d687a7ae65b281dc8596b676c56b47b033fe1f: Status 404 returned error can't find the container with id f6700221e6dd8c686f82d7ec32d687a7ae65b281dc8596b676c56b47b033fe1f Jun 12 19:23:20.800977 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:20.800947 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xcz4h"] Jun 12 19:23:20.804551 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:23:20.804525 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89059048_04a1_41d4_b539_5bff3d33fcc0.slice/crio-54218bdfce8899d080b9e13a5a081f96d0b88ea3527dc5d85c9fbeae60494a3b WatchSource:0}: Error finding container 54218bdfce8899d080b9e13a5a081f96d0b88ea3527dc5d85c9fbeae60494a3b: Status 404 returned error can't find the container with id 54218bdfce8899d080b9e13a5a081f96d0b88ea3527dc5d85c9fbeae60494a3b Jun 12 19:23:21.144640 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:21.144538 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xcz4h" event={"ID":"89059048-04a1-41d4-b539-5bff3d33fcc0","Type":"ContainerStarted","Data":"54218bdfce8899d080b9e13a5a081f96d0b88ea3527dc5d85c9fbeae60494a3b"} Jun 12 19:23:21.145579 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:21.145557 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6q46h" event={"ID":"7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c","Type":"ContainerStarted","Data":"f6700221e6dd8c686f82d7ec32d687a7ae65b281dc8596b676c56b47b033fe1f"} Jun 12 19:23:23.152766 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:23.152730 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6q46h" event={"ID":"7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c","Type":"ContainerStarted","Data":"fe28fa39bf03138cbb2312fd9c7fc55aadf4b0f538838294fed4f71dd84b780a"} Jun 12 19:23:23.153251 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:23.152795 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6q46h" event={"ID":"7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c","Type":"ContainerStarted","Data":"8808916a079d37b68eaf7dae92ca4ed809ffb435eb73169338b826f438d017e2"} Jun 12 19:23:23.153251 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:23.152920 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:23.173927 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:23.173873 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6q46h" podStartSLOduration=17.307944481 podStartE2EDuration="19.173858232s" totalImagesPullingTime="1.865913751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:23:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:23.171735061 +0000 UTC m=+53.832427015" watchObservedRunningTime="2026-06-12 19:23:23.173858232 +0000 UTC m=+53.834550195" Jun 12 19:23:24.830698 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.830669 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769647c8-b2w4q"] Jun 12 19:23:24.832678 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.832663 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769647c8-b2w4q" Jun 12 19:23:24.836559 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.836539 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-rggtq\"" Jun 12 19:23:24.837163 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.837144 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 12 19:23:24.837747 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.837700 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 12 19:23:24.837747 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.837704 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 12 19:23:24.838025 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.838011 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 12 19:23:24.849162 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.849135 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769647c8-b2w4q"] Jun 12 19:23:24.854408 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.854387 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b6029321-747e-496d-8bee-0582eeefd604-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6769647c8-b2w4q\" (UID: \"b6029321-747e-496d-8bee-0582eeefd604\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769647c8-b2w4q" Jun 12 19:23:24.854526 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.854457 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9b6l\" (UniqueName: \"kubernetes.io/projected/b6029321-747e-496d-8bee-0582eeefd604-kube-api-access-c9b6l\") pod \"managed-serviceaccount-addon-agent-6769647c8-b2w4q\" (UID: \"b6029321-747e-496d-8bee-0582eeefd604\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769647c8-b2w4q" Jun 12 19:23:24.933819 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.933786 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-789b778c76-rx8vs"] Jun 12 19:23:24.935438 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.935423 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:24.941653 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.941629 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 12 19:23:24.941993 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.941968 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 12 19:23:24.942220 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.942180 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-22657\"" Jun 12 19:23:24.943035 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.943013 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 12 19:23:24.950169 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.950151 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 12 19:23:24.953994 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.953976 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-789b778c76-rx8vs"] Jun 12 19:23:24.955755 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.955729 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b6029321-747e-496d-8bee-0582eeefd604-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6769647c8-b2w4q\" (UID: \"b6029321-747e-496d-8bee-0582eeefd604\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769647c8-b2w4q" Jun 12 19:23:24.955858 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.955775 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0006ddb5-24bf-4f95-a28b-c2b706d0e440-trusted-ca\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:24.955858 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.955851 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9b6l\" (UniqueName: \"kubernetes.io/projected/b6029321-747e-496d-8bee-0582eeefd604-kube-api-access-c9b6l\") pod \"managed-serviceaccount-addon-agent-6769647c8-b2w4q\" (UID: \"b6029321-747e-496d-8bee-0582eeefd604\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769647c8-b2w4q" Jun 12 19:23:24.955958 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.955877 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0006ddb5-24bf-4f95-a28b-c2b706d0e440-image-registry-private-configuration\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:24.955958 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.955905 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5qdf\" (UniqueName: \"kubernetes.io/projected/0006ddb5-24bf-4f95-a28b-c2b706d0e440-kube-api-access-q5qdf\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:24.955958 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.955940 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0006ddb5-24bf-4f95-a28b-c2b706d0e440-ca-trust-extracted\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:24.956098 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.955965 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0006ddb5-24bf-4f95-a28b-c2b706d0e440-bound-sa-token\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:24.956098 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.956027 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0006ddb5-24bf-4f95-a28b-c2b706d0e440-registry-tls\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:24.956098 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.956071 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0006ddb5-24bf-4f95-a28b-c2b706d0e440-registry-certificates\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:24.956228 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.956111 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0006ddb5-24bf-4f95-a28b-c2b706d0e440-installation-pull-secrets\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:24.958378 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.958361 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b6029321-747e-496d-8bee-0582eeefd604-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6769647c8-b2w4q\" (UID: \"b6029321-747e-496d-8bee-0582eeefd604\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769647c8-b2w4q" Jun 12 19:23:24.974291 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:24.974269 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9b6l\" (UniqueName: \"kubernetes.io/projected/b6029321-747e-496d-8bee-0582eeefd604-kube-api-access-c9b6l\") pod \"managed-serviceaccount-addon-agent-6769647c8-b2w4q\" (UID: \"b6029321-747e-496d-8bee-0582eeefd604\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769647c8-b2w4q" Jun 12 19:23:25.056649 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.056600 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0006ddb5-24bf-4f95-a28b-c2b706d0e440-installation-pull-secrets\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:25.056649 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.056660 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0006ddb5-24bf-4f95-a28b-c2b706d0e440-trusted-ca\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:25.056933 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.056727 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0006ddb5-24bf-4f95-a28b-c2b706d0e440-image-registry-private-configuration\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:25.056933 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.056752 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5qdf\" (UniqueName: \"kubernetes.io/projected/0006ddb5-24bf-4f95-a28b-c2b706d0e440-kube-api-access-q5qdf\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:25.056933 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.056780 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0006ddb5-24bf-4f95-a28b-c2b706d0e440-ca-trust-extracted\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:25.056933 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.056801 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0006ddb5-24bf-4f95-a28b-c2b706d0e440-bound-sa-token\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:25.056933 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.056826 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0006ddb5-24bf-4f95-a28b-c2b706d0e440-registry-tls\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:25.056933 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.056869 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0006ddb5-24bf-4f95-a28b-c2b706d0e440-registry-certificates\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:25.057311 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.057290 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0006ddb5-24bf-4f95-a28b-c2b706d0e440-ca-trust-extracted\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:25.057739 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.057717 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0006ddb5-24bf-4f95-a28b-c2b706d0e440-registry-certificates\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:25.057789 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.057717 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0006ddb5-24bf-4f95-a28b-c2b706d0e440-trusted-ca\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:25.059334 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.059313 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0006ddb5-24bf-4f95-a28b-c2b706d0e440-registry-tls\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:25.059584 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.059564 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0006ddb5-24bf-4f95-a28b-c2b706d0e440-image-registry-private-configuration\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:25.059727 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.059708 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0006ddb5-24bf-4f95-a28b-c2b706d0e440-installation-pull-secrets\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:25.068386 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.068367 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5qdf\" (UniqueName: \"kubernetes.io/projected/0006ddb5-24bf-4f95-a28b-c2b706d0e440-kube-api-access-q5qdf\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:25.072163 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.072143 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0006ddb5-24bf-4f95-a28b-c2b706d0e440-bound-sa-token\") pod \"image-registry-789b778c76-rx8vs\" (UID: \"0006ddb5-24bf-4f95-a28b-c2b706d0e440\") " pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:25.154442 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.154409 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769647c8-b2w4q" Jun 12 19:23:25.159641 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.159596 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xcz4h" event={"ID":"89059048-04a1-41d4-b539-5bff3d33fcc0","Type":"ContainerStarted","Data":"4f7d73d90f88ab1531521daae378c807e7acb8b70d098fabc6c71c77c37066a7"} Jun 12 19:23:25.244427 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.244392 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:25.358222 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.358195 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769647c8-b2w4q"] Jun 12 19:23:25.361640 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:23:25.361593 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6029321_747e_496d_8bee_0582eeefd604.slice/crio-1fe1dc82e5cb40e0fc1f018ddcba6d92a4a5a6886c3447249d2f54d84a28486c WatchSource:0}: Error finding container 1fe1dc82e5cb40e0fc1f018ddcba6d92a4a5a6886c3447249d2f54d84a28486c: Status 404 returned error can't find the container with id 1fe1dc82e5cb40e0fc1f018ddcba6d92a4a5a6886c3447249d2f54d84a28486c Jun 12 19:23:25.382517 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:25.382497 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-789b778c76-rx8vs"] Jun 12 19:23:25.384346 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:23:25.384318 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0006ddb5_24bf_4f95_a28b_c2b706d0e440.slice/crio-a6ac2404e08897022d955e690c3199f40b7d8978fe40bc7fa065559ade92e761 WatchSource:0}: Error finding container a6ac2404e08897022d955e690c3199f40b7d8978fe40bc7fa065559ade92e761: Status 404 returned error can't find the container with id a6ac2404e08897022d955e690c3199f40b7d8978fe40bc7fa065559ade92e761 Jun 12 19:23:26.165494 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:26.165452 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769647c8-b2w4q" event={"ID":"b6029321-747e-496d-8bee-0582eeefd604","Type":"ContainerStarted","Data":"1fe1dc82e5cb40e0fc1f018ddcba6d92a4a5a6886c3447249d2f54d84a28486c"} Jun 12 19:23:26.167960 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:26.167931 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xcz4h" event={"ID":"89059048-04a1-41d4-b539-5bff3d33fcc0","Type":"ContainerStarted","Data":"1b70e6bf4ff8cecc6168b57c66ba67df2405e2523578d5277497c8a8d3f61053"} Jun 12 19:23:26.169797 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:26.169773 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-789b778c76-rx8vs" event={"ID":"0006ddb5-24bf-4f95-a28b-c2b706d0e440","Type":"ContainerStarted","Data":"f612b97187b56032cca108720b539e8496c496188f3eef7dc2b3a1f89fb6b7ed"} Jun 12 19:23:26.169882 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:26.169817 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-789b778c76-rx8vs" event={"ID":"0006ddb5-24bf-4f95-a28b-c2b706d0e440","Type":"ContainerStarted","Data":"a6ac2404e08897022d955e690c3199f40b7d8978fe40bc7fa065559ade92e761"} Jun 12 19:23:26.170504 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:26.170485 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:26.193704 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:26.193656 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-789b778c76-rx8vs" podStartSLOduration=2.193638302 podStartE2EDuration="2.193638302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:23:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:26.193421454 +0000 UTC m=+56.854113423" watchObservedRunningTime="2026-06-12 19:23:26.193638302 +0000 UTC m=+56.854330283" Jun 12 19:23:28.180515 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:28.180425 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769647c8-b2w4q" event={"ID":"b6029321-747e-496d-8bee-0582eeefd604","Type":"ContainerStarted","Data":"0975b2c2640502eef09c26311a311d58c228daed393327c926a10d4066e6b26f"} Jun 12 19:23:28.182541 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:28.182518 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xcz4h" event={"ID":"89059048-04a1-41d4-b539-5bff3d33fcc0","Type":"ContainerStarted","Data":"e69d7cd5bfc79409e5f277da311380503c87be70c2219ec7de0066fbf4a2dec8"} Jun 12 19:23:28.199684 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:28.199644 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6769647c8-b2w4q" podStartSLOduration=1.605622882 podStartE2EDuration="4.199633389s" totalImagesPullingTime="2.594010507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:23:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:28.198958354 +0000 UTC m=+58.859650317" watchObservedRunningTime="2026-06-12 19:23:28.199633389 +0000 UTC m=+58.860325351" Jun 12 19:23:28.218652 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:28.218595 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xcz4h" podStartSLOduration=17.222373418 podStartE2EDuration="24.218584051s" totalImagesPullingTime="6.996210633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:23:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:28.217667091 +0000 UTC m=+58.878359064" watchObservedRunningTime="2026-06-12 19:23:28.218584051 +0000 UTC m=+58.879275992" Jun 12 19:23:31.083215 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:31.083187 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r4ck7" Jun 12 19:23:31.344404 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:31.344316 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-6ggb8"] Jun 12 19:23:31.347286 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:31.347265 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-6ggb8" Jun 12 19:23:31.349773 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:31.349751 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 12 19:23:31.349890 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:31.349838 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-m9tbt\"" Jun 12 19:23:31.355705 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:31.355685 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-6ggb8"] Jun 12 19:23:31.406875 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:31.406826 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/26fa8283-905c-4337-80e8-24beea30be83-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-6ggb8\" (UID: \"26fa8283-905c-4337-80e8-24beea30be83\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-6ggb8" Jun 12 19:23:31.508145 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:31.508113 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/26fa8283-905c-4337-80e8-24beea30be83-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-6ggb8\" (UID: \"26fa8283-905c-4337-80e8-24beea30be83\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-6ggb8" Jun 12 19:23:31.508365 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:31.508262 2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 12 19:23:31.508365 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:31.508350 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26fa8283-905c-4337-80e8-24beea30be83-tls-certificates podName:26fa8283-905c-4337-80e8-24beea30be83 nodeName:}" failed. No retries permitted until 2026-06-12 19:23:32.008326552 +0000 UTC m=+62.669018493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/26fa8283-905c-4337-80e8-24beea30be83-tls-certificates") pod "prometheus-operator-admission-webhook-5cf667749c-6ggb8" (UID: "26fa8283-905c-4337-80e8-24beea30be83") : secret "prometheus-operator-admission-webhook-tls" not found Jun 12 19:23:32.013161 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:32.013122 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/26fa8283-905c-4337-80e8-24beea30be83-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-6ggb8\" (UID: \"26fa8283-905c-4337-80e8-24beea30be83\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-6ggb8" Jun 12 19:23:32.015563 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:32.015542 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/26fa8283-905c-4337-80e8-24beea30be83-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-6ggb8\" (UID: \"26fa8283-905c-4337-80e8-24beea30be83\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-6ggb8" Jun 12 19:23:32.092281 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:32.092249 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-sn4jn"] Jun 12 19:23:32.094905 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:32.094889 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-sn4jn" Jun 12 19:23:32.097535 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:32.097516 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-74dfr\"" Jun 12 19:23:32.097811 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:32.097796 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 12 19:23:32.097967 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:32.097951 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 12 19:23:32.107170 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:32.107149 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-sn4jn"] Jun 12 19:23:32.113450 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:32.113422 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpdm2\" (UniqueName: \"kubernetes.io/projected/a3a121e0-b8e7-4f72-98f0-d40f786dc27a-kube-api-access-mpdm2\") pod \"downloads-694c955b9-sn4jn\" (UID: \"a3a121e0-b8e7-4f72-98f0-d40f786dc27a\") " pod="openshift-console/downloads-694c955b9-sn4jn" Jun 12 19:23:32.214581 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:32.214546 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpdm2\" (UniqueName: \"kubernetes.io/projected/a3a121e0-b8e7-4f72-98f0-d40f786dc27a-kube-api-access-mpdm2\") pod \"downloads-694c955b9-sn4jn\" (UID: \"a3a121e0-b8e7-4f72-98f0-d40f786dc27a\") " pod="openshift-console/downloads-694c955b9-sn4jn" Jun 12 19:23:32.224529 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:32.224507 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpdm2\" (UniqueName: \"kubernetes.io/projected/a3a121e0-b8e7-4f72-98f0-d40f786dc27a-kube-api-access-mpdm2\") pod \"downloads-694c955b9-sn4jn\" (UID: \"a3a121e0-b8e7-4f72-98f0-d40f786dc27a\") " pod="openshift-console/downloads-694c955b9-sn4jn" Jun 12 19:23:32.256552 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:32.256522 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-6ggb8" Jun 12 19:23:32.375940 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:32.375907 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-6ggb8"] Jun 12 19:23:32.378542 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:23:32.378517 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26fa8283_905c_4337_80e8_24beea30be83.slice/crio-efa1c4ee2c923b4d1558e5f53ea9e99278bd1cf9755fe3bf9254c10a091904fa WatchSource:0}: Error finding container efa1c4ee2c923b4d1558e5f53ea9e99278bd1cf9755fe3bf9254c10a091904fa: Status 404 returned error can't find the container with id efa1c4ee2c923b4d1558e5f53ea9e99278bd1cf9755fe3bf9254c10a091904fa Jun 12 19:23:32.403653 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:32.403599 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-sn4jn" Jun 12 19:23:32.531061 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:32.530976 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-sn4jn"] Jun 12 19:23:32.533940 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:23:32.533916 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3a121e0_b8e7_4f72_98f0_d40f786dc27a.slice/crio-a24e54aea9c81f4a239620573eca30914522447dd53a8cd1da208739de30fb58 WatchSource:0}: Error finding container a24e54aea9c81f4a239620573eca30914522447dd53a8cd1da208739de30fb58: Status 404 returned error can't find the container with id a24e54aea9c81f4a239620573eca30914522447dd53a8cd1da208739de30fb58 Jun 12 19:23:33.158341 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:33.158305 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6q46h" Jun 12 19:23:33.199023 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:33.198993 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-sn4jn" event={"ID":"a3a121e0-b8e7-4f72-98f0-d40f786dc27a","Type":"ContainerStarted","Data":"a24e54aea9c81f4a239620573eca30914522447dd53a8cd1da208739de30fb58"} Jun 12 19:23:33.200338 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:33.200301 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-6ggb8" event={"ID":"26fa8283-905c-4337-80e8-24beea30be83","Type":"ContainerStarted","Data":"efa1c4ee2c923b4d1558e5f53ea9e99278bd1cf9755fe3bf9254c10a091904fa"} Jun 12 19:23:34.205733 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.205691 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-6ggb8" event={"ID":"26fa8283-905c-4337-80e8-24beea30be83","Type":"ContainerStarted","Data":"aa56d634a02e279c562a1f06f87df1c038b28ae19a3c0eff668a3baa81698f79"} Jun 12 19:23:34.206191 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.205934 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-6ggb8" Jun 12 19:23:34.211839 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.211817 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-6ggb8" Jun 12 19:23:34.226070 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.226018 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-6ggb8" podStartSLOduration=2.260449853 podStartE2EDuration="3.22600084s" totalImagesPullingTime="965.550987ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:23:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:34.225350695 +0000 UTC m=+64.886042680" watchObservedRunningTime="2026-06-12 19:23:34.22600084 +0000 UTC m=+64.886692803" Jun 12 19:23:34.408139 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.408099 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj"] Jun 12 19:23:34.411593 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.411567 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj" Jun 12 19:23:34.414557 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.414356 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 12 19:23:34.414557 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.414383 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 12 19:23:34.414557 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.414470 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 12 19:23:34.414557 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.414553 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-m7jvt\"" Jun 12 19:23:34.414825 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.414660 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 12 19:23:34.414884 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.414835 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 12 19:23:34.424130 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.424109 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj"] Jun 12 19:23:34.431239 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.431217 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96vmh\" (UniqueName: \"kubernetes.io/projected/711103d7-2a43-4136-a2a4-72faec23720f-kube-api-access-96vmh\") pod \"prometheus-operator-864fcfc6f9-ldnxj\" (UID: \"711103d7-2a43-4136-a2a4-72faec23720f\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj" Jun 12 19:23:34.431362 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.431259 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/711103d7-2a43-4136-a2a4-72faec23720f-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-ldnxj\" (UID: \"711103d7-2a43-4136-a2a4-72faec23720f\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj" Jun 12 19:23:34.431362 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.431317 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/711103d7-2a43-4136-a2a4-72faec23720f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-ldnxj\" (UID: \"711103d7-2a43-4136-a2a4-72faec23720f\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj" Jun 12 19:23:34.431362 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.431353 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/711103d7-2a43-4136-a2a4-72faec23720f-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-ldnxj\" (UID: \"711103d7-2a43-4136-a2a4-72faec23720f\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj" Jun 12 19:23:34.532414 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.532382 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/711103d7-2a43-4136-a2a4-72faec23720f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-ldnxj\" (UID: \"711103d7-2a43-4136-a2a4-72faec23720f\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj" Jun 12 19:23:34.532595 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.532432 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/711103d7-2a43-4136-a2a4-72faec23720f-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-ldnxj\" (UID: \"711103d7-2a43-4136-a2a4-72faec23720f\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj" Jun 12 19:23:34.532595 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.532508 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96vmh\" (UniqueName: \"kubernetes.io/projected/711103d7-2a43-4136-a2a4-72faec23720f-kube-api-access-96vmh\") pod \"prometheus-operator-864fcfc6f9-ldnxj\" (UID: \"711103d7-2a43-4136-a2a4-72faec23720f\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj" Jun 12 19:23:34.532595 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.532536 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/711103d7-2a43-4136-a2a4-72faec23720f-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-ldnxj\" (UID: \"711103d7-2a43-4136-a2a4-72faec23720f\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj" Jun 12 19:23:34.532916 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:34.532891 2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 12 19:23:34.533056 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:34.532966 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/711103d7-2a43-4136-a2a4-72faec23720f-prometheus-operator-tls podName:711103d7-2a43-4136-a2a4-72faec23720f nodeName:}" failed. No retries permitted until 2026-06-12 19:23:35.03294518 +0000 UTC m=+65.693637125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/711103d7-2a43-4136-a2a4-72faec23720f-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-ldnxj" (UID: "711103d7-2a43-4136-a2a4-72faec23720f") : secret "prometheus-operator-tls" not found Jun 12 19:23:34.533440 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.533380 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/711103d7-2a43-4136-a2a4-72faec23720f-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-ldnxj\" (UID: \"711103d7-2a43-4136-a2a4-72faec23720f\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj" Jun 12 19:23:34.536217 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.536193 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/711103d7-2a43-4136-a2a4-72faec23720f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-ldnxj\" (UID: \"711103d7-2a43-4136-a2a4-72faec23720f\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj" Jun 12 19:23:34.542370 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.542345 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96vmh\" (UniqueName: \"kubernetes.io/projected/711103d7-2a43-4136-a2a4-72faec23720f-kube-api-access-96vmh\") pod \"prometheus-operator-864fcfc6f9-ldnxj\" (UID: \"711103d7-2a43-4136-a2a4-72faec23720f\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj" Jun 12 19:23:34.633892 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.633860 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs\") pod \"network-metrics-daemon-k6wxl\" (UID: \"6ab368bb-96f3-41d1-9e60-6f404ee5802a\") " pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:23:34.633892 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.633894 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret\") pod \"global-pull-secret-syncer-j8228\" (UID: \"41a1faa1-36af-4860-ad2c-d355620f8ec0\") " pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:23:34.636744 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.636723 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 19:23:34.636859 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.636799 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 19:23:34.646437 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.646406 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ab368bb-96f3-41d1-9e60-6f404ee5802a-metrics-certs\") pod \"network-metrics-daemon-k6wxl\" (UID: \"6ab368bb-96f3-41d1-9e60-6f404ee5802a\") " pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:23:34.646521 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.646446 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41a1faa1-36af-4860-ad2c-d355620f8ec0-original-pull-secret\") pod \"global-pull-secret-syncer-j8228\" (UID: \"41a1faa1-36af-4860-ad2c-d355620f8ec0\") " pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:23:34.734806 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.734769 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgcjg\" (UniqueName: \"kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg\") pod \"network-check-target-mww4t\" (UID: \"dc6a1d8d-5158-42f3-90ab-df432dd6ef0a\") " pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:23:34.737655 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.737632 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 19:23:34.748066 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.748044 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 19:23:34.759165 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.759136 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgcjg\" (UniqueName: \"kubernetes.io/projected/dc6a1d8d-5158-42f3-90ab-df432dd6ef0a-kube-api-access-hgcjg\") pod \"network-check-target-mww4t\" (UID: \"dc6a1d8d-5158-42f3-90ab-df432dd6ef0a\") " pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:23:34.923475 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.923393 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xsgr9\"" Jun 12 19:23:34.925672 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.925642 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j8228" Jun 12 19:23:34.931004 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.930985 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:23:34.938674 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.938446 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5lk9h\"" Jun 12 19:23:34.940582 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:34.940562 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6wxl" Jun 12 19:23:35.037843 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:35.037368 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/711103d7-2a43-4136-a2a4-72faec23720f-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-ldnxj\" (UID: \"711103d7-2a43-4136-a2a4-72faec23720f\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj" Jun 12 19:23:35.040564 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:35.040542 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/711103d7-2a43-4136-a2a4-72faec23720f-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-ldnxj\" (UID: \"711103d7-2a43-4136-a2a4-72faec23720f\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj" Jun 12 19:23:35.089775 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:35.089743 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j8228"] Jun 12 19:23:35.095345 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:23:35.095319 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a1faa1_36af_4860_ad2c_d355620f8ec0.slice/crio-fca53beee4ea31d45fd806e4a34601bde6ee89840cb2921f18e7a25e2a1623d9 WatchSource:0}: Error finding container fca53beee4ea31d45fd806e4a34601bde6ee89840cb2921f18e7a25e2a1623d9: Status 404 returned error can't find the container with id fca53beee4ea31d45fd806e4a34601bde6ee89840cb2921f18e7a25e2a1623d9 Jun 12 19:23:35.107984 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:35.107956 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mww4t"] Jun 12 19:23:35.112544 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:23:35.112514 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc6a1d8d_5158_42f3_90ab_df432dd6ef0a.slice/crio-69749fe5c1d324920a8e0e7f0006dadf537c878d863b22f344633583e23b839d WatchSource:0}: Error finding container 69749fe5c1d324920a8e0e7f0006dadf537c878d863b22f344633583e23b839d: Status 404 returned error can't find the container with id 69749fe5c1d324920a8e0e7f0006dadf537c878d863b22f344633583e23b839d Jun 12 19:23:35.131091 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:35.131023 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k6wxl"] Jun 12 19:23:35.133914 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:23:35.133890 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ab368bb_96f3_41d1_9e60_6f404ee5802a.slice/crio-9ec4f096ab837216cd551cf34eef307599b9be7b0800033fa6d23d3a68d94788 WatchSource:0}: Error finding container 9ec4f096ab837216cd551cf34eef307599b9be7b0800033fa6d23d3a68d94788: Status 404 returned error can't find the container with id 9ec4f096ab837216cd551cf34eef307599b9be7b0800033fa6d23d3a68d94788 Jun 12 19:23:35.210343 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:35.210261 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mww4t" event={"ID":"dc6a1d8d-5158-42f3-90ab-df432dd6ef0a","Type":"ContainerStarted","Data":"69749fe5c1d324920a8e0e7f0006dadf537c878d863b22f344633583e23b839d"} Jun 12 19:23:35.211571 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:35.211537 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k6wxl" event={"ID":"6ab368bb-96f3-41d1-9e60-6f404ee5802a","Type":"ContainerStarted","Data":"9ec4f096ab837216cd551cf34eef307599b9be7b0800033fa6d23d3a68d94788"} Jun 12 19:23:35.212710 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:35.212673 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j8228" event={"ID":"41a1faa1-36af-4860-ad2c-d355620f8ec0","Type":"ContainerStarted","Data":"fca53beee4ea31d45fd806e4a34601bde6ee89840cb2921f18e7a25e2a1623d9"} Jun 12 19:23:35.323784 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:35.323752 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj" Jun 12 19:23:35.482100 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:35.482072 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj"] Jun 12 19:23:35.485217 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:23:35.485190 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod711103d7_2a43_4136_a2a4_72faec23720f.slice/crio-be7d49e276d4acfa3b57cb3bbddd199d85e04ce45a35189d28389d787ce35e08 WatchSource:0}: Error finding container be7d49e276d4acfa3b57cb3bbddd199d85e04ce45a35189d28389d787ce35e08: Status 404 returned error can't find the container with id be7d49e276d4acfa3b57cb3bbddd199d85e04ce45a35189d28389d787ce35e08 Jun 12 19:23:36.221795 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:36.221705 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj" event={"ID":"711103d7-2a43-4136-a2a4-72faec23720f","Type":"ContainerStarted","Data":"be7d49e276d4acfa3b57cb3bbddd199d85e04ce45a35189d28389d787ce35e08"} Jun 12 19:23:38.231492 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:38.231453 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k6wxl" event={"ID":"6ab368bb-96f3-41d1-9e60-6f404ee5802a","Type":"ContainerStarted","Data":"0e3fdbdf23081d6824bc951d48230f5c80b8a7d4b197ad44587ebefdd4981855"} Jun 12 19:23:38.231926 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:38.231525 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k6wxl" event={"ID":"6ab368bb-96f3-41d1-9e60-6f404ee5802a","Type":"ContainerStarted","Data":"a6d8d7a4b1c9af1cd36cb54cbf2fa09fcd87d5775494c42ac035165a66608adf"} Jun 12 19:23:38.234159 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:38.233540 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj" event={"ID":"711103d7-2a43-4136-a2a4-72faec23720f","Type":"ContainerStarted","Data":"44047c396eee3f2fc3c2c61bca1b8bbe0a6a1609f6fd3e1430a060ba7d662542"} Jun 12 19:23:38.234159 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:38.233594 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj" event={"ID":"711103d7-2a43-4136-a2a4-72faec23720f","Type":"ContainerStarted","Data":"654e93cc33599212012979bbd93d602047e25328529e6dd00e4f75f0d9536622"} Jun 12 19:23:38.280635 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:38.280546 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k6wxl" podStartSLOduration=67.01450583 podStartE2EDuration="1m9.280524162s" totalImagesPullingTime="2.266018332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:38.253860758 +0000 UTC m=+68.914552716" watchObservedRunningTime="2026-06-12 19:23:38.280524162 +0000 UTC m=+68.941216126" Jun 12 19:23:38.282311 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:38.282146 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-ldnxj" podStartSLOduration=2.346013557 podStartE2EDuration="4.282132435s" totalImagesPullingTime="1.936118878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:38.281094686 +0000 UTC m=+68.941786650" watchObservedRunningTime="2026-06-12 19:23:38.282132435 +0000 UTC m=+68.942824400" Jun 12 19:23:39.819441 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.819397 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt"] Jun 12 19:23:39.822443 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.822417 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" Jun 12 19:23:39.826343 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.826115 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 12 19:23:39.826343 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.826120 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 12 19:23:39.828221 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.827871 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6c88g\"" Jun 12 19:23:39.828221 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.828078 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 12 19:23:39.832083 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.832013 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt"] Jun 12 19:23:39.860535 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.860506 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hbg7b"] Jun 12 19:23:39.863074 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.863048 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.865898 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.865845 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 12 19:23:39.866336 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.866314 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vblzv\"" Jun 12 19:23:39.866509 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.866492 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 12 19:23:39.867484 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.866579 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 12 19:23:39.878759 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.878738 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f1ee4965-f678-4bad-9a72-dfb5dce76731-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-5gwnt\" (UID: \"f1ee4965-f678-4bad-9a72-dfb5dce76731\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" Jun 12 19:23:39.878886 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.878769 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-sys\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.878886 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.878790 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1ee4965-f678-4bad-9a72-dfb5dce76731-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-5gwnt\" (UID: \"f1ee4965-f678-4bad-9a72-dfb5dce76731\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" Jun 12 19:23:39.878886 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.878852 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f1ee4965-f678-4bad-9a72-dfb5dce76731-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-5gwnt\" (UID: \"f1ee4965-f678-4bad-9a72-dfb5dce76731\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" Jun 12 19:23:39.878886 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.878882 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-node-exporter-tls\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.879028 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.878908 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-node-exporter-wtmp\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.879028 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.878936 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-root\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.879028 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.878952 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-node-exporter-accelerators-collector-config\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.879028 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.878997 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-node-exporter-textfile\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.879028 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.879020 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.879233 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.879041 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqwpn\" (UniqueName: \"kubernetes.io/projected/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-kube-api-access-sqwpn\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.879233 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.879076 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-metrics-client-ca\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.879233 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.879100 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1ee4965-f678-4bad-9a72-dfb5dce76731-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-5gwnt\" (UID: \"f1ee4965-f678-4bad-9a72-dfb5dce76731\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" Jun 12 19:23:39.879233 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.879119 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1ee4965-f678-4bad-9a72-dfb5dce76731-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-5gwnt\" (UID: \"f1ee4965-f678-4bad-9a72-dfb5dce76731\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" Jun 12 19:23:39.879233 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.879145 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndhk6\" (UniqueName: \"kubernetes.io/projected/f1ee4965-f678-4bad-9a72-dfb5dce76731-kube-api-access-ndhk6\") pod \"kube-state-metrics-678bc549d7-5gwnt\" (UID: \"f1ee4965-f678-4bad-9a72-dfb5dce76731\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" Jun 12 19:23:39.980049 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.980007 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1ee4965-f678-4bad-9a72-dfb5dce76731-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-5gwnt\" (UID: \"f1ee4965-f678-4bad-9a72-dfb5dce76731\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" Jun 12 19:23:39.980210 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.980066 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndhk6\" (UniqueName: \"kubernetes.io/projected/f1ee4965-f678-4bad-9a72-dfb5dce76731-kube-api-access-ndhk6\") pod \"kube-state-metrics-678bc549d7-5gwnt\" (UID: \"f1ee4965-f678-4bad-9a72-dfb5dce76731\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" Jun 12 19:23:39.980210 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.980103 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f1ee4965-f678-4bad-9a72-dfb5dce76731-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-5gwnt\" (UID: \"f1ee4965-f678-4bad-9a72-dfb5dce76731\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" Jun 12 19:23:39.980210 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.980133 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-sys\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.980210 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.980160 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1ee4965-f678-4bad-9a72-dfb5dce76731-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-5gwnt\" (UID: \"f1ee4965-f678-4bad-9a72-dfb5dce76731\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" Jun 12 19:23:39.980210 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.980190 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f1ee4965-f678-4bad-9a72-dfb5dce76731-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-5gwnt\" (UID: \"f1ee4965-f678-4bad-9a72-dfb5dce76731\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" Jun 12 19:23:39.980415 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.980219 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-node-exporter-tls\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.980415 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.980243 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-node-exporter-wtmp\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.980415 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.980274 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-root\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.980415 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.980303 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-node-exporter-accelerators-collector-config\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.980415 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.980319 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-sys\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.980415 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.980334 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-node-exporter-textfile\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.980415 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.980380 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.980691 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.980422 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqwpn\" (UniqueName: \"kubernetes.io/projected/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-kube-api-access-sqwpn\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.980691 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.980456 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-metrics-client-ca\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.980691 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.980485 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1ee4965-f678-4bad-9a72-dfb5dce76731-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-5gwnt\" (UID: \"f1ee4965-f678-4bad-9a72-dfb5dce76731\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" Jun 12 19:23:39.980691 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.980675 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-node-exporter-textfile\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.980907 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.980890 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f1ee4965-f678-4bad-9a72-dfb5dce76731-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-5gwnt\" (UID: \"f1ee4965-f678-4bad-9a72-dfb5dce76731\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" Jun 12 19:23:39.982251 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.981008 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1ee4965-f678-4bad-9a72-dfb5dce76731-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-5gwnt\" (UID: \"f1ee4965-f678-4bad-9a72-dfb5dce76731\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" Jun 12 19:23:39.982251 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.981032 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-node-exporter-wtmp\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.982251 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.981072 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-root\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.982251 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.981583 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-node-exporter-accelerators-collector-config\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.982251 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.981642 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-metrics-client-ca\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.982251 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:39.981731 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 12 19:23:39.982251 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:39.981808 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-node-exporter-tls podName:ca6b05a0-5a22-48f1-be2d-2d12f476b21e nodeName:}" failed. No retries permitted until 2026-06-12 19:23:40.481785682 +0000 UTC m=+71.142477630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-node-exporter-tls") pod "node-exporter-hbg7b" (UID: "ca6b05a0-5a22-48f1-be2d-2d12f476b21e") : secret "node-exporter-tls" not found Jun 12 19:23:39.982251 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.982205 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f1ee4965-f678-4bad-9a72-dfb5dce76731-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-5gwnt\" (UID: \"f1ee4965-f678-4bad-9a72-dfb5dce76731\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" Jun 12 19:23:39.984688 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.984661 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:39.985488 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.985450 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1ee4965-f678-4bad-9a72-dfb5dce76731-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-5gwnt\" (UID: \"f1ee4965-f678-4bad-9a72-dfb5dce76731\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" Jun 12 19:23:39.986387 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.986348 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1ee4965-f678-4bad-9a72-dfb5dce76731-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-5gwnt\" (UID: \"f1ee4965-f678-4bad-9a72-dfb5dce76731\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" Jun 12 19:23:39.990019 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.989977 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndhk6\" (UniqueName: \"kubernetes.io/projected/f1ee4965-f678-4bad-9a72-dfb5dce76731-kube-api-access-ndhk6\") pod \"kube-state-metrics-678bc549d7-5gwnt\" (UID: \"f1ee4965-f678-4bad-9a72-dfb5dce76731\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" Jun 12 19:23:39.992204 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:39.992162 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqwpn\" (UniqueName: \"kubernetes.io/projected/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-kube-api-access-sqwpn\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:40.137651 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.137472 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" Jun 12 19:23:40.484788 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.484751 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-node-exporter-tls\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:40.487682 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.487655 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca6b05a0-5a22-48f1-be2d-2d12f476b21e-node-exporter-tls\") pod \"node-exporter-hbg7b\" (UID: \"ca6b05a0-5a22-48f1-be2d-2d12f476b21e\") " pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:40.774467 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.774347 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hbg7b" Jun 12 19:23:40.858501 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.858430 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 19:23:40.862518 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.862416 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.865683 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.865659 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 12 19:23:40.865901 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.865887 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 12 19:23:40.866066 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.866053 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 12 19:23:40.866203 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.866192 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 12 19:23:40.866349 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.866331 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 12 19:23:40.866842 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.866527 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 12 19:23:40.866842 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.866633 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 12 19:23:40.866842 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.866641 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 12 19:23:40.866842 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.866728 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 12 19:23:40.867109 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.866928 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p9n4g\"" Jun 12 19:23:40.878719 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.878691 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 19:23:40.887427 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.887100 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d45cbb48-fc60-45de-8c14-19708ab10e42-config-out\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.887427 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.887132 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-web-config\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.887427 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.887151 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d45cbb48-fc60-45de-8c14-19708ab10e42-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.887427 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.887165 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpt9c\" (UniqueName: \"kubernetes.io/projected/d45cbb48-fc60-45de-8c14-19708ab10e42-kube-api-access-zpt9c\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.887427 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.887189 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d45cbb48-fc60-45de-8c14-19708ab10e42-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.887427 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.887207 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.887427 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.887225 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-config-volume\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.887427 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.887243 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.887427 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.887266 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.887427 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.887295 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45cbb48-fc60-45de-8c14-19708ab10e42-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.887427 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.887325 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.888079 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.887462 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.888079 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.887515 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d45cbb48-fc60-45de-8c14-19708ab10e42-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.987985 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.987950 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d45cbb48-fc60-45de-8c14-19708ab10e42-config-out\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.987985 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.987998 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-web-config\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.988241 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.988027 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d45cbb48-fc60-45de-8c14-19708ab10e42-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.988241 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.988048 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpt9c\" (UniqueName: \"kubernetes.io/projected/d45cbb48-fc60-45de-8c14-19708ab10e42-kube-api-access-zpt9c\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.988241 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.988089 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d45cbb48-fc60-45de-8c14-19708ab10e42-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.988241 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.988134 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.988241 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.988165 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-config-volume\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.988241 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.988200 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.988241 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.988233 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.988558 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.988261 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45cbb48-fc60-45de-8c14-19708ab10e42-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.988558 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.988293 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.988558 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.988330 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.988558 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.988366 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d45cbb48-fc60-45de-8c14-19708ab10e42-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.988829 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:40.988793 2558 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 12 19:23:40.988948 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:40.988873 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-main-tls podName:d45cbb48-fc60-45de-8c14-19708ab10e42 nodeName:}" failed. No retries permitted until 2026-06-12 19:23:41.488851268 +0000 UTC m=+72.149543215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "d45cbb48-fc60-45de-8c14-19708ab10e42") : secret "alertmanager-main-tls" not found Jun 12 19:23:40.989076 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:40.989044 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d45cbb48-fc60-45de-8c14-19708ab10e42-alertmanager-trusted-ca-bundle podName:d45cbb48-fc60-45de-8c14-19708ab10e42 nodeName:}" failed. No retries permitted until 2026-06-12 19:23:41.489024637 +0000 UTC m=+72.149716579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/d45cbb48-fc60-45de-8c14-19708ab10e42-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "d45cbb48-fc60-45de-8c14-19708ab10e42") : configmap references non-existent config key: ca-bundle.crt Jun 12 19:23:40.989435 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.989406 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d45cbb48-fc60-45de-8c14-19708ab10e42-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.990655 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.990631 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d45cbb48-fc60-45de-8c14-19708ab10e42-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.993451 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.993430 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-config-volume\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.993553 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.993376 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d45cbb48-fc60-45de-8c14-19708ab10e42-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.994233 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.994210 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d45cbb48-fc60-45de-8c14-19708ab10e42-config-out\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.995976 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.995934 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.996078 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.995983 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.996078 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.996058 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-web-config\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.997373 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.997352 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.997623 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.997513 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:40.999601 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:40.999560 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpt9c\" (UniqueName: \"kubernetes.io/projected/d45cbb48-fc60-45de-8c14-19708ab10e42-kube-api-access-zpt9c\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:41.490882 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.488210 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt"] Jun 12 19:23:41.493490 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:23:41.493315 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1ee4965_f678_4bad_9a72_dfb5dce76731.slice/crio-94c96dd2deb4c5d05a6043846a23814fd064000845b6e3f7a724fc4873a65bf3 WatchSource:0}: Error finding container 94c96dd2deb4c5d05a6043846a23814fd064000845b6e3f7a724fc4873a65bf3: Status 404 returned error can't find the container with id 94c96dd2deb4c5d05a6043846a23814fd064000845b6e3f7a724fc4873a65bf3 Jun 12 19:23:41.498412 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.498316 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45cbb48-fc60-45de-8c14-19708ab10e42-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:41.498412 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.498363 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:41.499331 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.499307 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45cbb48-fc60-45de-8c14-19708ab10e42-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:41.501509 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.501483 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:41.777194 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.777155 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp"] Jun 12 19:23:41.778137 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.777855 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:23:41.780680 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.779728 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.783388 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.783038 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-eh77q8lasc9sl\"" Jun 12 19:23:41.783388 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.783095 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 12 19:23:41.783388 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.783108 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 12 19:23:41.783388 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.783165 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 12 19:23:41.783388 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.783042 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 12 19:23:41.783388 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.783097 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 12 19:23:41.784849 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.784008 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-w5zzv\"" Jun 12 19:23:41.795636 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.795577 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp"] Jun 12 19:23:41.802133 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.802104 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-secret-thanos-querier-tls\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.802237 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.802155 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtnvg\" (UniqueName: \"kubernetes.io/projected/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-kube-api-access-qtnvg\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.802237 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.802212 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.802342 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.802281 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-secret-grpc-tls\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.802342 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.802312 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-metrics-client-ca\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.802445 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.802348 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.802445 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.802398 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.802564 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.802451 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.903474 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.903443 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-secret-grpc-tls\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.903902 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.903486 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-metrics-client-ca\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.903902 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.903523 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.903902 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.903550 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.903902 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.903597 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.903902 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.903667 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-secret-thanos-querier-tls\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.903902 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.903701 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtnvg\" (UniqueName: \"kubernetes.io/projected/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-kube-api-access-qtnvg\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.903902 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.903729 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.905599 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.905328 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-metrics-client-ca\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.907476 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.907425 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-secret-thanos-querier-tls\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.909708 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.909676 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.909816 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.909705 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-secret-grpc-tls\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.910821 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.910791 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.911173 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.911151 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.911549 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.911525 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.914011 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.913971 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtnvg\" (UniqueName: \"kubernetes.io/projected/30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce-kube-api-access-qtnvg\") pod \"thanos-querier-58f5cb5c88-nx2rp\" (UID: \"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce\") " pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:41.956888 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:41.956860 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 19:23:42.097174 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:42.096865 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:23:42.171713 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:23:42.171673 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd45cbb48_fc60_45de_8c14_19708ab10e42.slice/crio-2205202622eb0bc887458c3758d80e40e5354ea1cabcc5ca98c53c96b3759f63 WatchSource:0}: Error finding container 2205202622eb0bc887458c3758d80e40e5354ea1cabcc5ca98c53c96b3759f63: Status 404 returned error can't find the container with id 2205202622eb0bc887458c3758d80e40e5354ea1cabcc5ca98c53c96b3759f63 Jun 12 19:23:42.254356 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:42.254305 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j8228" event={"ID":"41a1faa1-36af-4860-ad2c-d355620f8ec0","Type":"ContainerStarted","Data":"2383bbca4a3d2bab708dc308fe99df85787fc110550f102c0494a1befccf8d86"} Jun 12 19:23:42.255705 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:42.255681 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45cbb48-fc60-45de-8c14-19708ab10e42","Type":"ContainerStarted","Data":"2205202622eb0bc887458c3758d80e40e5354ea1cabcc5ca98c53c96b3759f63"} Jun 12 19:23:42.256944 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:42.256897 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hbg7b" event={"ID":"ca6b05a0-5a22-48f1-be2d-2d12f476b21e","Type":"ContainerStarted","Data":"5214c538436d8a1ba322be8279798d5026b278211ce52c45f13cfe4d53812f3d"} Jun 12 19:23:42.258431 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:42.258384 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" event={"ID":"f1ee4965-f678-4bad-9a72-dfb5dce76731","Type":"ContainerStarted","Data":"94c96dd2deb4c5d05a6043846a23814fd064000845b6e3f7a724fc4873a65bf3"} Jun 12 19:23:42.261627 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:42.261549 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mww4t" event={"ID":"dc6a1d8d-5158-42f3-90ab-df432dd6ef0a","Type":"ContainerStarted","Data":"85939a27f6d6fc0edc876a68917c771ff0de015e1bbc3ff96fce7e04382a22a8"} Jun 12 19:23:42.261790 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:42.261771 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:23:42.272636 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:42.271135 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j8228" podStartSLOduration=66.029804741 podStartE2EDuration="1m12.271117715s" totalImagesPullingTime="6.241312974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:42.270434818 +0000 UTC m=+72.931126772" watchObservedRunningTime="2026-06-12 19:23:42.271117715 +0000 UTC m=+72.931809679" Jun 12 19:23:42.288333 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:42.287957 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mww4t" podStartSLOduration=66.081924742 podStartE2EDuration="1m12.287940727s" totalImagesPullingTime="6.206015985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:42.285372145 +0000 UTC m=+72.946064110" watchObservedRunningTime="2026-06-12 19:23:42.287940727 +0000 UTC m=+72.948632691" Jun 12 19:23:42.328089 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:42.328052 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp"] Jun 12 19:23:42.331494 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:23:42.331456 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30bcb6cc_2daf_4e8a_86e6_ec5cce1b31ce.slice/crio-f0d2090abeb1f144b09f9f4929fa59bafdb67db0ab0104742516baa1c7ce0622 WatchSource:0}: Error finding container f0d2090abeb1f144b09f9f4929fa59bafdb67db0ab0104742516baa1c7ce0622: Status 404 returned error can't find the container with id f0d2090abeb1f144b09f9f4929fa59bafdb67db0ab0104742516baa1c7ce0622 Jun 12 19:23:43.267907 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:43.267814 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" event={"ID":"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce","Type":"ContainerStarted","Data":"f0d2090abeb1f144b09f9f4929fa59bafdb67db0ab0104742516baa1c7ce0622"} Jun 12 19:23:43.270806 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:43.270773 2558 generic.go:356] "Generic (PLEG): container finished" podID="ca6b05a0-5a22-48f1-be2d-2d12f476b21e" containerID="5ce5c0de7de07461cb4414d1b5d861a77782cabce3d72e13fbe98520c241c768" exitCode=0 Jun 12 19:23:43.271097 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:43.271065 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hbg7b" event={"ID":"ca6b05a0-5a22-48f1-be2d-2d12f476b21e","Type":"ContainerDied","Data":"5ce5c0de7de07461cb4414d1b5d861a77782cabce3d72e13fbe98520c241c768"} Jun 12 19:23:44.201885 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.201847 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7bff96ccb-r6bg4"] Jun 12 19:23:44.203841 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.203816 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.207583 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.207558 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 12 19:23:44.207841 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.207825 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vphk9\"" Jun 12 19:23:44.208017 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.208003 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 12 19:23:44.208157 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.208140 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 12 19:23:44.208253 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.208239 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-e1kglj63dnpr7\"" Jun 12 19:23:44.208339 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.208326 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 12 19:23:44.215561 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.215531 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7bff96ccb-r6bg4"] Jun 12 19:23:44.328700 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.328583 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff9bab00-1b0e-4299-be03-8ec64317cccd-client-ca-bundle\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.328700 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.328657 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ff9bab00-1b0e-4299-be03-8ec64317cccd-secret-metrics-server-client-certs\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.329210 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.328747 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff9bab00-1b0e-4299-be03-8ec64317cccd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.329210 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.328792 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx9jr\" (UniqueName: \"kubernetes.io/projected/ff9bab00-1b0e-4299-be03-8ec64317cccd-kube-api-access-qx9jr\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.329210 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.328824 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ff9bab00-1b0e-4299-be03-8ec64317cccd-metrics-server-audit-profiles\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.329210 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.328921 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ff9bab00-1b0e-4299-be03-8ec64317cccd-audit-log\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.329210 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.328963 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ff9bab00-1b0e-4299-be03-8ec64317cccd-secret-metrics-server-tls\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.429961 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.429913 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff9bab00-1b0e-4299-be03-8ec64317cccd-client-ca-bundle\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.430140 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.429973 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ff9bab00-1b0e-4299-be03-8ec64317cccd-secret-metrics-server-client-certs\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.430140 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.430109 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff9bab00-1b0e-4299-be03-8ec64317cccd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.430261 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.430146 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx9jr\" (UniqueName: \"kubernetes.io/projected/ff9bab00-1b0e-4299-be03-8ec64317cccd-kube-api-access-qx9jr\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.430261 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.430173 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ff9bab00-1b0e-4299-be03-8ec64317cccd-metrics-server-audit-profiles\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.430261 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.430237 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ff9bab00-1b0e-4299-be03-8ec64317cccd-audit-log\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.430411 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.430278 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ff9bab00-1b0e-4299-be03-8ec64317cccd-secret-metrics-server-tls\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.430948 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.430914 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff9bab00-1b0e-4299-be03-8ec64317cccd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.431063 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.430967 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ff9bab00-1b0e-4299-be03-8ec64317cccd-audit-log\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.431586 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.431559 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ff9bab00-1b0e-4299-be03-8ec64317cccd-metrics-server-audit-profiles\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.433183 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.433161 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff9bab00-1b0e-4299-be03-8ec64317cccd-client-ca-bundle\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.433283 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.433233 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ff9bab00-1b0e-4299-be03-8ec64317cccd-secret-metrics-server-client-certs\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.433774 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.433752 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ff9bab00-1b0e-4299-be03-8ec64317cccd-secret-metrics-server-tls\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.441133 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.441110 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx9jr\" (UniqueName: \"kubernetes.io/projected/ff9bab00-1b0e-4299-be03-8ec64317cccd-kube-api-access-qx9jr\") pod \"metrics-server-7bff96ccb-r6bg4\" (UID: \"ff9bab00-1b0e-4299-be03-8ec64317cccd\") " pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.514862 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.514808 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:23:44.574426 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.574390 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-qqb6s"] Jun 12 19:23:44.577011 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.576984 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-qqb6s" Jun 12 19:23:44.582787 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.582755 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 12 19:23:44.582927 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.582910 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tw2sp\"" Jun 12 19:23:44.588727 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.588701 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-qqb6s"] Jun 12 19:23:44.632114 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.632078 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/414aedc3-d438-4187-ade2-06def9a8597f-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-qqb6s\" (UID: \"414aedc3-d438-4187-ade2-06def9a8597f\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-qqb6s" Jun 12 19:23:44.632296 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.632181 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw4jc\" (UniqueName: \"kubernetes.io/projected/414aedc3-d438-4187-ade2-06def9a8597f-kube-api-access-pw4jc\") pod \"monitoring-plugin-589576dfc7-qqb6s\" (UID: \"414aedc3-d438-4187-ade2-06def9a8597f\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-qqb6s" Jun 12 19:23:44.733760 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.733714 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/414aedc3-d438-4187-ade2-06def9a8597f-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-qqb6s\" (UID: \"414aedc3-d438-4187-ade2-06def9a8597f\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-qqb6s" Jun 12 19:23:44.733946 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.733773 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw4jc\" (UniqueName: \"kubernetes.io/projected/414aedc3-d438-4187-ade2-06def9a8597f-kube-api-access-pw4jc\") pod \"monitoring-plugin-589576dfc7-qqb6s\" (UID: \"414aedc3-d438-4187-ade2-06def9a8597f\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-qqb6s" Jun 12 19:23:44.733946 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:44.733886 2558 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 12 19:23:44.734055 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:23:44.733964 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/414aedc3-d438-4187-ade2-06def9a8597f-monitoring-plugin-cert podName:414aedc3-d438-4187-ade2-06def9a8597f nodeName:}" failed. No retries permitted until 2026-06-12 19:23:45.233942902 +0000 UTC m=+75.894634864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/414aedc3-d438-4187-ade2-06def9a8597f-monitoring-plugin-cert") pod "monitoring-plugin-589576dfc7-qqb6s" (UID: "414aedc3-d438-4187-ade2-06def9a8597f") : secret "monitoring-plugin-cert" not found Jun 12 19:23:44.751789 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:44.751757 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw4jc\" (UniqueName: \"kubernetes.io/projected/414aedc3-d438-4187-ade2-06def9a8597f-kube-api-access-pw4jc\") pod \"monitoring-plugin-589576dfc7-qqb6s\" (UID: \"414aedc3-d438-4187-ade2-06def9a8597f\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-qqb6s" Jun 12 19:23:45.239281 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:45.239244 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/414aedc3-d438-4187-ade2-06def9a8597f-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-qqb6s\" (UID: \"414aedc3-d438-4187-ade2-06def9a8597f\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-qqb6s" Jun 12 19:23:45.242136 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:45.242105 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/414aedc3-d438-4187-ade2-06def9a8597f-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-qqb6s\" (UID: \"414aedc3-d438-4187-ade2-06def9a8597f\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-qqb6s" Jun 12 19:23:45.490297 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:45.490207 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-qqb6s" Jun 12 19:23:46.148008 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.147976 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 19:23:46.151458 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.151433 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.159004 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.158977 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 12 19:23:46.161138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.160488 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 12 19:23:46.161138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.160836 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 12 19:23:46.161448 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.161428 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 12 19:23:46.161689 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.161672 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 12 19:23:46.161777 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.161718 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 12 19:23:46.161902 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.161886 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 12 19:23:46.161990 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.161672 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 12 19:23:46.162165 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.162151 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 12 19:23:46.162913 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.162888 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kb45k\"" Jun 12 19:23:46.163110 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.163095 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 12 19:23:46.163292 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.163278 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-73fg1e9uukrm7\"" Jun 12 19:23:46.164376 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.164314 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 12 19:23:46.164940 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.164780 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 12 19:23:46.166969 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.166949 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 12 19:23:46.168261 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.168241 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 12 19:23:46.214266 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.214226 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 19:23:46.247597 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.247558 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.247801 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.247633 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.247801 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.247658 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.247801 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.247695 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.247801 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.247720 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.247801 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.247750 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.247801 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.247775 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.247801 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.247797 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.248160 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.247824 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.248305 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.248286 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-web-config\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.248383 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.248327 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-config\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.248383 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.248368 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.248479 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.248407 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/351bc07a-027b-4050-9a40-6d02e076366e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.248479 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.248440 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/351bc07a-027b-4050-9a40-6d02e076366e-config-out\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.248479 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.248462 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.248645 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.248486 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.248645 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.248514 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5jch\" (UniqueName: \"kubernetes.io/projected/351bc07a-027b-4050-9a40-6d02e076366e-kube-api-access-m5jch\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.248645 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.248545 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.248834 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.248809 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.248981 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.248863 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.350873 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.350838 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/351bc07a-027b-4050-9a40-6d02e076366e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.350873 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.350881 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/351bc07a-027b-4050-9a40-6d02e076366e-config-out\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.351106 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.350910 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.351106 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.351063 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.351197 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.351116 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5jch\" (UniqueName: \"kubernetes.io/projected/351bc07a-027b-4050-9a40-6d02e076366e-kube-api-access-m5jch\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.351197 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.351154 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.351292 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.351210 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.351292 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.351247 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.351292 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.351283 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.351495 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.351310 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.351495 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.351336 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.351495 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.351375 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.351495 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.351402 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.351495 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.351438 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.351495 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.351466 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.351495 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.351491 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.352002 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.351518 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.352002 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.351544 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-web-config\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.352002 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.351579 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-config\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.352002 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.351654 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.352320 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.352288 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.352443 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.352338 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.353189 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.353074 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.354003 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.353851 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.357156 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.354237 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.357156 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.356571 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/351bc07a-027b-4050-9a40-6d02e076366e-config-out\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.357156 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.357017 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.357156 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.357105 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.358628 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.357489 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/351bc07a-027b-4050-9a40-6d02e076366e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.358628 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.357816 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.358628 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.358391 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.358812 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.358793 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-web-config\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.359099 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.359059 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.360245 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.360223 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-config\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.361841 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.361744 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.362036 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.361998 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.362126 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.362067 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.362915 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.362894 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.364247 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.364228 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.369113 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.369086 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5jch\" (UniqueName: \"kubernetes.io/projected/351bc07a-027b-4050-9a40-6d02e076366e-kube-api-access-m5jch\") pod \"prometheus-k8s-0\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:46.468342 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:46.468256 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:23:48.187830 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:48.187801 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-789b778c76-rx8vs" Jun 12 19:23:52.414887 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:52.414797 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 19:23:52.435849 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:52.435700 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-qqb6s"] Jun 12 19:23:52.450924 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:52.450860 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7bff96ccb-r6bg4"] Jun 12 19:23:52.563520 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:23:52.563486 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod351bc07a_027b_4050_9a40_6d02e076366e.slice/crio-c33fa9dd7b8d83d3e381937f10cad55950a20abcadba29ea6cf973543cb7f941 WatchSource:0}: Error finding container c33fa9dd7b8d83d3e381937f10cad55950a20abcadba29ea6cf973543cb7f941: Status 404 returned error can't find the container with id c33fa9dd7b8d83d3e381937f10cad55950a20abcadba29ea6cf973543cb7f941 Jun 12 19:23:52.564067 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:23:52.564039 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod414aedc3_d438_4187_ade2_06def9a8597f.slice/crio-f0ad829cd4c04935da4dfb28636aa93c11054d197c5536b5b1af963704af8788 WatchSource:0}: Error finding container f0ad829cd4c04935da4dfb28636aa93c11054d197c5536b5b1af963704af8788: Status 404 returned error can't find the container with id f0ad829cd4c04935da4dfb28636aa93c11054d197c5536b5b1af963704af8788 Jun 12 19:23:52.565657 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:23:52.565304 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff9bab00_1b0e_4299_be03_8ec64317cccd.slice/crio-d394369632c2837d5cd08f0c0101eb5817aa935d7beb067f8a45f722df6c4f5b WatchSource:0}: Error finding container d394369632c2837d5cd08f0c0101eb5817aa935d7beb067f8a45f722df6c4f5b: Status 404 returned error can't find the container with id d394369632c2837d5cd08f0c0101eb5817aa935d7beb067f8a45f722df6c4f5b Jun 12 19:23:53.322909 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.322852 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-qqb6s" event={"ID":"414aedc3-d438-4187-ade2-06def9a8597f","Type":"ContainerStarted","Data":"f0ad829cd4c04935da4dfb28636aa93c11054d197c5536b5b1af963704af8788"} Jun 12 19:23:53.328870 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.326253 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-sn4jn" event={"ID":"a3a121e0-b8e7-4f72-98f0-d40f786dc27a","Type":"ContainerStarted","Data":"bf5fa413c3f4cb1e4582177ea4f890e9d5a06e8405abaa1bb04ef634a3cbbd1b"} Jun 12 19:23:53.328870 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.327026 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-sn4jn" Jun 12 19:23:53.333361 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.332447 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-sn4jn" Jun 12 19:23:53.335741 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.335491 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" event={"ID":"f1ee4965-f678-4bad-9a72-dfb5dce76731","Type":"ContainerStarted","Data":"8c31daf7bcbac65cee3f96e8235ed3194a7456c2f2487cb36e82e78c45af6805"} Jun 12 19:23:53.335741 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.335536 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" event={"ID":"f1ee4965-f678-4bad-9a72-dfb5dce76731","Type":"ContainerStarted","Data":"6205b0dbeb67af206568985eb67066ed2462e5b95330f11568f6370ba7795ed4"} Jun 12 19:23:53.335741 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.335561 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" event={"ID":"f1ee4965-f678-4bad-9a72-dfb5dce76731","Type":"ContainerStarted","Data":"182d4874798cac132c7ae004731b0cdec72f6c75d5d79943ce706a57d1607048"} Jun 12 19:23:53.352469 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.352414 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-sn4jn" podStartSLOduration=1.60150426 podStartE2EDuration="21.352396682s" totalImagesPullingTime="19.750892422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:23:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:53.352162388 +0000 UTC m=+84.012854352" watchObservedRunningTime="2026-06-12 19:23:53.352396682 +0000 UTC m=+84.013088647" Jun 12 19:23:53.362575 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.362544 2558 generic.go:356] "Generic (PLEG): container finished" podID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerID="19b78494bd1a2dfa6beffbaf6a8bd746c4ff0bbc16d17083452b2935f63214a9" exitCode=0 Jun 12 19:23:53.363397 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.363374 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45cbb48-fc60-45de-8c14-19708ab10e42","Type":"ContainerDied","Data":"19b78494bd1a2dfa6beffbaf6a8bd746c4ff0bbc16d17083452b2935f63214a9"} Jun 12 19:23:53.380809 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.380783 2558 generic.go:356] "Generic (PLEG): container finished" podID="351bc07a-027b-4050-9a40-6d02e076366e" containerID="d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6" exitCode=0 Jun 12 19:23:53.380991 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.380972 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351bc07a-027b-4050-9a40-6d02e076366e","Type":"ContainerDied","Data":"d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6"} Jun 12 19:23:53.381169 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.381149 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351bc07a-027b-4050-9a40-6d02e076366e","Type":"ContainerStarted","Data":"c33fa9dd7b8d83d3e381937f10cad55950a20abcadba29ea6cf973543cb7f941"} Jun 12 19:23:53.388621 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.388583 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" event={"ID":"ff9bab00-1b0e-4299-be03-8ec64317cccd","Type":"ContainerStarted","Data":"d394369632c2837d5cd08f0c0101eb5817aa935d7beb067f8a45f722df6c4f5b"} Jun 12 19:23:53.395388 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.395365 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hbg7b" event={"ID":"ca6b05a0-5a22-48f1-be2d-2d12f476b21e","Type":"ContainerStarted","Data":"0c27eb6ba27555a89c04b8578cb06d65bba3c00e22fb1198bf0e1e6e30fe3b13"} Jun 12 19:23:53.395550 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.395534 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hbg7b" event={"ID":"ca6b05a0-5a22-48f1-be2d-2d12f476b21e","Type":"ContainerStarted","Data":"557f359e278c9a59326dc008f2982c669d9778ba9fc19bbc8373a2b20ff277b6"} Jun 12 19:23:53.405044 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.404890 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" event={"ID":"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce","Type":"ContainerStarted","Data":"af9f60616a6054271ecba7873e34280cae9ba6f2d5a6f36907bd18a01ce62379"} Jun 12 19:23:53.405044 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.404955 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" event={"ID":"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce","Type":"ContainerStarted","Data":"39f60499fd265c366bf33a2380d4e1c5a5674913bea07ea0a90fa10e76f3bb33"} Jun 12 19:23:53.405044 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.404988 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" event={"ID":"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce","Type":"ContainerStarted","Data":"3e82f3fd671cf1ab56758392525e3a204f108eab0c612ba5b64f21a5b6eef38c"} Jun 12 19:23:53.472950 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.471478 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-5gwnt" podStartSLOduration=3.740786282 podStartE2EDuration="14.471455753s" totalImagesPullingTime="10.730669471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:53.401684339 +0000 UTC m=+84.062376304" watchObservedRunningTime="2026-06-12 19:23:53.471455753 +0000 UTC m=+84.132147718" Jun 12 19:23:53.499291 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:53.497931 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hbg7b" podStartSLOduration=13.534858436 podStartE2EDuration="14.497908301s" totalImagesPullingTime="879.602803ms" totalInitContainerRuntime="83.447062ms" isStatefulPod=true podCreationTimestamp="2026-06-12 19:23:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:53.496906906 +0000 UTC m=+84.157598871" watchObservedRunningTime="2026-06-12 19:23:53.497908301 +0000 UTC m=+84.158600265" Jun 12 19:23:59.454266 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:59.454121 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45cbb48-fc60-45de-8c14-19708ab10e42","Type":"ContainerStarted","Data":"7280753607cf4f2b45cd270216047a941945f0e646a719a0ce7c9c7eb274136c"} Jun 12 19:23:59.454266 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:59.454207 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45cbb48-fc60-45de-8c14-19708ab10e42","Type":"ContainerStarted","Data":"1f9800f03c5e715b0bc398128949a2f307b0da1475b26380016edecc1d04b0ab"} Jun 12 19:23:59.457301 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:59.457172 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351bc07a-027b-4050-9a40-6d02e076366e","Type":"ContainerStarted","Data":"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9"} Jun 12 19:23:59.457301 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:59.457242 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351bc07a-027b-4050-9a40-6d02e076366e","Type":"ContainerStarted","Data":"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3"} Jun 12 19:23:59.459636 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:59.459244 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" event={"ID":"ff9bab00-1b0e-4299-be03-8ec64317cccd","Type":"ContainerStarted","Data":"1017511c2e7f8954bf6715c23fcf800716f75c54e764491d06193be65cd43ee5"} Jun 12 19:23:59.466658 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:59.466344 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" event={"ID":"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce","Type":"ContainerStarted","Data":"a4c3f3a91e6bbf13d09aaff2a3513442ff876c715e2a07086d0c2755b78dba44"} Jun 12 19:23:59.466658 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:59.466412 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" event={"ID":"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce","Type":"ContainerStarted","Data":"be949429fc6b020b75f7f425d57ff30863ea4d99be044053033f28eef63eab2b"} Jun 12 19:23:59.466658 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:59.466452 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" event={"ID":"30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce","Type":"ContainerStarted","Data":"cea53170e962ad757b0a3ed1fc531d7c3229931734c6cd35400002cf82c48a42"} Jun 12 19:23:59.469014 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:59.468963 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-qqb6s" event={"ID":"414aedc3-d438-4187-ade2-06def9a8597f","Type":"ContainerStarted","Data":"7ff82d5dbef17a8e8b690caceb1e983ffabb564767f00896e4cefc2be05ec541"} Jun 12 19:23:59.469513 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:59.469423 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-qqb6s" Jun 12 19:23:59.477637 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:59.477530 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-qqb6s" Jun 12 19:23:59.480661 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:59.480307 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" podStartSLOduration=9.369673195 podStartE2EDuration="15.480292499s" totalImagesPullingTime="6.110619304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:23:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:59.478505545 +0000 UTC m=+90.139197510" watchObservedRunningTime="2026-06-12 19:23:59.480292499 +0000 UTC m=+90.140984462" Jun 12 19:23:59.504444 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:23:59.504390 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" podStartSLOduration=2.430386204 podStartE2EDuration="18.504368586s" totalImagesPullingTime="16.073982382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:23:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:59.502788298 +0000 UTC m=+90.163480264" watchObservedRunningTime="2026-06-12 19:23:59.504368586 +0000 UTC m=+90.165060550" Jun 12 19:24:00.478069 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:00.478026 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45cbb48-fc60-45de-8c14-19708ab10e42","Type":"ContainerStarted","Data":"fc05fa7b65e98c149df43ee63af37b992edf61be7a7c05f105a7832b962a6e3d"} Jun 12 19:24:00.478653 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:00.478112 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45cbb48-fc60-45de-8c14-19708ab10e42","Type":"ContainerStarted","Data":"b2edcc4343eac8b3505cc2c1d25640c56bc9ae8a60aaae4db2e432c279fe9abb"} Jun 12 19:24:00.478653 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:00.478156 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45cbb48-fc60-45de-8c14-19708ab10e42","Type":"ContainerStarted","Data":"9cc4f3db1599d75ae45a5369073bbcde544e5014dbf7d970d2dec792bfc44f59"} Jun 12 19:24:00.478653 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:00.478191 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45cbb48-fc60-45de-8c14-19708ab10e42","Type":"ContainerStarted","Data":"285ff259ee965114f1f98b91d42f1fcf9a560823081d79a4fda3079b9c934cb5"} Jun 12 19:24:00.482240 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:00.482209 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351bc07a-027b-4050-9a40-6d02e076366e","Type":"ContainerStarted","Data":"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5"} Jun 12 19:24:00.482367 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:00.482287 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351bc07a-027b-4050-9a40-6d02e076366e","Type":"ContainerStarted","Data":"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2"} Jun 12 19:24:00.483706 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:00.483687 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:24:00.483818 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:00.483744 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351bc07a-027b-4050-9a40-6d02e076366e","Type":"ContainerStarted","Data":"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4"} Jun 12 19:24:00.483818 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:00.483808 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351bc07a-027b-4050-9a40-6d02e076366e","Type":"ContainerStarted","Data":"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175"} Jun 12 19:24:00.490548 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:00.490529 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-58f5cb5c88-nx2rp" Jun 12 19:24:00.508408 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:00.508352 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-qqb6s" podStartSLOduration=10.397223788 podStartE2EDuration="16.508333761s" totalImagesPullingTime="6.111109973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:23:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:59.536975325 +0000 UTC m=+90.197667290" watchObservedRunningTime="2026-06-12 19:24:00.508333761 +0000 UTC m=+91.169025727" Jun 12 19:24:00.508748 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:00.508711 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.097112686 podStartE2EDuration="20.508701384s" totalImagesPullingTime="15.383549944s" totalInitContainerRuntime="28.038754ms" isStatefulPod=false podCreationTimestamp="2026-06-12 19:23:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:24:00.506151102 +0000 UTC m=+91.166843068" watchObservedRunningTime="2026-06-12 19:24:00.508701384 +0000 UTC m=+91.169393349" Jun 12 19:24:00.569016 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:00.568954 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=8.859665353 podStartE2EDuration="14.568935478s" totalImagesPullingTime="5.658350546s" totalInitContainerRuntime="50.919579ms" isStatefulPod=false podCreationTimestamp="2026-06-12 19:23:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:24:00.56800291 +0000 UTC m=+91.228694873" watchObservedRunningTime="2026-06-12 19:24:00.568935478 +0000 UTC m=+91.229627440" Jun 12 19:24:01.468595 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:01.468557 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:24:04.516001 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:04.515969 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:24:04.516398 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:04.516065 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:24:13.274079 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:13.274047 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mww4t" Jun 12 19:24:24.520795 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:24.520767 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:24:24.524469 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:24.524448 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7bff96ccb-r6bg4" Jun 12 19:24:46.469430 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:46.469381 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:24:46.489558 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:46.489535 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:24:46.682240 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:24:46.682209 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:00.137453 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:00.137415 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 19:25:00.138013 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:00.137727 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="alertmanager" containerID="cri-o://1f9800f03c5e715b0bc398128949a2f307b0da1475b26380016edecc1d04b0ab" gracePeriod=120 Jun 12 19:25:00.138013 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:00.137800 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="kube-rbac-proxy-metric" containerID="cri-o://b2edcc4343eac8b3505cc2c1d25640c56bc9ae8a60aaae4db2e432c279fe9abb" gracePeriod=120 Jun 12 19:25:00.138013 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:00.137852 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="kube-rbac-proxy" containerID="cri-o://9cc4f3db1599d75ae45a5369073bbcde544e5014dbf7d970d2dec792bfc44f59" gracePeriod=120 Jun 12 19:25:00.138013 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:00.137864 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="config-reloader" containerID="cri-o://7280753607cf4f2b45cd270216047a941945f0e646a719a0ce7c9c7eb274136c" gracePeriod=120 Jun 12 19:25:00.138013 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:00.137862 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="kube-rbac-proxy-web" containerID="cri-o://285ff259ee965114f1f98b91d42f1fcf9a560823081d79a4fda3079b9c934cb5" gracePeriod=120 Jun 12 19:25:00.138013 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:00.137815 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="prom-label-proxy" containerID="cri-o://fc05fa7b65e98c149df43ee63af37b992edf61be7a7c05f105a7832b962a6e3d" gracePeriod=120 Jun 12 19:25:00.731540 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:00.731499 2558 generic.go:356] "Generic (PLEG): container finished" podID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerID="fc05fa7b65e98c149df43ee63af37b992edf61be7a7c05f105a7832b962a6e3d" exitCode=0 Jun 12 19:25:00.731540 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:00.731526 2558 generic.go:356] "Generic (PLEG): container finished" podID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerID="9cc4f3db1599d75ae45a5369073bbcde544e5014dbf7d970d2dec792bfc44f59" exitCode=0 Jun 12 19:25:00.731540 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:00.731535 2558 generic.go:356] "Generic (PLEG): container finished" podID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerID="7280753607cf4f2b45cd270216047a941945f0e646a719a0ce7c9c7eb274136c" exitCode=0 Jun 12 19:25:00.731540 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:00.731544 2558 generic.go:356] "Generic (PLEG): container finished" podID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerID="1f9800f03c5e715b0bc398128949a2f307b0da1475b26380016edecc1d04b0ab" exitCode=0 Jun 12 19:25:00.731808 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:00.731572 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45cbb48-fc60-45de-8c14-19708ab10e42","Type":"ContainerDied","Data":"fc05fa7b65e98c149df43ee63af37b992edf61be7a7c05f105a7832b962a6e3d"} Jun 12 19:25:00.731808 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:00.731709 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45cbb48-fc60-45de-8c14-19708ab10e42","Type":"ContainerDied","Data":"9cc4f3db1599d75ae45a5369073bbcde544e5014dbf7d970d2dec792bfc44f59"} Jun 12 19:25:00.731808 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:00.731755 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45cbb48-fc60-45de-8c14-19708ab10e42","Type":"ContainerDied","Data":"7280753607cf4f2b45cd270216047a941945f0e646a719a0ce7c9c7eb274136c"} Jun 12 19:25:00.731808 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:00.731795 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45cbb48-fc60-45de-8c14-19708ab10e42","Type":"ContainerDied","Data":"1f9800f03c5e715b0bc398128949a2f307b0da1475b26380016edecc1d04b0ab"} Jun 12 19:25:01.393259 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.393236 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.448743 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.448709 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-kube-rbac-proxy\") pod \"d45cbb48-fc60-45de-8c14-19708ab10e42\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " Jun 12 19:25:01.448935 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.448787 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-web-config\") pod \"d45cbb48-fc60-45de-8c14-19708ab10e42\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " Jun 12 19:25:01.448935 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.448820 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpt9c\" (UniqueName: \"kubernetes.io/projected/d45cbb48-fc60-45de-8c14-19708ab10e42-kube-api-access-zpt9c\") pod \"d45cbb48-fc60-45de-8c14-19708ab10e42\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " Jun 12 19:25:01.448935 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.448888 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d45cbb48-fc60-45de-8c14-19708ab10e42\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " Jun 12 19:25:01.448935 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.448920 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-config-volume\") pod \"d45cbb48-fc60-45de-8c14-19708ab10e42\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " Jun 12 19:25:01.449152 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.448946 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d45cbb48-fc60-45de-8c14-19708ab10e42-alertmanager-main-db\") pod \"d45cbb48-fc60-45de-8c14-19708ab10e42\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " Jun 12 19:25:01.449152 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.448975 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-main-tls\") pod \"d45cbb48-fc60-45de-8c14-19708ab10e42\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " Jun 12 19:25:01.449152 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.448999 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-cluster-tls-config\") pod \"d45cbb48-fc60-45de-8c14-19708ab10e42\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " Jun 12 19:25:01.449152 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.449029 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-kube-rbac-proxy-web\") pod \"d45cbb48-fc60-45de-8c14-19708ab10e42\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " Jun 12 19:25:01.449152 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.449085 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d45cbb48-fc60-45de-8c14-19708ab10e42-config-out\") pod \"d45cbb48-fc60-45de-8c14-19708ab10e42\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " Jun 12 19:25:01.449152 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.449118 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45cbb48-fc60-45de-8c14-19708ab10e42-alertmanager-trusted-ca-bundle\") pod \"d45cbb48-fc60-45de-8c14-19708ab10e42\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " Jun 12 19:25:01.449574 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.449163 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d45cbb48-fc60-45de-8c14-19708ab10e42-metrics-client-ca\") pod \"d45cbb48-fc60-45de-8c14-19708ab10e42\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " Jun 12 19:25:01.449574 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.449213 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d45cbb48-fc60-45de-8c14-19708ab10e42-tls-assets\") pod \"d45cbb48-fc60-45de-8c14-19708ab10e42\" (UID: \"d45cbb48-fc60-45de-8c14-19708ab10e42\") " Jun 12 19:25:01.449728 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.449683 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d45cbb48-fc60-45de-8c14-19708ab10e42-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d45cbb48-fc60-45de-8c14-19708ab10e42" (UID: "d45cbb48-fc60-45de-8c14-19708ab10e42"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:25:01.450835 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.450800 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d45cbb48-fc60-45de-8c14-19708ab10e42-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d45cbb48-fc60-45de-8c14-19708ab10e42" (UID: "d45cbb48-fc60-45de-8c14-19708ab10e42"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:25:01.450966 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.450841 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d45cbb48-fc60-45de-8c14-19708ab10e42-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d45cbb48-fc60-45de-8c14-19708ab10e42" (UID: "d45cbb48-fc60-45de-8c14-19708ab10e42"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:25:01.452123 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.452079 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d45cbb48-fc60-45de-8c14-19708ab10e42-kube-api-access-zpt9c" (OuterVolumeSpecName: "kube-api-access-zpt9c") pod "d45cbb48-fc60-45de-8c14-19708ab10e42" (UID: "d45cbb48-fc60-45de-8c14-19708ab10e42"). InnerVolumeSpecName "kube-api-access-zpt9c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:25:01.453517 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.453474 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d45cbb48-fc60-45de-8c14-19708ab10e42" (UID: "d45cbb48-fc60-45de-8c14-19708ab10e42"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:25:01.453666 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.453644 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d45cbb48-fc60-45de-8c14-19708ab10e42" (UID: "d45cbb48-fc60-45de-8c14-19708ab10e42"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:25:01.454037 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.454002 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d45cbb48-fc60-45de-8c14-19708ab10e42" (UID: "d45cbb48-fc60-45de-8c14-19708ab10e42"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:25:01.454380 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.454344 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d45cbb48-fc60-45de-8c14-19708ab10e42-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d45cbb48-fc60-45de-8c14-19708ab10e42" (UID: "d45cbb48-fc60-45de-8c14-19708ab10e42"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:25:01.454545 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.454516 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-config-volume" (OuterVolumeSpecName: "config-volume") pod "d45cbb48-fc60-45de-8c14-19708ab10e42" (UID: "d45cbb48-fc60-45de-8c14-19708ab10e42"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:25:01.454656 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.454636 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d45cbb48-fc60-45de-8c14-19708ab10e42-config-out" (OuterVolumeSpecName: "config-out") pod "d45cbb48-fc60-45de-8c14-19708ab10e42" (UID: "d45cbb48-fc60-45de-8c14-19708ab10e42"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:25:01.454885 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.454863 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d45cbb48-fc60-45de-8c14-19708ab10e42" (UID: "d45cbb48-fc60-45de-8c14-19708ab10e42"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:25:01.459730 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.459689 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d45cbb48-fc60-45de-8c14-19708ab10e42" (UID: "d45cbb48-fc60-45de-8c14-19708ab10e42"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:25:01.466113 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.466080 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-web-config" (OuterVolumeSpecName: "web-config") pod "d45cbb48-fc60-45de-8c14-19708ab10e42" (UID: "d45cbb48-fc60-45de-8c14-19708ab10e42"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:25:01.550106 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.550071 2558 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d45cbb48-fc60-45de-8c14-19708ab10e42-metrics-client-ca\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:01.550106 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.550099 2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d45cbb48-fc60-45de-8c14-19708ab10e42-tls-assets\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:01.550106 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.550112 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:01.550345 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.550122 2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-web-config\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:01.550345 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.550130 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpt9c\" (UniqueName: \"kubernetes.io/projected/d45cbb48-fc60-45de-8c14-19708ab10e42-kube-api-access-zpt9c\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:01.550345 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.550139 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:01.550345 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.550148 2558 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-config-volume\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:01.550345 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.550156 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d45cbb48-fc60-45de-8c14-19708ab10e42-alertmanager-main-db\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:01.550345 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.550163 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-main-tls\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:01.550345 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.550173 2558 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-cluster-tls-config\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:01.550345 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.550183 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d45cbb48-fc60-45de-8c14-19708ab10e42-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:01.550345 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.550191 2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d45cbb48-fc60-45de-8c14-19708ab10e42-config-out\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:01.550345 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.550199 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d45cbb48-fc60-45de-8c14-19708ab10e42-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:01.738768 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.738736 2558 generic.go:356] "Generic (PLEG): container finished" podID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerID="b2edcc4343eac8b3505cc2c1d25640c56bc9ae8a60aaae4db2e432c279fe9abb" exitCode=0 Jun 12 19:25:01.738768 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.738765 2558 generic.go:356] "Generic (PLEG): container finished" podID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerID="285ff259ee965114f1f98b91d42f1fcf9a560823081d79a4fda3079b9c934cb5" exitCode=0 Jun 12 19:25:01.738963 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.738812 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.738963 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.738826 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45cbb48-fc60-45de-8c14-19708ab10e42","Type":"ContainerDied","Data":"b2edcc4343eac8b3505cc2c1d25640c56bc9ae8a60aaae4db2e432c279fe9abb"} Jun 12 19:25:01.738963 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.738908 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45cbb48-fc60-45de-8c14-19708ab10e42","Type":"ContainerDied","Data":"285ff259ee965114f1f98b91d42f1fcf9a560823081d79a4fda3079b9c934cb5"} Jun 12 19:25:01.738963 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.738950 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d45cbb48-fc60-45de-8c14-19708ab10e42","Type":"ContainerDied","Data":"2205202622eb0bc887458c3758d80e40e5354ea1cabcc5ca98c53c96b3759f63"} Jun 12 19:25:01.739093 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.738988 2558 scope.go:117] "RemoveContainer" containerID="fc05fa7b65e98c149df43ee63af37b992edf61be7a7c05f105a7832b962a6e3d" Jun 12 19:25:01.747007 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.746985 2558 scope.go:117] "RemoveContainer" containerID="b2edcc4343eac8b3505cc2c1d25640c56bc9ae8a60aaae4db2e432c279fe9abb" Jun 12 19:25:01.754967 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.754949 2558 scope.go:117] "RemoveContainer" containerID="9cc4f3db1599d75ae45a5369073bbcde544e5014dbf7d970d2dec792bfc44f59" Jun 12 19:25:01.761733 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.761708 2558 scope.go:117] "RemoveContainer" containerID="285ff259ee965114f1f98b91d42f1fcf9a560823081d79a4fda3079b9c934cb5" Jun 12 19:25:01.764594 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.764569 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 19:25:01.769581 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.769555 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 19:25:01.770670 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.770652 2558 scope.go:117] "RemoveContainer" containerID="7280753607cf4f2b45cd270216047a941945f0e646a719a0ce7c9c7eb274136c" Jun 12 19:25:01.778287 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.778266 2558 scope.go:117] "RemoveContainer" containerID="1f9800f03c5e715b0bc398128949a2f307b0da1475b26380016edecc1d04b0ab" Jun 12 19:25:01.785734 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.785709 2558 scope.go:117] "RemoveContainer" containerID="19b78494bd1a2dfa6beffbaf6a8bd746c4ff0bbc16d17083452b2935f63214a9" Jun 12 19:25:01.791450 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.791422 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" path="/var/lib/kubelet/pods/d45cbb48-fc60-45de-8c14-19708ab10e42/volumes" Jun 12 19:25:01.793805 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.793790 2558 scope.go:117] "RemoveContainer" containerID="fc05fa7b65e98c149df43ee63af37b992edf61be7a7c05f105a7832b962a6e3d" Jun 12 19:25:01.794111 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:25:01.794083 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc05fa7b65e98c149df43ee63af37b992edf61be7a7c05f105a7832b962a6e3d\": container with ID starting with fc05fa7b65e98c149df43ee63af37b992edf61be7a7c05f105a7832b962a6e3d not found: ID does not exist" containerID="fc05fa7b65e98c149df43ee63af37b992edf61be7a7c05f105a7832b962a6e3d" Jun 12 19:25:01.794185 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.794121 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc05fa7b65e98c149df43ee63af37b992edf61be7a7c05f105a7832b962a6e3d"} err="failed to get container status \"fc05fa7b65e98c149df43ee63af37b992edf61be7a7c05f105a7832b962a6e3d\": rpc error: code = NotFound desc = could not find container \"fc05fa7b65e98c149df43ee63af37b992edf61be7a7c05f105a7832b962a6e3d\": container with ID starting with fc05fa7b65e98c149df43ee63af37b992edf61be7a7c05f105a7832b962a6e3d not found: ID does not exist" Jun 12 19:25:01.794185 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.794153 2558 scope.go:117] "RemoveContainer" containerID="b2edcc4343eac8b3505cc2c1d25640c56bc9ae8a60aaae4db2e432c279fe9abb" Jun 12 19:25:01.794445 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:25:01.794403 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2edcc4343eac8b3505cc2c1d25640c56bc9ae8a60aaae4db2e432c279fe9abb\": container with ID starting with b2edcc4343eac8b3505cc2c1d25640c56bc9ae8a60aaae4db2e432c279fe9abb not found: ID does not exist" containerID="b2edcc4343eac8b3505cc2c1d25640c56bc9ae8a60aaae4db2e432c279fe9abb" Jun 12 19:25:01.794580 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.794440 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2edcc4343eac8b3505cc2c1d25640c56bc9ae8a60aaae4db2e432c279fe9abb"} err="failed to get container status \"b2edcc4343eac8b3505cc2c1d25640c56bc9ae8a60aaae4db2e432c279fe9abb\": rpc error: code = NotFound desc = could not find container \"b2edcc4343eac8b3505cc2c1d25640c56bc9ae8a60aaae4db2e432c279fe9abb\": container with ID starting with b2edcc4343eac8b3505cc2c1d25640c56bc9ae8a60aaae4db2e432c279fe9abb not found: ID does not exist" Jun 12 19:25:01.794580 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.794473 2558 scope.go:117] "RemoveContainer" containerID="9cc4f3db1599d75ae45a5369073bbcde544e5014dbf7d970d2dec792bfc44f59" Jun 12 19:25:01.795383 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:25:01.795358 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cc4f3db1599d75ae45a5369073bbcde544e5014dbf7d970d2dec792bfc44f59\": container with ID starting with 9cc4f3db1599d75ae45a5369073bbcde544e5014dbf7d970d2dec792bfc44f59 not found: ID does not exist" containerID="9cc4f3db1599d75ae45a5369073bbcde544e5014dbf7d970d2dec792bfc44f59" Jun 12 19:25:01.795483 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.795392 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cc4f3db1599d75ae45a5369073bbcde544e5014dbf7d970d2dec792bfc44f59"} err="failed to get container status \"9cc4f3db1599d75ae45a5369073bbcde544e5014dbf7d970d2dec792bfc44f59\": rpc error: code = NotFound desc = could not find container \"9cc4f3db1599d75ae45a5369073bbcde544e5014dbf7d970d2dec792bfc44f59\": container with ID starting with 9cc4f3db1599d75ae45a5369073bbcde544e5014dbf7d970d2dec792bfc44f59 not found: ID does not exist" Jun 12 19:25:01.795483 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.795411 2558 scope.go:117] "RemoveContainer" containerID="285ff259ee965114f1f98b91d42f1fcf9a560823081d79a4fda3079b9c934cb5" Jun 12 19:25:01.795759 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:25:01.795741 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"285ff259ee965114f1f98b91d42f1fcf9a560823081d79a4fda3079b9c934cb5\": container with ID starting with 285ff259ee965114f1f98b91d42f1fcf9a560823081d79a4fda3079b9c934cb5 not found: ID does not exist" containerID="285ff259ee965114f1f98b91d42f1fcf9a560823081d79a4fda3079b9c934cb5" Jun 12 19:25:01.795826 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.795773 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285ff259ee965114f1f98b91d42f1fcf9a560823081d79a4fda3079b9c934cb5"} err="failed to get container status \"285ff259ee965114f1f98b91d42f1fcf9a560823081d79a4fda3079b9c934cb5\": rpc error: code = NotFound desc = could not find container \"285ff259ee965114f1f98b91d42f1fcf9a560823081d79a4fda3079b9c934cb5\": container with ID starting with 285ff259ee965114f1f98b91d42f1fcf9a560823081d79a4fda3079b9c934cb5 not found: ID does not exist" Jun 12 19:25:01.795826 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.795788 2558 scope.go:117] "RemoveContainer" containerID="7280753607cf4f2b45cd270216047a941945f0e646a719a0ce7c9c7eb274136c" Jun 12 19:25:01.796077 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:25:01.796056 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7280753607cf4f2b45cd270216047a941945f0e646a719a0ce7c9c7eb274136c\": container with ID starting with 7280753607cf4f2b45cd270216047a941945f0e646a719a0ce7c9c7eb274136c not found: ID does not exist" containerID="7280753607cf4f2b45cd270216047a941945f0e646a719a0ce7c9c7eb274136c" Jun 12 19:25:01.796128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.796081 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7280753607cf4f2b45cd270216047a941945f0e646a719a0ce7c9c7eb274136c"} err="failed to get container status \"7280753607cf4f2b45cd270216047a941945f0e646a719a0ce7c9c7eb274136c\": rpc error: code = NotFound desc = could not find container \"7280753607cf4f2b45cd270216047a941945f0e646a719a0ce7c9c7eb274136c\": container with ID starting with 7280753607cf4f2b45cd270216047a941945f0e646a719a0ce7c9c7eb274136c not found: ID does not exist" Jun 12 19:25:01.796128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.796096 2558 scope.go:117] "RemoveContainer" containerID="1f9800f03c5e715b0bc398128949a2f307b0da1475b26380016edecc1d04b0ab" Jun 12 19:25:01.796330 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:25:01.796314 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f9800f03c5e715b0bc398128949a2f307b0da1475b26380016edecc1d04b0ab\": container with ID starting with 1f9800f03c5e715b0bc398128949a2f307b0da1475b26380016edecc1d04b0ab not found: ID does not exist" containerID="1f9800f03c5e715b0bc398128949a2f307b0da1475b26380016edecc1d04b0ab" Jun 12 19:25:01.796374 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.796333 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f9800f03c5e715b0bc398128949a2f307b0da1475b26380016edecc1d04b0ab"} err="failed to get container status \"1f9800f03c5e715b0bc398128949a2f307b0da1475b26380016edecc1d04b0ab\": rpc error: code = NotFound desc = could not find container \"1f9800f03c5e715b0bc398128949a2f307b0da1475b26380016edecc1d04b0ab\": container with ID starting with 1f9800f03c5e715b0bc398128949a2f307b0da1475b26380016edecc1d04b0ab not found: ID does not exist" Jun 12 19:25:01.796374 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.796346 2558 scope.go:117] "RemoveContainer" containerID="19b78494bd1a2dfa6beffbaf6a8bd746c4ff0bbc16d17083452b2935f63214a9" Jun 12 19:25:01.796570 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:25:01.796553 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19b78494bd1a2dfa6beffbaf6a8bd746c4ff0bbc16d17083452b2935f63214a9\": container with ID starting with 19b78494bd1a2dfa6beffbaf6a8bd746c4ff0bbc16d17083452b2935f63214a9 not found: ID does not exist" containerID="19b78494bd1a2dfa6beffbaf6a8bd746c4ff0bbc16d17083452b2935f63214a9" Jun 12 19:25:01.796677 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.796578 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19b78494bd1a2dfa6beffbaf6a8bd746c4ff0bbc16d17083452b2935f63214a9"} err="failed to get container status \"19b78494bd1a2dfa6beffbaf6a8bd746c4ff0bbc16d17083452b2935f63214a9\": rpc error: code = NotFound desc = could not find container \"19b78494bd1a2dfa6beffbaf6a8bd746c4ff0bbc16d17083452b2935f63214a9\": container with ID starting with 19b78494bd1a2dfa6beffbaf6a8bd746c4ff0bbc16d17083452b2935f63214a9 not found: ID does not exist" Jun 12 19:25:01.796677 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.796601 2558 scope.go:117] "RemoveContainer" containerID="fc05fa7b65e98c149df43ee63af37b992edf61be7a7c05f105a7832b962a6e3d" Jun 12 19:25:01.796863 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.796841 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc05fa7b65e98c149df43ee63af37b992edf61be7a7c05f105a7832b962a6e3d"} err="failed to get container status \"fc05fa7b65e98c149df43ee63af37b992edf61be7a7c05f105a7832b962a6e3d\": rpc error: code = NotFound desc = could not find container \"fc05fa7b65e98c149df43ee63af37b992edf61be7a7c05f105a7832b962a6e3d\": container with ID starting with fc05fa7b65e98c149df43ee63af37b992edf61be7a7c05f105a7832b962a6e3d not found: ID does not exist" Jun 12 19:25:01.796910 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.796866 2558 scope.go:117] "RemoveContainer" containerID="b2edcc4343eac8b3505cc2c1d25640c56bc9ae8a60aaae4db2e432c279fe9abb" Jun 12 19:25:01.797056 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797038 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 19:25:01.797117 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797100 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2edcc4343eac8b3505cc2c1d25640c56bc9ae8a60aaae4db2e432c279fe9abb"} err="failed to get container status \"b2edcc4343eac8b3505cc2c1d25640c56bc9ae8a60aaae4db2e432c279fe9abb\": rpc error: code = NotFound desc = could not find container \"b2edcc4343eac8b3505cc2c1d25640c56bc9ae8a60aaae4db2e432c279fe9abb\": container with ID starting with b2edcc4343eac8b3505cc2c1d25640c56bc9ae8a60aaae4db2e432c279fe9abb not found: ID does not exist" Jun 12 19:25:01.797151 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797118 2558 scope.go:117] "RemoveContainer" containerID="9cc4f3db1599d75ae45a5369073bbcde544e5014dbf7d970d2dec792bfc44f59" Jun 12 19:25:01.797354 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797340 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="alertmanager" Jun 12 19:25:01.797410 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797347 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cc4f3db1599d75ae45a5369073bbcde544e5014dbf7d970d2dec792bfc44f59"} err="failed to get container status \"9cc4f3db1599d75ae45a5369073bbcde544e5014dbf7d970d2dec792bfc44f59\": rpc error: code = NotFound desc = could not find container \"9cc4f3db1599d75ae45a5369073bbcde544e5014dbf7d970d2dec792bfc44f59\": container with ID starting with 9cc4f3db1599d75ae45a5369073bbcde544e5014dbf7d970d2dec792bfc44f59 not found: ID does not exist" Jun 12 19:25:01.797410 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797357 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="alertmanager" Jun 12 19:25:01.797410 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797372 2558 scope.go:117] "RemoveContainer" containerID="285ff259ee965114f1f98b91d42f1fcf9a560823081d79a4fda3079b9c934cb5" Jun 12 19:25:01.797410 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797377 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="kube-rbac-proxy-web" Jun 12 19:25:01.797410 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797384 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="kube-rbac-proxy-web" Jun 12 19:25:01.797410 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797394 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="kube-rbac-proxy" Jun 12 19:25:01.797410 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797400 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="kube-rbac-proxy" Jun 12 19:25:01.797410 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797407 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="config-reloader" Jun 12 19:25:01.797410 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797413 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="config-reloader" Jun 12 19:25:01.797809 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797425 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="kube-rbac-proxy-metric" Jun 12 19:25:01.797809 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797433 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="kube-rbac-proxy-metric" Jun 12 19:25:01.797809 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797444 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="init-config-reloader" Jun 12 19:25:01.797809 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797449 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="init-config-reloader" Jun 12 19:25:01.797809 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797455 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="prom-label-proxy" Jun 12 19:25:01.797809 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797460 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="prom-label-proxy" Jun 12 19:25:01.797809 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797512 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="alertmanager" Jun 12 19:25:01.797809 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797523 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="config-reloader" Jun 12 19:25:01.797809 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797530 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="kube-rbac-proxy-metric" Jun 12 19:25:01.797809 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797536 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="kube-rbac-proxy" Jun 12 19:25:01.797809 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797542 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="kube-rbac-proxy-web" Jun 12 19:25:01.797809 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797547 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d45cbb48-fc60-45de-8c14-19708ab10e42" containerName="prom-label-proxy" Jun 12 19:25:01.797809 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797592 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285ff259ee965114f1f98b91d42f1fcf9a560823081d79a4fda3079b9c934cb5"} err="failed to get container status \"285ff259ee965114f1f98b91d42f1fcf9a560823081d79a4fda3079b9c934cb5\": rpc error: code = NotFound desc = could not find container \"285ff259ee965114f1f98b91d42f1fcf9a560823081d79a4fda3079b9c934cb5\": container with ID starting with 285ff259ee965114f1f98b91d42f1fcf9a560823081d79a4fda3079b9c934cb5 not found: ID does not exist" Jun 12 19:25:01.797809 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797621 2558 scope.go:117] "RemoveContainer" containerID="7280753607cf4f2b45cd270216047a941945f0e646a719a0ce7c9c7eb274136c" Jun 12 19:25:01.798256 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797856 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7280753607cf4f2b45cd270216047a941945f0e646a719a0ce7c9c7eb274136c"} err="failed to get container status \"7280753607cf4f2b45cd270216047a941945f0e646a719a0ce7c9c7eb274136c\": rpc error: code = NotFound desc = could not find container \"7280753607cf4f2b45cd270216047a941945f0e646a719a0ce7c9c7eb274136c\": container with ID starting with 7280753607cf4f2b45cd270216047a941945f0e646a719a0ce7c9c7eb274136c not found: ID does not exist" Jun 12 19:25:01.798256 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.797873 2558 scope.go:117] "RemoveContainer" containerID="1f9800f03c5e715b0bc398128949a2f307b0da1475b26380016edecc1d04b0ab" Jun 12 19:25:01.798256 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.798090 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f9800f03c5e715b0bc398128949a2f307b0da1475b26380016edecc1d04b0ab"} err="failed to get container status \"1f9800f03c5e715b0bc398128949a2f307b0da1475b26380016edecc1d04b0ab\": rpc error: code = NotFound desc = could not find container \"1f9800f03c5e715b0bc398128949a2f307b0da1475b26380016edecc1d04b0ab\": container with ID starting with 1f9800f03c5e715b0bc398128949a2f307b0da1475b26380016edecc1d04b0ab not found: ID does not exist" Jun 12 19:25:01.798256 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.798103 2558 scope.go:117] "RemoveContainer" containerID="19b78494bd1a2dfa6beffbaf6a8bd746c4ff0bbc16d17083452b2935f63214a9" Jun 12 19:25:01.798379 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.798291 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19b78494bd1a2dfa6beffbaf6a8bd746c4ff0bbc16d17083452b2935f63214a9"} err="failed to get container status \"19b78494bd1a2dfa6beffbaf6a8bd746c4ff0bbc16d17083452b2935f63214a9\": rpc error: code = NotFound desc = could not find container \"19b78494bd1a2dfa6beffbaf6a8bd746c4ff0bbc16d17083452b2935f63214a9\": container with ID starting with 19b78494bd1a2dfa6beffbaf6a8bd746c4ff0bbc16d17083452b2935f63214a9 not found: ID does not exist" Jun 12 19:25:01.801211 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.801165 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.803876 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.803855 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 12 19:25:01.803876 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.803867 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 12 19:25:01.804133 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.803886 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 12 19:25:01.804133 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.803898 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 12 19:25:01.804133 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.804034 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p9n4g\"" Jun 12 19:25:01.804133 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.804089 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 12 19:25:01.804133 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.804093 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 12 19:25:01.804133 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.804105 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 12 19:25:01.804650 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.804631 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 12 19:25:01.810201 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.810183 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 12 19:25:01.815527 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.815503 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 19:25:01.852863 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.852823 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.853038 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.852872 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.853038 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.852891 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.853038 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.852917 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.853038 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.852953 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-web-config\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.853038 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.852993 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68f8dbdf-4641-40a6-bf81-595089bb7f49-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.853038 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.853013 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/68f8dbdf-4641-40a6-bf81-595089bb7f49-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.853240 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.853064 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68f8dbdf-4641-40a6-bf81-595089bb7f49-config-out\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.853240 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.853096 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f8dbdf-4641-40a6-bf81-595089bb7f49-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.853240 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.853130 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68f8dbdf-4641-40a6-bf81-595089bb7f49-tls-assets\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.853240 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.853147 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrrx9\" (UniqueName: \"kubernetes.io/projected/68f8dbdf-4641-40a6-bf81-595089bb7f49-kube-api-access-zrrx9\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.853240 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.853169 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.853240 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.853185 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-config-volume\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.954057 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.954008 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68f8dbdf-4641-40a6-bf81-595089bb7f49-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.954057 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.954059 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/68f8dbdf-4641-40a6-bf81-595089bb7f49-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.954298 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.954085 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68f8dbdf-4641-40a6-bf81-595089bb7f49-config-out\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.954298 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.954115 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f8dbdf-4641-40a6-bf81-595089bb7f49-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.954298 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.954147 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68f8dbdf-4641-40a6-bf81-595089bb7f49-tls-assets\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.954298 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.954214 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrrx9\" (UniqueName: \"kubernetes.io/projected/68f8dbdf-4641-40a6-bf81-595089bb7f49-kube-api-access-zrrx9\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.954298 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.954245 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.954298 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.954269 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-config-volume\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.954635 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.954340 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.954635 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.954392 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.954635 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.954418 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.954635 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.954450 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.954635 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.954472 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-web-config\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.954635 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.954482 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/68f8dbdf-4641-40a6-bf81-595089bb7f49-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.955138 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.955079 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f8dbdf-4641-40a6-bf81-595089bb7f49-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.955420 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.955393 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68f8dbdf-4641-40a6-bf81-595089bb7f49-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.957799 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.957627 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68f8dbdf-4641-40a6-bf81-595089bb7f49-tls-assets\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.957799 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.957748 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68f8dbdf-4641-40a6-bf81-595089bb7f49-config-out\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.957799 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.957792 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.957974 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.957792 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.957974 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.957849 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-config-volume\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.957974 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.957877 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.957974 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.957952 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.958112 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.958022 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-web-config\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.959667 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.959645 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/68f8dbdf-4641-40a6-bf81-595089bb7f49-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:01.963943 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:01.963924 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrrx9\" (UniqueName: \"kubernetes.io/projected/68f8dbdf-4641-40a6-bf81-595089bb7f49-kube-api-access-zrrx9\") pod \"alertmanager-main-0\" (UID: \"68f8dbdf-4641-40a6-bf81-595089bb7f49\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:02.111018 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:02.110922 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 19:25:02.251286 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:02.251247 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 19:25:02.254280 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:25:02.254252 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f8dbdf_4641_40a6_bf81_595089bb7f49.slice/crio-4f75725d9ca5af5696b7c2b9d988b41032b9bf7189de5bfad0d6a48e6e91c76d WatchSource:0}: Error finding container 4f75725d9ca5af5696b7c2b9d988b41032b9bf7189de5bfad0d6a48e6e91c76d: Status 404 returned error can't find the container with id 4f75725d9ca5af5696b7c2b9d988b41032b9bf7189de5bfad0d6a48e6e91c76d Jun 12 19:25:02.745149 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:02.745112 2558 generic.go:356] "Generic (PLEG): container finished" podID="68f8dbdf-4641-40a6-bf81-595089bb7f49" containerID="cb223d2465f5bcec95e1cfc9c9d983659543754400a4bac49eee90b9e6df8935" exitCode=0 Jun 12 19:25:02.745551 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:02.745194 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68f8dbdf-4641-40a6-bf81-595089bb7f49","Type":"ContainerDied","Data":"cb223d2465f5bcec95e1cfc9c9d983659543754400a4bac49eee90b9e6df8935"} Jun 12 19:25:02.745551 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:02.745276 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68f8dbdf-4641-40a6-bf81-595089bb7f49","Type":"ContainerStarted","Data":"4f75725d9ca5af5696b7c2b9d988b41032b9bf7189de5bfad0d6a48e6e91c76d"} Jun 12 19:25:03.752557 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:03.752518 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68f8dbdf-4641-40a6-bf81-595089bb7f49","Type":"ContainerStarted","Data":"97ebefa7f5374b624f3f649bafca284626f3409119f92279682795f1cac161b0"} Jun 12 19:25:03.752924 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:03.752589 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68f8dbdf-4641-40a6-bf81-595089bb7f49","Type":"ContainerStarted","Data":"a8c77a281ea6e4db5c28a15445d60a0255b58a9cd5117bf9839fbcbb0491f4fc"} Jun 12 19:25:03.752924 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:03.752643 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68f8dbdf-4641-40a6-bf81-595089bb7f49","Type":"ContainerStarted","Data":"fff8772eec233fe11142ae200f73f858d0eff5a779323a867ba92dd8c3d0ff8b"} Jun 12 19:25:03.752924 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:03.752668 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68f8dbdf-4641-40a6-bf81-595089bb7f49","Type":"ContainerStarted","Data":"fbe341137e17bf16f271e1dc07460f67b8d68425053240f0de824b2c79aaf04d"} Jun 12 19:25:03.752924 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:03.752690 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68f8dbdf-4641-40a6-bf81-595089bb7f49","Type":"ContainerStarted","Data":"38755f04c38912facdc01b0983234c157c28a5d08359cab21dce4b0ff08c2aa8"} Jun 12 19:25:03.752924 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:03.752713 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68f8dbdf-4641-40a6-bf81-595089bb7f49","Type":"ContainerStarted","Data":"d5a283772205bf8de231a9e782e62ac8079c5b8b89103da018329528b818d574"} Jun 12 19:25:03.783195 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:03.783139 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.767599466 podStartE2EDuration="2.783116691s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.517225ms" isStatefulPod=false podCreationTimestamp="2026-06-12 19:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:25:03.781349499 +0000 UTC m=+154.442041462" watchObservedRunningTime="2026-06-12 19:25:03.783116691 +0000 UTC m=+154.443808654" Jun 12 19:25:04.454661 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.454619 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 19:25:04.454991 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.454953 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="prometheus" containerID="cri-o://4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3" gracePeriod=600 Jun 12 19:25:04.455157 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.454986 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="kube-rbac-proxy" containerID="cri-o://3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2" gracePeriod=600 Jun 12 19:25:04.455157 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.455020 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="kube-rbac-proxy-web" containerID="cri-o://ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4" gracePeriod=600 Jun 12 19:25:04.455157 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.455020 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="config-reloader" containerID="cri-o://b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9" gracePeriod=600 Jun 12 19:25:04.455157 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.455049 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5" gracePeriod=600 Jun 12 19:25:04.455157 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.454994 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="thanos-sidecar" containerID="cri-o://3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175" gracePeriod=600 Jun 12 19:25:04.709815 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.709417 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:04.763549 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.763090 2558 generic.go:356] "Generic (PLEG): container finished" podID="351bc07a-027b-4050-9a40-6d02e076366e" containerID="46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5" exitCode=0 Jun 12 19:25:04.763549 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.763119 2558 generic.go:356] "Generic (PLEG): container finished" podID="351bc07a-027b-4050-9a40-6d02e076366e" containerID="3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2" exitCode=0 Jun 12 19:25:04.763549 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.763126 2558 generic.go:356] "Generic (PLEG): container finished" podID="351bc07a-027b-4050-9a40-6d02e076366e" containerID="ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4" exitCode=0 Jun 12 19:25:04.763549 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.763133 2558 generic.go:356] "Generic (PLEG): container finished" podID="351bc07a-027b-4050-9a40-6d02e076366e" containerID="3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175" exitCode=0 Jun 12 19:25:04.763549 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.763138 2558 generic.go:356] "Generic (PLEG): container finished" podID="351bc07a-027b-4050-9a40-6d02e076366e" containerID="b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9" exitCode=0 Jun 12 19:25:04.763549 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.763143 2558 generic.go:356] "Generic (PLEG): container finished" podID="351bc07a-027b-4050-9a40-6d02e076366e" containerID="4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3" exitCode=0 Jun 12 19:25:04.763549 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.763188 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351bc07a-027b-4050-9a40-6d02e076366e","Type":"ContainerDied","Data":"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5"} Jun 12 19:25:04.763549 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.763203 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:04.763549 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.763265 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351bc07a-027b-4050-9a40-6d02e076366e","Type":"ContainerDied","Data":"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2"} Jun 12 19:25:04.763549 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.763307 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351bc07a-027b-4050-9a40-6d02e076366e","Type":"ContainerDied","Data":"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4"} Jun 12 19:25:04.763549 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.763340 2558 scope.go:117] "RemoveContainer" containerID="46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5" Jun 12 19:25:04.763549 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.763349 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351bc07a-027b-4050-9a40-6d02e076366e","Type":"ContainerDied","Data":"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175"} Jun 12 19:25:04.763549 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.763388 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351bc07a-027b-4050-9a40-6d02e076366e","Type":"ContainerDied","Data":"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9"} Jun 12 19:25:04.763549 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.763425 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351bc07a-027b-4050-9a40-6d02e076366e","Type":"ContainerDied","Data":"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3"} Jun 12 19:25:04.763549 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.763465 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"351bc07a-027b-4050-9a40-6d02e076366e","Type":"ContainerDied","Data":"c33fa9dd7b8d83d3e381937f10cad55950a20abcadba29ea6cf973543cb7f941"} Jun 12 19:25:04.773708 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.773681 2558 scope.go:117] "RemoveContainer" containerID="3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2" Jun 12 19:25:04.779954 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.779915 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/351bc07a-027b-4050-9a40-6d02e076366e-tls-assets\") pod \"351bc07a-027b-4050-9a40-6d02e076366e\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " Jun 12 19:25:04.780093 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.779962 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"351bc07a-027b-4050-9a40-6d02e076366e\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " Jun 12 19:25:04.780093 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.779994 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-configmap-serving-certs-ca-bundle\") pod \"351bc07a-027b-4050-9a40-6d02e076366e\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " Jun 12 19:25:04.780093 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.780029 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-rulefiles-2\") pod \"351bc07a-027b-4050-9a40-6d02e076366e\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " Jun 12 19:25:04.780093 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.780053 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-web-config\") pod \"351bc07a-027b-4050-9a40-6d02e076366e\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " Jun 12 19:25:04.780093 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.780076 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5jch\" (UniqueName: \"kubernetes.io/projected/351bc07a-027b-4050-9a40-6d02e076366e-kube-api-access-m5jch\") pod \"351bc07a-027b-4050-9a40-6d02e076366e\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " Jun 12 19:25:04.780355 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.780104 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-prometheus-k8s-tls\") pod \"351bc07a-027b-4050-9a40-6d02e076366e\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " Jun 12 19:25:04.780355 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.780146 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-trusted-ca-bundle\") pod \"351bc07a-027b-4050-9a40-6d02e076366e\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " Jun 12 19:25:04.780355 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.780171 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-rulefiles-0\") pod \"351bc07a-027b-4050-9a40-6d02e076366e\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " Jun 12 19:25:04.780355 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.780216 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-config\") pod \"351bc07a-027b-4050-9a40-6d02e076366e\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " Jun 12 19:25:04.780355 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.780252 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-rulefiles-1\") pod \"351bc07a-027b-4050-9a40-6d02e076366e\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " Jun 12 19:25:04.780355 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.780289 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-thanos-prometheus-http-client-file\") pod \"351bc07a-027b-4050-9a40-6d02e076366e\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " Jun 12 19:25:04.780355 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.780316 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/351bc07a-027b-4050-9a40-6d02e076366e-config-out\") pod \"351bc07a-027b-4050-9a40-6d02e076366e\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " Jun 12 19:25:04.780355 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.780342 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-configmap-kubelet-serving-ca-bundle\") pod \"351bc07a-027b-4050-9a40-6d02e076366e\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " Jun 12 19:25:04.780735 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.780376 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-configmap-metrics-client-ca\") pod \"351bc07a-027b-4050-9a40-6d02e076366e\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " Jun 12 19:25:04.780735 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.780403 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-kube-rbac-proxy\") pod \"351bc07a-027b-4050-9a40-6d02e076366e\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " Jun 12 19:25:04.780735 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.780448 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"351bc07a-027b-4050-9a40-6d02e076366e\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " Jun 12 19:25:04.780735 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.780517 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-metrics-client-certs\") pod \"351bc07a-027b-4050-9a40-6d02e076366e\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " Jun 12 19:25:04.780735 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.780541 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-grpc-tls\") pod \"351bc07a-027b-4050-9a40-6d02e076366e\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " Jun 12 19:25:04.780735 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.780583 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-db\") pod \"351bc07a-027b-4050-9a40-6d02e076366e\" (UID: \"351bc07a-027b-4050-9a40-6d02e076366e\") " Jun 12 19:25:04.782577 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.781363 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "351bc07a-027b-4050-9a40-6d02e076366e" (UID: "351bc07a-027b-4050-9a40-6d02e076366e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:25:04.782577 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.781891 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "351bc07a-027b-4050-9a40-6d02e076366e" (UID: "351bc07a-027b-4050-9a40-6d02e076366e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:25:04.783865 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.783834 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "351bc07a-027b-4050-9a40-6d02e076366e" (UID: "351bc07a-027b-4050-9a40-6d02e076366e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:25:04.784646 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.784625 2558 scope.go:117] "RemoveContainer" containerID="ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4" Jun 12 19:25:04.785080 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.784696 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "351bc07a-027b-4050-9a40-6d02e076366e" (UID: "351bc07a-027b-4050-9a40-6d02e076366e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:25:04.785459 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.785380 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/351bc07a-027b-4050-9a40-6d02e076366e-config-out" (OuterVolumeSpecName: "config-out") pod "351bc07a-027b-4050-9a40-6d02e076366e" (UID: "351bc07a-027b-4050-9a40-6d02e076366e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:25:04.785835 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.785730 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "351bc07a-027b-4050-9a40-6d02e076366e" (UID: "351bc07a-027b-4050-9a40-6d02e076366e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:25:04.785939 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.785918 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "351bc07a-027b-4050-9a40-6d02e076366e" (UID: "351bc07a-027b-4050-9a40-6d02e076366e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:25:04.786003 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.785930 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "351bc07a-027b-4050-9a40-6d02e076366e" (UID: "351bc07a-027b-4050-9a40-6d02e076366e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:25:04.786003 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.785992 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "351bc07a-027b-4050-9a40-6d02e076366e" (UID: "351bc07a-027b-4050-9a40-6d02e076366e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:25:04.787943 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.787892 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "351bc07a-027b-4050-9a40-6d02e076366e" (UID: "351bc07a-027b-4050-9a40-6d02e076366e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:25:04.788145 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.788095 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "351bc07a-027b-4050-9a40-6d02e076366e" (UID: "351bc07a-027b-4050-9a40-6d02e076366e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:25:04.789241 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.789207 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "351bc07a-027b-4050-9a40-6d02e076366e" (UID: "351bc07a-027b-4050-9a40-6d02e076366e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:25:04.789627 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.789584 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-config" (OuterVolumeSpecName: "config") pod "351bc07a-027b-4050-9a40-6d02e076366e" (UID: "351bc07a-027b-4050-9a40-6d02e076366e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:25:04.789875 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.789780 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "351bc07a-027b-4050-9a40-6d02e076366e" (UID: "351bc07a-027b-4050-9a40-6d02e076366e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:25:04.789875 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.789844 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "351bc07a-027b-4050-9a40-6d02e076366e" (UID: "351bc07a-027b-4050-9a40-6d02e076366e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:25:04.790494 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.790375 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "351bc07a-027b-4050-9a40-6d02e076366e" (UID: "351bc07a-027b-4050-9a40-6d02e076366e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:25:04.790494 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.790460 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/351bc07a-027b-4050-9a40-6d02e076366e-kube-api-access-m5jch" (OuterVolumeSpecName: "kube-api-access-m5jch") pod "351bc07a-027b-4050-9a40-6d02e076366e" (UID: "351bc07a-027b-4050-9a40-6d02e076366e"). InnerVolumeSpecName "kube-api-access-m5jch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:25:04.790840 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.790816 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/351bc07a-027b-4050-9a40-6d02e076366e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "351bc07a-027b-4050-9a40-6d02e076366e" (UID: "351bc07a-027b-4050-9a40-6d02e076366e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:25:04.793345 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.793306 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "351bc07a-027b-4050-9a40-6d02e076366e" (UID: "351bc07a-027b-4050-9a40-6d02e076366e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:25:04.798919 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.798734 2558 scope.go:117] "RemoveContainer" containerID="3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175" Jun 12 19:25:04.808462 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.808396 2558 scope.go:117] "RemoveContainer" containerID="b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9" Jun 12 19:25:04.808538 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.808465 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-web-config" (OuterVolumeSpecName: "web-config") pod "351bc07a-027b-4050-9a40-6d02e076366e" (UID: "351bc07a-027b-4050-9a40-6d02e076366e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:25:04.815946 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.815925 2558 scope.go:117] "RemoveContainer" containerID="4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3" Jun 12 19:25:04.823920 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.823898 2558 scope.go:117] "RemoveContainer" containerID="d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6" Jun 12 19:25:04.831307 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.831287 2558 scope.go:117] "RemoveContainer" containerID="46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5" Jun 12 19:25:04.831564 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:25:04.831547 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5\": container with ID starting with 46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5 not found: ID does not exist" containerID="46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5" Jun 12 19:25:04.831656 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.831576 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5"} err="failed to get container status \"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5\": rpc error: code = NotFound desc = could not find container \"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5\": container with ID starting with 46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5 not found: ID does not exist" Jun 12 19:25:04.831731 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.831721 2558 scope.go:117] "RemoveContainer" containerID="3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2" Jun 12 19:25:04.832013 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:25:04.831989 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2\": container with ID starting with 3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2 not found: ID does not exist" containerID="3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2" Jun 12 19:25:04.832013 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.832009 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2"} err="failed to get container status \"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2\": rpc error: code = NotFound desc = could not find container \"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2\": container with ID starting with 3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2 not found: ID does not exist" Jun 12 19:25:04.832150 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.832025 2558 scope.go:117] "RemoveContainer" containerID="ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4" Jun 12 19:25:04.832242 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:25:04.832228 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4\": container with ID starting with ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4 not found: ID does not exist" containerID="ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4" Jun 12 19:25:04.832284 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.832246 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4"} err="failed to get container status \"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4\": rpc error: code = NotFound desc = could not find container \"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4\": container with ID starting with ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4 not found: ID does not exist" Jun 12 19:25:04.832284 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.832258 2558 scope.go:117] "RemoveContainer" containerID="3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175" Jun 12 19:25:04.832450 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:25:04.832433 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175\": container with ID starting with 3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175 not found: ID does not exist" containerID="3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175" Jun 12 19:25:04.832484 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.832454 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175"} err="failed to get container status \"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175\": rpc error: code = NotFound desc = could not find container \"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175\": container with ID starting with 3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175 not found: ID does not exist" Jun 12 19:25:04.832484 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.832468 2558 scope.go:117] "RemoveContainer" containerID="b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9" Jun 12 19:25:04.832740 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:25:04.832724 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9\": container with ID starting with b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9 not found: ID does not exist" containerID="b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9" Jun 12 19:25:04.832789 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.832742 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9"} err="failed to get container status \"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9\": rpc error: code = NotFound desc = could not find container \"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9\": container with ID starting with b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9 not found: ID does not exist" Jun 12 19:25:04.832789 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.832753 2558 scope.go:117] "RemoveContainer" containerID="4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3" Jun 12 19:25:04.832944 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:25:04.832929 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3\": container with ID starting with 4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3 not found: ID does not exist" containerID="4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3" Jun 12 19:25:04.832983 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.832947 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3"} err="failed to get container status \"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3\": rpc error: code = NotFound desc = could not find container \"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3\": container with ID starting with 4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3 not found: ID does not exist" Jun 12 19:25:04.832983 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.832959 2558 scope.go:117] "RemoveContainer" containerID="d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6" Jun 12 19:25:04.833145 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:25:04.833129 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6\": container with ID starting with d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6 not found: ID does not exist" containerID="d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6" Jun 12 19:25:04.833185 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.833147 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6"} err="failed to get container status \"d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6\": rpc error: code = NotFound desc = could not find container \"d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6\": container with ID starting with d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6 not found: ID does not exist" Jun 12 19:25:04.833185 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.833159 2558 scope.go:117] "RemoveContainer" containerID="46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5" Jun 12 19:25:04.833339 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.833323 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5"} err="failed to get container status \"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5\": rpc error: code = NotFound desc = could not find container \"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5\": container with ID starting with 46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5 not found: ID does not exist" Jun 12 19:25:04.833390 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.833339 2558 scope.go:117] "RemoveContainer" containerID="3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2" Jun 12 19:25:04.833521 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.833506 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2"} err="failed to get container status \"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2\": rpc error: code = NotFound desc = could not find container \"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2\": container with ID starting with 3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2 not found: ID does not exist" Jun 12 19:25:04.833567 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.833521 2558 scope.go:117] "RemoveContainer" containerID="ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4" Jun 12 19:25:04.833991 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.833973 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4"} err="failed to get container status \"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4\": rpc error: code = NotFound desc = could not find container \"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4\": container with ID starting with ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4 not found: ID does not exist" Jun 12 19:25:04.834041 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.833992 2558 scope.go:117] "RemoveContainer" containerID="3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175" Jun 12 19:25:04.834198 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.834184 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175"} err="failed to get container status \"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175\": rpc error: code = NotFound desc = could not find container \"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175\": container with ID starting with 3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175 not found: ID does not exist" Jun 12 19:25:04.834245 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.834198 2558 scope.go:117] "RemoveContainer" containerID="b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9" Jun 12 19:25:04.834390 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.834373 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9"} err="failed to get container status \"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9\": rpc error: code = NotFound desc = could not find container \"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9\": container with ID starting with b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9 not found: ID does not exist" Jun 12 19:25:04.834436 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.834390 2558 scope.go:117] "RemoveContainer" containerID="4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3" Jun 12 19:25:04.834568 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.834554 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3"} err="failed to get container status \"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3\": rpc error: code = NotFound desc = could not find container \"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3\": container with ID starting with 4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3 not found: ID does not exist" Jun 12 19:25:04.834620 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.834569 2558 scope.go:117] "RemoveContainer" containerID="d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6" Jun 12 19:25:04.834792 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.834777 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6"} err="failed to get container status \"d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6\": rpc error: code = NotFound desc = could not find container \"d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6\": container with ID starting with d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6 not found: ID does not exist" Jun 12 19:25:04.834835 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.834791 2558 scope.go:117] "RemoveContainer" containerID="46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5" Jun 12 19:25:04.834971 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.834953 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5"} err="failed to get container status \"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5\": rpc error: code = NotFound desc = could not find container \"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5\": container with ID starting with 46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5 not found: ID does not exist" Jun 12 19:25:04.835010 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.834972 2558 scope.go:117] "RemoveContainer" containerID="3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2" Jun 12 19:25:04.835180 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.835161 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2"} err="failed to get container status \"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2\": rpc error: code = NotFound desc = could not find container \"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2\": container with ID starting with 3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2 not found: ID does not exist" Jun 12 19:25:04.835223 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.835180 2558 scope.go:117] "RemoveContainer" containerID="ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4" Jun 12 19:25:04.835393 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.835376 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4"} err="failed to get container status \"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4\": rpc error: code = NotFound desc = could not find container \"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4\": container with ID starting with ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4 not found: ID does not exist" Jun 12 19:25:04.835452 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.835392 2558 scope.go:117] "RemoveContainer" containerID="3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175" Jun 12 19:25:04.835583 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.835559 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175"} err="failed to get container status \"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175\": rpc error: code = NotFound desc = could not find container \"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175\": container with ID starting with 3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175 not found: ID does not exist" Jun 12 19:25:04.835649 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.835586 2558 scope.go:117] "RemoveContainer" containerID="b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9" Jun 12 19:25:04.835888 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.835871 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9"} err="failed to get container status \"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9\": rpc error: code = NotFound desc = could not find container \"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9\": container with ID starting with b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9 not found: ID does not exist" Jun 12 19:25:04.835888 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.835887 2558 scope.go:117] "RemoveContainer" containerID="4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3" Jun 12 19:25:04.836091 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.836073 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3"} err="failed to get container status \"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3\": rpc error: code = NotFound desc = could not find container \"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3\": container with ID starting with 4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3 not found: ID does not exist" Jun 12 19:25:04.836163 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.836092 2558 scope.go:117] "RemoveContainer" containerID="d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6" Jun 12 19:25:04.836309 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.836294 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6"} err="failed to get container status \"d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6\": rpc error: code = NotFound desc = could not find container \"d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6\": container with ID starting with d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6 not found: ID does not exist" Jun 12 19:25:04.836354 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.836309 2558 scope.go:117] "RemoveContainer" containerID="46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5" Jun 12 19:25:04.836540 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.836525 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5"} err="failed to get container status \"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5\": rpc error: code = NotFound desc = could not find container \"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5\": container with ID starting with 46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5 not found: ID does not exist" Jun 12 19:25:04.836585 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.836541 2558 scope.go:117] "RemoveContainer" containerID="3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2" Jun 12 19:25:04.836793 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.836771 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2"} err="failed to get container status \"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2\": rpc error: code = NotFound desc = could not find container \"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2\": container with ID starting with 3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2 not found: ID does not exist" Jun 12 19:25:04.836793 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.836793 2558 scope.go:117] "RemoveContainer" containerID="ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4" Jun 12 19:25:04.837038 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.837017 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4"} err="failed to get container status \"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4\": rpc error: code = NotFound desc = could not find container \"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4\": container with ID starting with ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4 not found: ID does not exist" Jun 12 19:25:04.837111 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.837041 2558 scope.go:117] "RemoveContainer" containerID="3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175" Jun 12 19:25:04.837248 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.837230 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175"} err="failed to get container status \"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175\": rpc error: code = NotFound desc = could not find container \"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175\": container with ID starting with 3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175 not found: ID does not exist" Jun 12 19:25:04.837288 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.837248 2558 scope.go:117] "RemoveContainer" containerID="b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9" Jun 12 19:25:04.837485 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.837467 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9"} err="failed to get container status \"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9\": rpc error: code = NotFound desc = could not find container \"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9\": container with ID starting with b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9 not found: ID does not exist" Jun 12 19:25:04.837525 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.837486 2558 scope.go:117] "RemoveContainer" containerID="4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3" Jun 12 19:25:04.837726 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.837711 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3"} err="failed to get container status \"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3\": rpc error: code = NotFound desc = could not find container \"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3\": container with ID starting with 4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3 not found: ID does not exist" Jun 12 19:25:04.837770 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.837726 2558 scope.go:117] "RemoveContainer" containerID="d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6" Jun 12 19:25:04.837905 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.837891 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6"} err="failed to get container status \"d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6\": rpc error: code = NotFound desc = could not find container \"d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6\": container with ID starting with d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6 not found: ID does not exist" Jun 12 19:25:04.837944 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.837907 2558 scope.go:117] "RemoveContainer" containerID="46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5" Jun 12 19:25:04.838074 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.838053 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5"} err="failed to get container status \"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5\": rpc error: code = NotFound desc = could not find container \"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5\": container with ID starting with 46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5 not found: ID does not exist" Jun 12 19:25:04.838115 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.838074 2558 scope.go:117] "RemoveContainer" containerID="3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2" Jun 12 19:25:04.838245 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.838230 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2"} err="failed to get container status \"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2\": rpc error: code = NotFound desc = could not find container \"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2\": container with ID starting with 3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2 not found: ID does not exist" Jun 12 19:25:04.838294 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.838247 2558 scope.go:117] "RemoveContainer" containerID="ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4" Jun 12 19:25:04.838410 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.838395 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4"} err="failed to get container status \"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4\": rpc error: code = NotFound desc = could not find container \"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4\": container with ID starting with ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4 not found: ID does not exist" Jun 12 19:25:04.838410 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.838409 2558 scope.go:117] "RemoveContainer" containerID="3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175" Jun 12 19:25:04.838589 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.838571 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175"} err="failed to get container status \"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175\": rpc error: code = NotFound desc = could not find container \"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175\": container with ID starting with 3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175 not found: ID does not exist" Jun 12 19:25:04.838650 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.838590 2558 scope.go:117] "RemoveContainer" containerID="b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9" Jun 12 19:25:04.838797 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.838782 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9"} err="failed to get container status \"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9\": rpc error: code = NotFound desc = could not find container \"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9\": container with ID starting with b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9 not found: ID does not exist" Jun 12 19:25:04.838797 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.838796 2558 scope.go:117] "RemoveContainer" containerID="4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3" Jun 12 19:25:04.839007 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.838993 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3"} err="failed to get container status \"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3\": rpc error: code = NotFound desc = could not find container \"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3\": container with ID starting with 4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3 not found: ID does not exist" Jun 12 19:25:04.839007 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.839005 2558 scope.go:117] "RemoveContainer" containerID="d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6" Jun 12 19:25:04.839211 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.839193 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6"} err="failed to get container status \"d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6\": rpc error: code = NotFound desc = could not find container \"d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6\": container with ID starting with d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6 not found: ID does not exist" Jun 12 19:25:04.839254 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.839212 2558 scope.go:117] "RemoveContainer" containerID="46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5" Jun 12 19:25:04.839429 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.839410 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5"} err="failed to get container status \"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5\": rpc error: code = NotFound desc = could not find container \"46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5\": container with ID starting with 46c44b5eb3336ad492db1e696c1e30e79e185992cf8bc6044ae84d8cd0a094d5 not found: ID does not exist" Jun 12 19:25:04.839429 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.839427 2558 scope.go:117] "RemoveContainer" containerID="3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2" Jun 12 19:25:04.839678 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.839659 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2"} err="failed to get container status \"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2\": rpc error: code = NotFound desc = could not find container \"3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2\": container with ID starting with 3485e8795c34abb87b0ff9d4ce5bfac927dce039db823863a1e063cb9b2392b2 not found: ID does not exist" Jun 12 19:25:04.839678 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.839678 2558 scope.go:117] "RemoveContainer" containerID="ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4" Jun 12 19:25:04.839883 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.839865 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4"} err="failed to get container status \"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4\": rpc error: code = NotFound desc = could not find container \"ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4\": container with ID starting with ab0a0536eb9314df6ee047c88bbf23d73ed715904110203a55e02d4936179ff4 not found: ID does not exist" Jun 12 19:25:04.839925 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.839884 2558 scope.go:117] "RemoveContainer" containerID="3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175" Jun 12 19:25:04.840072 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.840053 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175"} err="failed to get container status \"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175\": rpc error: code = NotFound desc = could not find container \"3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175\": container with ID starting with 3bb39bd223735fb937d703c836828b8b22bad8043a0357f380b8e6c067d8d175 not found: ID does not exist" Jun 12 19:25:04.840140 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.840073 2558 scope.go:117] "RemoveContainer" containerID="b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9" Jun 12 19:25:04.840319 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.840303 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9"} err="failed to get container status \"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9\": rpc error: code = NotFound desc = could not find container \"b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9\": container with ID starting with b4607fccac26c3b7c5662ca4cf91ba0404717777372edc1fa55bcbe4f1bee7c9 not found: ID does not exist" Jun 12 19:25:04.840366 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.840320 2558 scope.go:117] "RemoveContainer" containerID="4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3" Jun 12 19:25:04.840551 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.840530 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3"} err="failed to get container status \"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3\": rpc error: code = NotFound desc = could not find container \"4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3\": container with ID starting with 4a51de614a794fa225621bf9bd52b30e36f82c178754344e4185aec5eba340d3 not found: ID does not exist" Jun 12 19:25:04.840551 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.840548 2558 scope.go:117] "RemoveContainer" containerID="d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6" Jun 12 19:25:04.840787 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.840765 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6"} err="failed to get container status \"d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6\": rpc error: code = NotFound desc = could not find container \"d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6\": container with ID starting with d5355fb5b949f4c6de36fc6374eea9dc5da3260434421e53d75e4f8e57d3cbe6 not found: ID does not exist" Jun 12 19:25:04.882133 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.882101 2558 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:04.882133 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.882127 2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/351bc07a-027b-4050-9a40-6d02e076366e-config-out\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:04.882133 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.882137 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:04.882133 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.882146 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-configmap-metrics-client-ca\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:04.882377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.882155 2558 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-kube-rbac-proxy\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:04.882377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.882165 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:04.882377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.882175 2558 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-metrics-client-certs\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:04.882377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.882185 2558 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-grpc-tls\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:04.882377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.882193 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-db\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:04.882377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.882201 2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/351bc07a-027b-4050-9a40-6d02e076366e-tls-assets\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:04.882377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.882209 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:04.882377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.882217 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:04.882377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.882225 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:04.882377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.882234 2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-web-config\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:04.882377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.882242 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5jch\" (UniqueName: \"kubernetes.io/projected/351bc07a-027b-4050-9a40-6d02e076366e-kube-api-access-m5jch\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:04.882377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.882250 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:04.882377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.882259 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:04.882377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.882267 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:04.882377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.882278 2558 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/351bc07a-027b-4050-9a40-6d02e076366e-config\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:04.882377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:04.882286 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/351bc07a-027b-4050-9a40-6d02e076366e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:25:05.089466 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.089412 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 19:25:05.094951 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.094919 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 19:25:05.122228 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122195 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 19:25:05.122633 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122592 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="thanos-sidecar" Jun 12 19:25:05.122633 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122630 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="thanos-sidecar" Jun 12 19:25:05.122791 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122653 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="config-reloader" Jun 12 19:25:05.122791 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122661 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="config-reloader" Jun 12 19:25:05.122791 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122669 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="kube-rbac-proxy-thanos" Jun 12 19:25:05.122791 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122677 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="kube-rbac-proxy-thanos" Jun 12 19:25:05.122791 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122688 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="kube-rbac-proxy-web" Jun 12 19:25:05.122791 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122696 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="kube-rbac-proxy-web" Jun 12 19:25:05.122791 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122711 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="prometheus" Jun 12 19:25:05.122791 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122719 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="prometheus" Jun 12 19:25:05.122791 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122733 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="kube-rbac-proxy" Jun 12 19:25:05.122791 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122743 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="kube-rbac-proxy" Jun 12 19:25:05.122791 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122760 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="init-config-reloader" Jun 12 19:25:05.122791 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122769 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="init-config-reloader" Jun 12 19:25:05.123380 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122852 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="config-reloader" Jun 12 19:25:05.123380 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122866 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="kube-rbac-proxy-web" Jun 12 19:25:05.123380 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122876 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="kube-rbac-proxy-thanos" Jun 12 19:25:05.123380 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122886 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="thanos-sidecar" Jun 12 19:25:05.123380 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122896 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="prometheus" Jun 12 19:25:05.123380 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.122908 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="351bc07a-027b-4050-9a40-6d02e076366e" containerName="kube-rbac-proxy" Jun 12 19:25:05.126911 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.126882 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.129712 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.129597 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kb45k\"" Jun 12 19:25:05.129712 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.129648 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 12 19:25:05.129712 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.129599 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 12 19:25:05.129712 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.129695 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 12 19:25:05.129976 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.129730 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 12 19:25:05.129976 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.129884 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 12 19:25:05.129976 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.129966 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 12 19:25:05.130240 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.130213 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 12 19:25:05.130315 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.130294 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 12 19:25:05.130315 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.130303 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 12 19:25:05.130418 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.130320 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 12 19:25:05.130545 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.130503 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 12 19:25:05.130680 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.130548 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 12 19:25:05.130680 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.130559 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-73fg1e9uukrm7\"" Jun 12 19:25:05.133247 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.133229 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 12 19:25:05.137697 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.137678 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 12 19:25:05.146903 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.146877 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 19:25:05.185464 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.185433 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.185752 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.185472 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.185752 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.185492 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.185752 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.185518 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.185752 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.185561 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-web-config\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.185752 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.185712 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-config-out\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.186021 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.185753 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.186021 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.185787 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.186021 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.185817 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-config\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.186021 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.185849 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.186021 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.185865 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.186021 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.185930 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.186021 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.185959 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.186021 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.185980 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.186360 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.186043 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.186360 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.186073 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q2ft\" (UniqueName: \"kubernetes.io/projected/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-kube-api-access-8q2ft\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.186360 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.186096 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.186360 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.186120 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.186360 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.186190 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.186360 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.186208 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.287236 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.287202 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.287236 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.287240 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.287567 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.287256 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.287567 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.287272 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.287567 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.287290 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q2ft\" (UniqueName: \"kubernetes.io/projected/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-kube-api-access-8q2ft\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.287567 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.287308 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.287567 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.287329 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.287567 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.287366 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.287567 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.287381 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.287567 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.287401 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.287567 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.287427 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.287567 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.287451 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.287567 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.287469 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.287567 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.287484 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-web-config\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.287567 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.287515 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-config-out\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.287567 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.287534 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.287567 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.287552 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.287567 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.287574 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-config\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.288385 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.287639 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.288385 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.287663 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.288385 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.288078 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.288922 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.288568 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.288922 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.288635 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.288922 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.288777 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.289835 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.289808 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.289917 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.289859 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.290230 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.290059 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.291091 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.291063 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.291179 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.291121 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.291488 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.291464 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.291789 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.291767 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.291962 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.291937 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.292356 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.292336 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.293047 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.293027 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.293439 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.293415 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-config-out\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.293535 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.293517 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-web-config\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.293585 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.293539 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.293674 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.293657 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.293720 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.293700 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-config\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.297070 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.297048 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q2ft\" (UniqueName: \"kubernetes.io/projected/f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c-kube-api-access-8q2ft\") pod \"prometheus-k8s-0\" (UID: \"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.438866 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.438779 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:25:05.583374 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.583061 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 19:25:05.585868 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:25:05.585836 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e7088b_5cbb_4ff2_b9c1_7de3aa54b76c.slice/crio-4bf193971be717a382bb8997d19240c9d7247077288bffec8ae3b4db3b46ae32 WatchSource:0}: Error finding container 4bf193971be717a382bb8997d19240c9d7247077288bffec8ae3b4db3b46ae32: Status 404 returned error can't find the container with id 4bf193971be717a382bb8997d19240c9d7247077288bffec8ae3b4db3b46ae32 Jun 12 19:25:05.770451 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.770417 2558 generic.go:356] "Generic (PLEG): container finished" podID="f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c" containerID="8fa6409432e768e81bdc78c663d50fb67f2311374d64e27b1310536455386cd0" exitCode=0 Jun 12 19:25:05.770842 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.770471 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c","Type":"ContainerDied","Data":"8fa6409432e768e81bdc78c663d50fb67f2311374d64e27b1310536455386cd0"} Jun 12 19:25:05.770842 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.770523 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c","Type":"ContainerStarted","Data":"4bf193971be717a382bb8997d19240c9d7247077288bffec8ae3b4db3b46ae32"} Jun 12 19:25:05.792644 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:05.792589 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="351bc07a-027b-4050-9a40-6d02e076366e" path="/var/lib/kubelet/pods/351bc07a-027b-4050-9a40-6d02e076366e/volumes" Jun 12 19:25:06.778008 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:06.777969 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c","Type":"ContainerStarted","Data":"d247d4692c27c61f04ee97edd2e581c22b081e4ca4eeb96d9c762fc0f72c23fa"} Jun 12 19:25:06.778489 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:06.778085 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c","Type":"ContainerStarted","Data":"b666afd31f9b9e7bc5e5325985f12dce006fd539f6d83468dbb6afd2f3161a1c"} Jun 12 19:25:06.778489 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:06.778137 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c","Type":"ContainerStarted","Data":"e68dc121d5569dd4a7c3de27d2f62c96fef46614999aef66ab746fba31636fb7"} Jun 12 19:25:06.778489 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:06.778183 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c","Type":"ContainerStarted","Data":"a24e9d0424f0e0dc45ef14d6a11c4af118aa6100a4b551ebf3042399332b7137"} Jun 12 19:25:06.778489 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:06.778226 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c","Type":"ContainerStarted","Data":"b162d4235bfa3c860518de86b7b3be770e1caa4ceade3c631e7a957ba024173d"} Jun 12 19:25:06.778489 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:06.778265 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c","Type":"ContainerStarted","Data":"2642575f22efe5359c50d53e2bb2afeb08fb7145d2502d2f9a1c5b95fdff6291"} Jun 12 19:25:06.808196 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:06.808137 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.786851509 podStartE2EDuration="1.808116082s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.264573ms" isStatefulPod=false podCreationTimestamp="2026-06-12 19:25:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:25:06.806580439 +0000 UTC m=+157.467272403" watchObservedRunningTime="2026-06-12 19:25:06.808116082 +0000 UTC m=+157.468808049" Jun 12 19:25:10.439588 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:25:10.439502 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:26:05.439440 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:26:05.439400 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:26:05.455429 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:26:05.455407 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:26:06.028956 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:26:06.028929 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:27:29.736828 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:27:29.736800 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4ck7_7069475a-78c9-4feb-a9b4-f4099f73a3d7/ovn-acl-logging/0.log" Jun 12 19:27:29.739310 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:27:29.739291 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4ck7_7069475a-78c9-4feb-a9b4-f4099f73a3d7/ovn-acl-logging/0.log" Jun 12 19:27:29.740726 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:27:29.740707 2558 kubelet.go:1648] "Image garbage collection succeeded" Jun 12 19:28:46.653821 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.653787 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv"] Jun 12 19:28:46.657634 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.657595 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" Jun 12 19:28:46.660568 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.660549 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 12 19:28:46.660728 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.660591 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 12 19:28:46.660788 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.660744 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 12 19:28:46.660788 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.660778 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8zhg8\"" Jun 12 19:28:46.660866 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.660842 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 12 19:28:46.678026 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.678004 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv"] Jun 12 19:28:46.790132 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.790101 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/45d1f165-6a93-4cc0-9f04-ebe6cb5b5171-manifests\") pod \"opendatahub-operator-controller-manager-789f988849-mdzqv\" (UID: \"45d1f165-6a93-4cc0-9f04-ebe6cb5b5171\") " pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" Jun 12 19:28:46.790132 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.790133 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45d1f165-6a93-4cc0-9f04-ebe6cb5b5171-webhook-cert\") pod \"opendatahub-operator-controller-manager-789f988849-mdzqv\" (UID: \"45d1f165-6a93-4cc0-9f04-ebe6cb5b5171\") " pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" Jun 12 19:28:46.790357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.790155 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/45d1f165-6a93-4cc0-9f04-ebe6cb5b5171-apiservice-cert\") pod \"opendatahub-operator-controller-manager-789f988849-mdzqv\" (UID: \"45d1f165-6a93-4cc0-9f04-ebe6cb5b5171\") " pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" Jun 12 19:28:46.790357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.790180 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45d1f165-6a93-4cc0-9f04-ebe6cb5b5171-tmp\") pod \"opendatahub-operator-controller-manager-789f988849-mdzqv\" (UID: \"45d1f165-6a93-4cc0-9f04-ebe6cb5b5171\") " pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" Jun 12 19:28:46.790357 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.790262 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdxld\" (UniqueName: \"kubernetes.io/projected/45d1f165-6a93-4cc0-9f04-ebe6cb5b5171-kube-api-access-sdxld\") pod \"opendatahub-operator-controller-manager-789f988849-mdzqv\" (UID: \"45d1f165-6a93-4cc0-9f04-ebe6cb5b5171\") " pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" Jun 12 19:28:46.891656 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.891597 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45d1f165-6a93-4cc0-9f04-ebe6cb5b5171-tmp\") pod \"opendatahub-operator-controller-manager-789f988849-mdzqv\" (UID: \"45d1f165-6a93-4cc0-9f04-ebe6cb5b5171\") " pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" Jun 12 19:28:46.891841 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.891817 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdxld\" (UniqueName: \"kubernetes.io/projected/45d1f165-6a93-4cc0-9f04-ebe6cb5b5171-kube-api-access-sdxld\") pod \"opendatahub-operator-controller-manager-789f988849-mdzqv\" (UID: \"45d1f165-6a93-4cc0-9f04-ebe6cb5b5171\") " pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" Jun 12 19:28:46.892041 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.892014 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/45d1f165-6a93-4cc0-9f04-ebe6cb5b5171-manifests\") pod \"opendatahub-operator-controller-manager-789f988849-mdzqv\" (UID: \"45d1f165-6a93-4cc0-9f04-ebe6cb5b5171\") " pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" Jun 12 19:28:46.892199 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.892054 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45d1f165-6a93-4cc0-9f04-ebe6cb5b5171-webhook-cert\") pod \"opendatahub-operator-controller-manager-789f988849-mdzqv\" (UID: \"45d1f165-6a93-4cc0-9f04-ebe6cb5b5171\") " pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" Jun 12 19:28:46.892199 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.892084 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/45d1f165-6a93-4cc0-9f04-ebe6cb5b5171-apiservice-cert\") pod \"opendatahub-operator-controller-manager-789f988849-mdzqv\" (UID: \"45d1f165-6a93-4cc0-9f04-ebe6cb5b5171\") " pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" Jun 12 19:28:46.892377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.892354 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/45d1f165-6a93-4cc0-9f04-ebe6cb5b5171-manifests\") pod \"opendatahub-operator-controller-manager-789f988849-mdzqv\" (UID: \"45d1f165-6a93-4cc0-9f04-ebe6cb5b5171\") " pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" Jun 12 19:28:46.894292 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.894272 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45d1f165-6a93-4cc0-9f04-ebe6cb5b5171-tmp\") pod \"opendatahub-operator-controller-manager-789f988849-mdzqv\" (UID: \"45d1f165-6a93-4cc0-9f04-ebe6cb5b5171\") " pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" Jun 12 19:28:46.894672 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.894644 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45d1f165-6a93-4cc0-9f04-ebe6cb5b5171-webhook-cert\") pod \"opendatahub-operator-controller-manager-789f988849-mdzqv\" (UID: \"45d1f165-6a93-4cc0-9f04-ebe6cb5b5171\") " pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" Jun 12 19:28:46.894845 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.894825 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/45d1f165-6a93-4cc0-9f04-ebe6cb5b5171-apiservice-cert\") pod \"opendatahub-operator-controller-manager-789f988849-mdzqv\" (UID: \"45d1f165-6a93-4cc0-9f04-ebe6cb5b5171\") " pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" Jun 12 19:28:46.901316 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.901290 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdxld\" (UniqueName: \"kubernetes.io/projected/45d1f165-6a93-4cc0-9f04-ebe6cb5b5171-kube-api-access-sdxld\") pod \"opendatahub-operator-controller-manager-789f988849-mdzqv\" (UID: \"45d1f165-6a93-4cc0-9f04-ebe6cb5b5171\") " pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" Jun 12 19:28:46.968594 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:46.968504 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" Jun 12 19:28:47.113296 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:47.113272 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv"] Jun 12 19:28:47.116305 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:28:47.116276 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d1f165_6a93_4cc0_9f04_ebe6cb5b5171.slice/crio-401193d93f26c764a9d08cb50ebd2ea01d29f9e30a328e76a44f84549ee22179 WatchSource:0}: Error finding container 401193d93f26c764a9d08cb50ebd2ea01d29f9e30a328e76a44f84549ee22179: Status 404 returned error can't find the container with id 401193d93f26c764a9d08cb50ebd2ea01d29f9e30a328e76a44f84549ee22179 Jun 12 19:28:47.118260 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:47.118239 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 19:28:47.662817 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:47.662781 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" event={"ID":"45d1f165-6a93-4cc0-9f04-ebe6cb5b5171","Type":"ContainerStarted","Data":"401193d93f26c764a9d08cb50ebd2ea01d29f9e30a328e76a44f84549ee22179"} Jun 12 19:28:50.679299 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:50.679138 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" event={"ID":"45d1f165-6a93-4cc0-9f04-ebe6cb5b5171","Type":"ContainerStarted","Data":"504d4261a0b95a3fd17cd3803da4312f5c53952f32aa67a514a7a7382afa88e3"} Jun 12 19:28:51.684983 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:51.684940 2558 generic.go:356] "Generic (PLEG): container finished" podID="45d1f165-6a93-4cc0-9f04-ebe6cb5b5171" containerID="504d4261a0b95a3fd17cd3803da4312f5c53952f32aa67a514a7a7382afa88e3" exitCode=0 Jun 12 19:28:51.684983 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:51.684985 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" event={"ID":"45d1f165-6a93-4cc0-9f04-ebe6cb5b5171","Type":"ContainerDied","Data":"504d4261a0b95a3fd17cd3803da4312f5c53952f32aa67a514a7a7382afa88e3"} Jun 12 19:28:52.692150 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:52.692093 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" event={"ID":"45d1f165-6a93-4cc0-9f04-ebe6cb5b5171","Type":"ContainerStarted","Data":"8c7f3de7a26708b207d1141f31faf26346dd94d59433b788e248f3937d9266ce"} Jun 12 19:28:52.692701 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:52.692262 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" Jun 12 19:28:52.719458 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:28:52.719401 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" podStartSLOduration=2.440029709 podStartE2EDuration="6.719380644s" totalImagesPullingTime="3.28320921s" totalInitContainerRuntime="996.141725ms" isStatefulPod=false podCreationTimestamp="2026-06-12 19:28:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:28:52.717270886 +0000 UTC m=+383.377962850" watchObservedRunningTime="2026-06-12 19:28:52.719380644 +0000 UTC m=+383.380072610" Jun 12 19:29:03.699125 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:03.699094 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-789f988849-mdzqv" Jun 12 19:29:05.057167 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.057136 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp"] Jun 12 19:29:05.067306 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.067279 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp" Jun 12 19:29:05.077979 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.077950 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 12 19:29:05.077979 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.077968 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-sbjfz\"" Jun 12 19:29:05.078164 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.077992 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 12 19:29:05.078164 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.078009 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 12 19:29:05.078164 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.078020 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 12 19:29:05.078164 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.077959 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 12 19:29:05.078881 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.078853 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp"] Jun 12 19:29:05.155470 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.155430 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/94d084ea-6afc-4d76-931f-0b962f537b7a-metrics-cert\") pod \"lws-controller-manager-796f4f9d48-v4hbp\" (UID: \"94d084ea-6afc-4d76-931f-0b962f537b7a\") " pod="openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp" Jun 12 19:29:05.155647 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.155538 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94d084ea-6afc-4d76-931f-0b962f537b7a-cert\") pod \"lws-controller-manager-796f4f9d48-v4hbp\" (UID: \"94d084ea-6afc-4d76-931f-0b962f537b7a\") " pod="openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp" Jun 12 19:29:05.155647 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.155576 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbg99\" (UniqueName: \"kubernetes.io/projected/94d084ea-6afc-4d76-931f-0b962f537b7a-kube-api-access-bbg99\") pod \"lws-controller-manager-796f4f9d48-v4hbp\" (UID: \"94d084ea-6afc-4d76-931f-0b962f537b7a\") " pod="openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp" Jun 12 19:29:05.155647 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.155597 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/94d084ea-6afc-4d76-931f-0b962f537b7a-manager-config\") pod \"lws-controller-manager-796f4f9d48-v4hbp\" (UID: \"94d084ea-6afc-4d76-931f-0b962f537b7a\") " pod="openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp" Jun 12 19:29:05.256648 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.256588 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/94d084ea-6afc-4d76-931f-0b962f537b7a-metrics-cert\") pod \"lws-controller-manager-796f4f9d48-v4hbp\" (UID: \"94d084ea-6afc-4d76-931f-0b962f537b7a\") " pod="openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp" Jun 12 19:29:05.256844 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.256680 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94d084ea-6afc-4d76-931f-0b962f537b7a-cert\") pod \"lws-controller-manager-796f4f9d48-v4hbp\" (UID: \"94d084ea-6afc-4d76-931f-0b962f537b7a\") " pod="openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp" Jun 12 19:29:05.256844 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.256702 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbg99\" (UniqueName: \"kubernetes.io/projected/94d084ea-6afc-4d76-931f-0b962f537b7a-kube-api-access-bbg99\") pod \"lws-controller-manager-796f4f9d48-v4hbp\" (UID: \"94d084ea-6afc-4d76-931f-0b962f537b7a\") " pod="openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp" Jun 12 19:29:05.256844 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.256720 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/94d084ea-6afc-4d76-931f-0b962f537b7a-manager-config\") pod \"lws-controller-manager-796f4f9d48-v4hbp\" (UID: \"94d084ea-6afc-4d76-931f-0b962f537b7a\") " pod="openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp" Jun 12 19:29:05.257472 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.257388 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/94d084ea-6afc-4d76-931f-0b962f537b7a-manager-config\") pod \"lws-controller-manager-796f4f9d48-v4hbp\" (UID: \"94d084ea-6afc-4d76-931f-0b962f537b7a\") " pod="openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp" Jun 12 19:29:05.259192 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.259172 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/94d084ea-6afc-4d76-931f-0b962f537b7a-metrics-cert\") pod \"lws-controller-manager-796f4f9d48-v4hbp\" (UID: \"94d084ea-6afc-4d76-931f-0b962f537b7a\") " pod="openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp" Jun 12 19:29:05.259272 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.259229 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94d084ea-6afc-4d76-931f-0b962f537b7a-cert\") pod \"lws-controller-manager-796f4f9d48-v4hbp\" (UID: \"94d084ea-6afc-4d76-931f-0b962f537b7a\") " pod="openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp" Jun 12 19:29:05.266383 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.266359 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbg99\" (UniqueName: \"kubernetes.io/projected/94d084ea-6afc-4d76-931f-0b962f537b7a-kube-api-access-bbg99\") pod \"lws-controller-manager-796f4f9d48-v4hbp\" (UID: \"94d084ea-6afc-4d76-931f-0b962f537b7a\") " pod="openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp" Jun 12 19:29:05.376699 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.376593 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp" Jun 12 19:29:05.516073 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.515904 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp"] Jun 12 19:29:05.748908 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:05.748875 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp" event={"ID":"94d084ea-6afc-4d76-931f-0b962f537b7a","Type":"ContainerStarted","Data":"abe2f87948afca576800f871a7946bb5745e9fd98e4492f084d005b675ac401e"} Jun 12 19:29:08.766040 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:08.766005 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp" event={"ID":"94d084ea-6afc-4d76-931f-0b962f537b7a","Type":"ContainerStarted","Data":"b8d766821f4f4046942fbb4aeecc06f39528e1639a0124874d36785535b39402"} Jun 12 19:29:08.766511 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:08.766117 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp" Jun 12 19:29:08.784571 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:08.784523 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp" podStartSLOduration=1.4821392420000001 podStartE2EDuration="3.784508624s" totalImagesPullingTime="2.302369382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:29:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:29:08.782592161 +0000 UTC m=+399.443284121" watchObservedRunningTime="2026-06-12 19:29:08.784508624 +0000 UTC m=+399.445200586" Jun 12 19:29:12.100812 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:12.100779 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7b5796c76f-hghxr"] Jun 12 19:29:12.113815 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:12.113776 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b5796c76f-hghxr"] Jun 12 19:29:12.113970 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:12.113890 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b5796c76f-hghxr" Jun 12 19:29:12.117624 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:12.117564 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 12 19:29:12.117624 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:12.117580 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-f4l58\"" Jun 12 19:29:12.117819 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:12.117591 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 12 19:29:12.117900 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:12.117882 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 12 19:29:12.117900 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:12.117895 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 12 19:29:12.220492 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:12.220457 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4391dd6-b95f-430d-a93b-80432f60bc00-tls-certs\") pod \"kube-auth-proxy-7b5796c76f-hghxr\" (UID: \"c4391dd6-b95f-430d-a93b-80432f60bc00\") " pod="openshift-ingress/kube-auth-proxy-7b5796c76f-hghxr" Jun 12 19:29:12.220764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:12.220505 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc6t8\" (UniqueName: \"kubernetes.io/projected/c4391dd6-b95f-430d-a93b-80432f60bc00-kube-api-access-tc6t8\") pod \"kube-auth-proxy-7b5796c76f-hghxr\" (UID: \"c4391dd6-b95f-430d-a93b-80432f60bc00\") " pod="openshift-ingress/kube-auth-proxy-7b5796c76f-hghxr" Jun 12 19:29:12.220764 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:12.220570 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4391dd6-b95f-430d-a93b-80432f60bc00-tmp\") pod \"kube-auth-proxy-7b5796c76f-hghxr\" (UID: \"c4391dd6-b95f-430d-a93b-80432f60bc00\") " pod="openshift-ingress/kube-auth-proxy-7b5796c76f-hghxr" Jun 12 19:29:12.321061 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:12.321029 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4391dd6-b95f-430d-a93b-80432f60bc00-tls-certs\") pod \"kube-auth-proxy-7b5796c76f-hghxr\" (UID: \"c4391dd6-b95f-430d-a93b-80432f60bc00\") " pod="openshift-ingress/kube-auth-proxy-7b5796c76f-hghxr" Jun 12 19:29:12.321248 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:12.321076 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc6t8\" (UniqueName: \"kubernetes.io/projected/c4391dd6-b95f-430d-a93b-80432f60bc00-kube-api-access-tc6t8\") pod \"kube-auth-proxy-7b5796c76f-hghxr\" (UID: \"c4391dd6-b95f-430d-a93b-80432f60bc00\") " pod="openshift-ingress/kube-auth-proxy-7b5796c76f-hghxr" Jun 12 19:29:12.321248 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:12.321116 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4391dd6-b95f-430d-a93b-80432f60bc00-tmp\") pod \"kube-auth-proxy-7b5796c76f-hghxr\" (UID: \"c4391dd6-b95f-430d-a93b-80432f60bc00\") " pod="openshift-ingress/kube-auth-proxy-7b5796c76f-hghxr" Jun 12 19:29:12.323385 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:12.323366 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4391dd6-b95f-430d-a93b-80432f60bc00-tmp\") pod \"kube-auth-proxy-7b5796c76f-hghxr\" (UID: \"c4391dd6-b95f-430d-a93b-80432f60bc00\") " pod="openshift-ingress/kube-auth-proxy-7b5796c76f-hghxr" Jun 12 19:29:12.323672 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:12.323655 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4391dd6-b95f-430d-a93b-80432f60bc00-tls-certs\") pod \"kube-auth-proxy-7b5796c76f-hghxr\" (UID: \"c4391dd6-b95f-430d-a93b-80432f60bc00\") " pod="openshift-ingress/kube-auth-proxy-7b5796c76f-hghxr" Jun 12 19:29:12.331150 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:12.331124 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc6t8\" (UniqueName: \"kubernetes.io/projected/c4391dd6-b95f-430d-a93b-80432f60bc00-kube-api-access-tc6t8\") pod \"kube-auth-proxy-7b5796c76f-hghxr\" (UID: \"c4391dd6-b95f-430d-a93b-80432f60bc00\") " pod="openshift-ingress/kube-auth-proxy-7b5796c76f-hghxr" Jun 12 19:29:12.424418 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:12.424338 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b5796c76f-hghxr" Jun 12 19:29:12.555537 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:12.555513 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b5796c76f-hghxr"] Jun 12 19:29:12.557913 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:29:12.557886 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4391dd6_b95f_430d_a93b_80432f60bc00.slice/crio-6599ec1470548f07c86540c8adb2dab6fa0e3a9cc1a35f0561dd890c11ca6975 WatchSource:0}: Error finding container 6599ec1470548f07c86540c8adb2dab6fa0e3a9cc1a35f0561dd890c11ca6975: Status 404 returned error can't find the container with id 6599ec1470548f07c86540c8adb2dab6fa0e3a9cc1a35f0561dd890c11ca6975 Jun 12 19:29:12.786590 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:12.786557 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b5796c76f-hghxr" event={"ID":"c4391dd6-b95f-430d-a93b-80432f60bc00","Type":"ContainerStarted","Data":"6599ec1470548f07c86540c8adb2dab6fa0e3a9cc1a35f0561dd890c11ca6975"} Jun 12 19:29:15.804389 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:15.804350 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b5796c76f-hghxr" event={"ID":"c4391dd6-b95f-430d-a93b-80432f60bc00","Type":"ContainerStarted","Data":"68ad400c7583fcf9010390dccbeba8735d9d9af148674786bbc089c168439458"} Jun 12 19:29:19.773447 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:19.773419 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-796f4f9d48-v4hbp" Jun 12 19:29:19.791081 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:29:19.791025 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7b5796c76f-hghxr" podStartSLOduration=5.027648313 podStartE2EDuration="7.791003764s" totalImagesPullingTime="2.763355451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:29:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:29:15.827104788 +0000 UTC m=+406.487796773" watchObservedRunningTime="2026-06-12 19:29:19.791003764 +0000 UTC m=+410.451695730" Jun 12 19:30:46.816006 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:46.815972 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vjhjw"] Jun 12 19:30:46.819241 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:46.819222 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vjhjw" Jun 12 19:30:46.822065 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:46.822044 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 19:30:46.822189 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:46.822177 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-cv9zq\"" Jun 12 19:30:46.823113 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:46.823096 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 12 19:30:46.823681 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:46.823663 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 19:30:46.831865 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:46.831842 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vjhjw"] Jun 12 19:30:46.843130 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:46.843097 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n92l5\" (UniqueName: \"kubernetes.io/projected/0d37a630-12a3-4202-9f14-632c80b9eb8f-kube-api-access-n92l5\") pod \"dns-operator-controller-manager-864dd78c4c-vjhjw\" (UID: \"0d37a630-12a3-4202-9f14-632c80b9eb8f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vjhjw" Jun 12 19:30:46.943966 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:46.943932 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n92l5\" (UniqueName: \"kubernetes.io/projected/0d37a630-12a3-4202-9f14-632c80b9eb8f-kube-api-access-n92l5\") pod \"dns-operator-controller-manager-864dd78c4c-vjhjw\" (UID: \"0d37a630-12a3-4202-9f14-632c80b9eb8f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vjhjw" Jun 12 19:30:46.955537 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:46.955508 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n92l5\" (UniqueName: \"kubernetes.io/projected/0d37a630-12a3-4202-9f14-632c80b9eb8f-kube-api-access-n92l5\") pod \"dns-operator-controller-manager-864dd78c4c-vjhjw\" (UID: \"0d37a630-12a3-4202-9f14-632c80b9eb8f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vjhjw" Jun 12 19:30:47.129598 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:47.129504 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vjhjw" Jun 12 19:30:47.273354 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:47.273332 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vjhjw"] Jun 12 19:30:47.276213 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:30:47.276185 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d37a630_12a3_4202_9f14_632c80b9eb8f.slice/crio-1c954c4ab3bb103f5c35bec82340b371cf42b948dffcbb55f1eaa066429d2a25 WatchSource:0}: Error finding container 1c954c4ab3bb103f5c35bec82340b371cf42b948dffcbb55f1eaa066429d2a25: Status 404 returned error can't find the container with id 1c954c4ab3bb103f5c35bec82340b371cf42b948dffcbb55f1eaa066429d2a25 Jun 12 19:30:48.224065 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:48.224023 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vjhjw" event={"ID":"0d37a630-12a3-4202-9f14-632c80b9eb8f","Type":"ContainerStarted","Data":"1c954c4ab3bb103f5c35bec82340b371cf42b948dffcbb55f1eaa066429d2a25"} Jun 12 19:30:50.235100 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:50.235063 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vjhjw" event={"ID":"0d37a630-12a3-4202-9f14-632c80b9eb8f","Type":"ContainerStarted","Data":"fa2953e8a87da591116c2774e4c7afb88aac73a2003634c818ef35b82da475c1"} Jun 12 19:30:50.235488 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:50.235193 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vjhjw" Jun 12 19:30:50.268257 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:50.268196 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vjhjw" podStartSLOduration=2.040077685 podStartE2EDuration="4.268177398s" totalImagesPullingTime="2.228099713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:30:50.26767637 +0000 UTC m=+500.928368332" watchObservedRunningTime="2026-06-12 19:30:50.268177398 +0000 UTC m=+500.928869367" Jun 12 19:30:54.597616 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:54.597582 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vrk6s"] Jun 12 19:30:54.601428 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:54.601404 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrk6s" Jun 12 19:30:54.604232 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:54.604208 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 12 19:30:54.604335 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:54.604228 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 12 19:30:54.604335 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:54.604232 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wkr7c\"" Jun 12 19:30:54.609530 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:54.609508 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vrk6s"] Jun 12 19:30:54.721010 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:54.720978 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/73014c53-b67a-440f-8fa1-eea76bf443d3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vrk6s\" (UID: \"73014c53-b67a-440f-8fa1-eea76bf443d3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrk6s" Jun 12 19:30:54.721179 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:54.721036 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/73014c53-b67a-440f-8fa1-eea76bf443d3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vrk6s\" (UID: \"73014c53-b67a-440f-8fa1-eea76bf443d3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrk6s" Jun 12 19:30:54.721179 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:54.721134 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbxnt\" (UniqueName: \"kubernetes.io/projected/73014c53-b67a-440f-8fa1-eea76bf443d3-kube-api-access-dbxnt\") pod \"kuadrant-console-plugin-66b5774985-vrk6s\" (UID: \"73014c53-b67a-440f-8fa1-eea76bf443d3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrk6s" Jun 12 19:30:54.822379 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:54.822338 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/73014c53-b67a-440f-8fa1-eea76bf443d3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vrk6s\" (UID: \"73014c53-b67a-440f-8fa1-eea76bf443d3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrk6s" Jun 12 19:30:54.822567 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:54.822403 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/73014c53-b67a-440f-8fa1-eea76bf443d3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vrk6s\" (UID: \"73014c53-b67a-440f-8fa1-eea76bf443d3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrk6s" Jun 12 19:30:54.822567 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:54.822456 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbxnt\" (UniqueName: \"kubernetes.io/projected/73014c53-b67a-440f-8fa1-eea76bf443d3-kube-api-access-dbxnt\") pod \"kuadrant-console-plugin-66b5774985-vrk6s\" (UID: \"73014c53-b67a-440f-8fa1-eea76bf443d3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrk6s" Jun 12 19:30:54.823128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:54.823104 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/73014c53-b67a-440f-8fa1-eea76bf443d3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vrk6s\" (UID: \"73014c53-b67a-440f-8fa1-eea76bf443d3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrk6s" Jun 12 19:30:54.825108 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:54.825080 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/73014c53-b67a-440f-8fa1-eea76bf443d3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vrk6s\" (UID: \"73014c53-b67a-440f-8fa1-eea76bf443d3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrk6s" Jun 12 19:30:54.832630 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:54.832587 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbxnt\" (UniqueName: \"kubernetes.io/projected/73014c53-b67a-440f-8fa1-eea76bf443d3-kube-api-access-dbxnt\") pod \"kuadrant-console-plugin-66b5774985-vrk6s\" (UID: \"73014c53-b67a-440f-8fa1-eea76bf443d3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrk6s" Jun 12 19:30:54.911457 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:54.911387 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrk6s" Jun 12 19:30:55.042702 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:55.042676 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vrk6s"] Jun 12 19:30:55.044863 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:30:55.044828 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73014c53_b67a_440f_8fa1_eea76bf443d3.slice/crio-561ed9df63700b72f66841d025b5051cb8f32136d617c1a326ba903764083342 WatchSource:0}: Error finding container 561ed9df63700b72f66841d025b5051cb8f32136d617c1a326ba903764083342: Status 404 returned error can't find the container with id 561ed9df63700b72f66841d025b5051cb8f32136d617c1a326ba903764083342 Jun 12 19:30:55.259355 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:30:55.259314 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrk6s" event={"ID":"73014c53-b67a-440f-8fa1-eea76bf443d3","Type":"ContainerStarted","Data":"561ed9df63700b72f66841d025b5051cb8f32136d617c1a326ba903764083342"} Jun 12 19:31:01.242875 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:31:01.242839 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vjhjw" Jun 12 19:31:05.331804 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:31:05.331765 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q42p2"] Jun 12 19:31:05.342387 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:31:05.342356 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q42p2" Jun 12 19:31:05.345204 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:31:05.345179 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-mgh6r\"" Jun 12 19:31:05.350381 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:31:05.350352 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q42p2"] Jun 12 19:31:05.425969 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:31:05.425933 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clfth\" (UniqueName: \"kubernetes.io/projected/c405af12-d0b7-4ec1-90fc-853bdeb046f6-kube-api-access-clfth\") pod \"limitador-operator-controller-manager-859d7b78bd-q42p2\" (UID: \"c405af12-d0b7-4ec1-90fc-853bdeb046f6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q42p2" Jun 12 19:31:05.526680 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:31:05.526642 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clfth\" (UniqueName: \"kubernetes.io/projected/c405af12-d0b7-4ec1-90fc-853bdeb046f6-kube-api-access-clfth\") pod \"limitador-operator-controller-manager-859d7b78bd-q42p2\" (UID: \"c405af12-d0b7-4ec1-90fc-853bdeb046f6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q42p2" Jun 12 19:31:05.540448 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:31:05.540415 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clfth\" (UniqueName: \"kubernetes.io/projected/c405af12-d0b7-4ec1-90fc-853bdeb046f6-kube-api-access-clfth\") pod \"limitador-operator-controller-manager-859d7b78bd-q42p2\" (UID: \"c405af12-d0b7-4ec1-90fc-853bdeb046f6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q42p2" Jun 12 19:31:05.657687 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:31:05.657581 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q42p2" Jun 12 19:31:18.636096 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:31:18.636068 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q42p2"] Jun 12 19:31:18.645057 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:31:18.644980 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc405af12_d0b7_4ec1_90fc_853bdeb046f6.slice/crio-563034949db4ed3636ac75786d2222739f785e681bc75a2b4bbc65565d5334f7 WatchSource:0}: Error finding container 563034949db4ed3636ac75786d2222739f785e681bc75a2b4bbc65565d5334f7: Status 404 returned error can't find the container with id 563034949db4ed3636ac75786d2222739f785e681bc75a2b4bbc65565d5334f7 Jun 12 19:31:19.390305 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:31:19.390269 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q42p2" event={"ID":"c405af12-d0b7-4ec1-90fc-853bdeb046f6","Type":"ContainerStarted","Data":"563034949db4ed3636ac75786d2222739f785e681bc75a2b4bbc65565d5334f7"} Jun 12 19:31:19.392161 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:31:19.392127 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrk6s" event={"ID":"73014c53-b67a-440f-8fa1-eea76bf443d3","Type":"ContainerStarted","Data":"82cedac1e2e251959bb8679fec31e44f6a8e823a4ac4c2d9d3166d3203723860"} Jun 12 19:31:19.420912 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:31:19.420861 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrk6s" podStartSLOduration=1.87180711 podStartE2EDuration="25.42084603s" totalImagesPullingTime="23.54903892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:31:19.420277194 +0000 UTC m=+530.080969157" watchObservedRunningTime="2026-06-12 19:31:19.42084603 +0000 UTC m=+530.081537992" Jun 12 19:31:23.415052 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:31:23.415017 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q42p2" event={"ID":"c405af12-d0b7-4ec1-90fc-853bdeb046f6","Type":"ContainerStarted","Data":"a06d59e3252b40ecb194ccd2a360f8a55d15738360f45861c3c6eadeb188b8e9"} Jun 12 19:31:23.415533 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:31:23.415148 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q42p2" Jun 12 19:31:23.435754 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:31:23.435705 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q42p2" podStartSLOduration=14.146586073 podStartE2EDuration="18.435689416s" totalImagesPullingTime="4.289103343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:31:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:31:23.433847176 +0000 UTC m=+534.094539139" watchObservedRunningTime="2026-06-12 19:31:23.435689416 +0000 UTC m=+534.096381378" Jun 12 19:31:34.421280 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:31:34.421250 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q42p2" Jun 12 19:32:29.767393 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:29.767367 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4ck7_7069475a-78c9-4feb-a9b4-f4099f73a3d7/ovn-acl-logging/0.log" Jun 12 19:32:29.768075 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:29.768050 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4ck7_7069475a-78c9-4feb-a9b4-f4099f73a3d7/ovn-acl-logging/0.log" Jun 12 19:32:42.748671 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:42.748562 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 19:32:42.751038 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:42.751021 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 19:32:42.753821 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:42.753798 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 12 19:32:42.753951 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:42.753879 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 12 19:32:42.754820 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:42.754805 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-mxbzd\"" Jun 12 19:32:42.754889 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:42.754811 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 12 19:32:42.760953 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:42.760929 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 19:32:42.813699 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:42.813663 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwfv6\" (UniqueName: \"kubernetes.io/projected/f197e353-d5c5-4c5d-a3bb-683174711982-kube-api-access-fwfv6\") pod \"maas-keycloak-0\" (UID: \"f197e353-d5c5-4c5d-a3bb-683174711982\") " pod="keycloak-system/maas-keycloak-0" Jun 12 19:32:42.914196 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:42.914157 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwfv6\" (UniqueName: \"kubernetes.io/projected/f197e353-d5c5-4c5d-a3bb-683174711982-kube-api-access-fwfv6\") pod \"maas-keycloak-0\" (UID: \"f197e353-d5c5-4c5d-a3bb-683174711982\") " pod="keycloak-system/maas-keycloak-0" Jun 12 19:32:42.923919 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:42.923887 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwfv6\" (UniqueName: \"kubernetes.io/projected/f197e353-d5c5-4c5d-a3bb-683174711982-kube-api-access-fwfv6\") pod \"maas-keycloak-0\" (UID: \"f197e353-d5c5-4c5d-a3bb-683174711982\") " pod="keycloak-system/maas-keycloak-0" Jun 12 19:32:43.061588 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:43.061503 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 19:32:43.197911 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:43.197886 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 19:32:43.199897 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:32:43.199865 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf197e353_d5c5_4c5d_a3bb_683174711982.slice/crio-95da68baba53de303e5d1d1701583065c33ac71067fcff41384c5edc66d6b2d8 WatchSource:0}: Error finding container 95da68baba53de303e5d1d1701583065c33ac71067fcff41384c5edc66d6b2d8: Status 404 returned error can't find the container with id 95da68baba53de303e5d1d1701583065c33ac71067fcff41384c5edc66d6b2d8 Jun 12 19:32:43.794415 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:43.794372 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f197e353-d5c5-4c5d-a3bb-683174711982","Type":"ContainerStarted","Data":"95da68baba53de303e5d1d1701583065c33ac71067fcff41384c5edc66d6b2d8"} Jun 12 19:32:48.828351 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:48.828306 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f197e353-d5c5-4c5d-a3bb-683174711982","Type":"ContainerStarted","Data":"8f980247a4d68af75b10fc7306fe5714eafc5a78dd79c78ac6bdb2d48bc4c58e"} Jun 12 19:32:48.850248 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:48.850193 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.073505228 podStartE2EDuration="6.850177445s" totalImagesPullingTime="4.776672217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:32:48.847900608 +0000 UTC m=+619.508592572" watchObservedRunningTime="2026-06-12 19:32:48.850177445 +0000 UTC m=+619.510869445" Jun 12 19:32:49.063666 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:49.063634 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 12 19:32:49.063855 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:49.063748 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f197e353-d5c5-4c5d-a3bb-683174711982" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 12 19:32:50.062191 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:50.062139 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f197e353-d5c5-4c5d-a3bb-683174711982" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 12 19:32:51.062198 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:51.062149 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f197e353-d5c5-4c5d-a3bb-683174711982" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 12 19:32:52.062745 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:52.062680 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f197e353-d5c5-4c5d-a3bb-683174711982" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 12 19:32:53.062423 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:53.062374 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 12 19:32:53.063533 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:53.063498 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f197e353-d5c5-4c5d-a3bb-683174711982" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 12 19:32:54.062060 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:54.062011 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f197e353-d5c5-4c5d-a3bb-683174711982" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 12 19:32:55.062733 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:55.062680 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f197e353-d5c5-4c5d-a3bb-683174711982" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 12 19:32:56.062621 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:56.062550 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f197e353-d5c5-4c5d-a3bb-683174711982" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 12 19:32:57.062853 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:57.062800 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f197e353-d5c5-4c5d-a3bb-683174711982" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 12 19:32:58.062467 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:58.062415 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f197e353-d5c5-4c5d-a3bb-683174711982" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 12 19:32:59.062839 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:32:59.062792 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f197e353-d5c5-4c5d-a3bb-683174711982" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 12 19:33:00.062060 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:00.062016 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f197e353-d5c5-4c5d-a3bb-683174711982" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 12 19:33:01.154804 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:01.154693 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 12 19:33:01.169549 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:01.169502 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f197e353-d5c5-4c5d-a3bb-683174711982" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 19:33:11.160860 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:11.160828 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 12 19:33:17.833882 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:17.833845 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b759ddc58-b8lsf"] Jun 12 19:33:17.836171 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:17.836155 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b759ddc58-b8lsf" Jun 12 19:33:17.838699 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:17.838677 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 12 19:33:17.838826 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:17.838715 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 12 19:33:17.838826 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:17.838718 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sjgx9\"" Jun 12 19:33:17.845563 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:17.845538 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b759ddc58-b8lsf"] Jun 12 19:33:17.963844 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:17.963807 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a197dc7f-029c-4f8e-8dc6-040598768c96-webhook-cert\") pod \"maas-controller-5b759ddc58-b8lsf\" (UID: \"a197dc7f-029c-4f8e-8dc6-040598768c96\") " pod="opendatahub/maas-controller-5b759ddc58-b8lsf" Jun 12 19:33:17.964013 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:17.963885 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n2s4\" (UniqueName: \"kubernetes.io/projected/a197dc7f-029c-4f8e-8dc6-040598768c96-kube-api-access-4n2s4\") pod \"maas-controller-5b759ddc58-b8lsf\" (UID: \"a197dc7f-029c-4f8e-8dc6-040598768c96\") " pod="opendatahub/maas-controller-5b759ddc58-b8lsf" Jun 12 19:33:18.017576 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:18.017541 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84ccb868f8-9qdlt"] Jun 12 19:33:18.023258 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:18.023241 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84ccb868f8-9qdlt" Jun 12 19:33:18.030953 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:18.030929 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84ccb868f8-9qdlt"] Jun 12 19:33:18.065344 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:18.065316 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a197dc7f-029c-4f8e-8dc6-040598768c96-webhook-cert\") pod \"maas-controller-5b759ddc58-b8lsf\" (UID: \"a197dc7f-029c-4f8e-8dc6-040598768c96\") " pod="opendatahub/maas-controller-5b759ddc58-b8lsf" Jun 12 19:33:18.065495 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:18.065351 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fht9n\" (UniqueName: \"kubernetes.io/projected/5db7ab02-348c-48ed-a355-dfbd41f57f2e-kube-api-access-fht9n\") pod \"maas-controller-84ccb868f8-9qdlt\" (UID: \"5db7ab02-348c-48ed-a355-dfbd41f57f2e\") " pod="opendatahub/maas-controller-84ccb868f8-9qdlt" Jun 12 19:33:18.065495 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:18.065382 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n2s4\" (UniqueName: \"kubernetes.io/projected/a197dc7f-029c-4f8e-8dc6-040598768c96-kube-api-access-4n2s4\") pod \"maas-controller-5b759ddc58-b8lsf\" (UID: \"a197dc7f-029c-4f8e-8dc6-040598768c96\") " pod="opendatahub/maas-controller-5b759ddc58-b8lsf" Jun 12 19:33:18.065495 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:18.065442 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5db7ab02-348c-48ed-a355-dfbd41f57f2e-webhook-cert\") pod \"maas-controller-84ccb868f8-9qdlt\" (UID: \"5db7ab02-348c-48ed-a355-dfbd41f57f2e\") " pod="opendatahub/maas-controller-84ccb868f8-9qdlt" Jun 12 19:33:18.065495 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:33:18.065488 2558 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 12 19:33:18.065734 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:33:18.065552 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a197dc7f-029c-4f8e-8dc6-040598768c96-webhook-cert podName:a197dc7f-029c-4f8e-8dc6-040598768c96 nodeName:}" failed. No retries permitted until 2026-06-12 19:33:18.565530638 +0000 UTC m=+649.226222593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/a197dc7f-029c-4f8e-8dc6-040598768c96-webhook-cert") pod "maas-controller-5b759ddc58-b8lsf" (UID: "a197dc7f-029c-4f8e-8dc6-040598768c96") : secret "maas-controller-webhook-cert" not found Jun 12 19:33:18.077194 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:18.077171 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n2s4\" (UniqueName: \"kubernetes.io/projected/a197dc7f-029c-4f8e-8dc6-040598768c96-kube-api-access-4n2s4\") pod \"maas-controller-5b759ddc58-b8lsf\" (UID: \"a197dc7f-029c-4f8e-8dc6-040598768c96\") " pod="opendatahub/maas-controller-5b759ddc58-b8lsf" Jun 12 19:33:18.165987 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:18.165901 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5db7ab02-348c-48ed-a355-dfbd41f57f2e-webhook-cert\") pod \"maas-controller-84ccb868f8-9qdlt\" (UID: \"5db7ab02-348c-48ed-a355-dfbd41f57f2e\") " pod="opendatahub/maas-controller-84ccb868f8-9qdlt" Jun 12 19:33:18.166118 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:18.165987 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fht9n\" (UniqueName: \"kubernetes.io/projected/5db7ab02-348c-48ed-a355-dfbd41f57f2e-kube-api-access-fht9n\") pod \"maas-controller-84ccb868f8-9qdlt\" (UID: \"5db7ab02-348c-48ed-a355-dfbd41f57f2e\") " pod="opendatahub/maas-controller-84ccb868f8-9qdlt" Jun 12 19:33:18.168388 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:18.168360 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5db7ab02-348c-48ed-a355-dfbd41f57f2e-webhook-cert\") pod \"maas-controller-84ccb868f8-9qdlt\" (UID: \"5db7ab02-348c-48ed-a355-dfbd41f57f2e\") " pod="opendatahub/maas-controller-84ccb868f8-9qdlt" Jun 12 19:33:18.174872 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:18.174833 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fht9n\" (UniqueName: \"kubernetes.io/projected/5db7ab02-348c-48ed-a355-dfbd41f57f2e-kube-api-access-fht9n\") pod \"maas-controller-84ccb868f8-9qdlt\" (UID: \"5db7ab02-348c-48ed-a355-dfbd41f57f2e\") " pod="opendatahub/maas-controller-84ccb868f8-9qdlt" Jun 12 19:33:18.334468 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:18.334433 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84ccb868f8-9qdlt" Jun 12 19:33:18.469904 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:18.469877 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84ccb868f8-9qdlt"] Jun 12 19:33:18.471801 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:33:18.471768 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5db7ab02_348c_48ed_a355_dfbd41f57f2e.slice/crio-65f385fcfc643bbcc6e388ab641a48432ea2f5bee90515324072dbff2a69406c WatchSource:0}: Error finding container 65f385fcfc643bbcc6e388ab641a48432ea2f5bee90515324072dbff2a69406c: Status 404 returned error can't find the container with id 65f385fcfc643bbcc6e388ab641a48432ea2f5bee90515324072dbff2a69406c Jun 12 19:33:18.569408 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:18.569380 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a197dc7f-029c-4f8e-8dc6-040598768c96-webhook-cert\") pod \"maas-controller-5b759ddc58-b8lsf\" (UID: \"a197dc7f-029c-4f8e-8dc6-040598768c96\") " pod="opendatahub/maas-controller-5b759ddc58-b8lsf" Jun 12 19:33:18.571770 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:18.571747 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a197dc7f-029c-4f8e-8dc6-040598768c96-webhook-cert\") pod \"maas-controller-5b759ddc58-b8lsf\" (UID: \"a197dc7f-029c-4f8e-8dc6-040598768c96\") " pod="opendatahub/maas-controller-5b759ddc58-b8lsf" Jun 12 19:33:18.746949 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:18.746916 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b759ddc58-b8lsf" Jun 12 19:33:18.876394 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:18.876368 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b759ddc58-b8lsf"] Jun 12 19:33:18.878109 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:33:18.878081 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda197dc7f_029c_4f8e_8dc6_040598768c96.slice/crio-3b8b04dc71a3bdddb7a756ad8021014a812173b7aaa7d636d699572cd1aa8e19 WatchSource:0}: Error finding container 3b8b04dc71a3bdddb7a756ad8021014a812173b7aaa7d636d699572cd1aa8e19: Status 404 returned error can't find the container with id 3b8b04dc71a3bdddb7a756ad8021014a812173b7aaa7d636d699572cd1aa8e19 Jun 12 19:33:18.997530 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:18.997433 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b759ddc58-b8lsf" event={"ID":"a197dc7f-029c-4f8e-8dc6-040598768c96","Type":"ContainerStarted","Data":"3b8b04dc71a3bdddb7a756ad8021014a812173b7aaa7d636d699572cd1aa8e19"} Jun 12 19:33:18.998590 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:18.998566 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84ccb868f8-9qdlt" event={"ID":"5db7ab02-348c-48ed-a355-dfbd41f57f2e","Type":"ContainerStarted","Data":"65f385fcfc643bbcc6e388ab641a48432ea2f5bee90515324072dbff2a69406c"} Jun 12 19:33:21.010702 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:21.010601 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84ccb868f8-9qdlt" event={"ID":"5db7ab02-348c-48ed-a355-dfbd41f57f2e","Type":"ContainerStarted","Data":"60f95933af005e6ebddd1ab4e325b12ae8b0e6e48f50ba6d58e27bca3904246c"} Jun 12 19:33:21.011140 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:21.010770 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84ccb868f8-9qdlt" Jun 12 19:33:21.012123 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:21.012096 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b759ddc58-b8lsf" event={"ID":"a197dc7f-029c-4f8e-8dc6-040598768c96","Type":"ContainerStarted","Data":"fdcdc6b207ef97cfd1da46845680c978bb20711e71e7bb6255c6ea5dbe8f8af4"} Jun 12 19:33:21.012253 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:21.012214 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b759ddc58-b8lsf" Jun 12 19:33:21.046875 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:21.046830 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84ccb868f8-9qdlt" podStartSLOduration=1.9859203380000001 podStartE2EDuration="4.046817107s" totalImagesPullingTime="2.060896769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:33:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:33:21.045767186 +0000 UTC m=+651.706459151" watchObservedRunningTime="2026-06-12 19:33:21.046817107 +0000 UTC m=+651.707509097" Jun 12 19:33:21.082835 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:21.082788 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b759ddc58-b8lsf" podStartSLOduration=2.424564425 podStartE2EDuration="4.082771884s" totalImagesPullingTime="1.658207459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:33:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:33:21.081513403 +0000 UTC m=+651.742205367" watchObservedRunningTime="2026-06-12 19:33:21.082771884 +0000 UTC m=+651.743463847" Jun 12 19:33:32.022406 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:32.022373 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84ccb868f8-9qdlt" Jun 12 19:33:32.022825 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:32.022445 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b759ddc58-b8lsf" Jun 12 19:33:32.096299 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:32.096270 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b759ddc58-b8lsf"] Jun 12 19:33:32.096478 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:32.096442 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5b759ddc58-b8lsf" podUID="a197dc7f-029c-4f8e-8dc6-040598768c96" containerName="manager" containerID="cri-o://fdcdc6b207ef97cfd1da46845680c978bb20711e71e7bb6255c6ea5dbe8f8af4" gracePeriod=30 Jun 12 19:33:32.339289 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:32.339266 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b759ddc58-b8lsf" Jun 12 19:33:32.394784 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:32.394757 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n2s4\" (UniqueName: \"kubernetes.io/projected/a197dc7f-029c-4f8e-8dc6-040598768c96-kube-api-access-4n2s4\") pod \"a197dc7f-029c-4f8e-8dc6-040598768c96\" (UID: \"a197dc7f-029c-4f8e-8dc6-040598768c96\") " Jun 12 19:33:32.394934 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:32.394796 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a197dc7f-029c-4f8e-8dc6-040598768c96-webhook-cert\") pod \"a197dc7f-029c-4f8e-8dc6-040598768c96\" (UID: \"a197dc7f-029c-4f8e-8dc6-040598768c96\") " Jun 12 19:33:32.397015 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:32.396993 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a197dc7f-029c-4f8e-8dc6-040598768c96-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a197dc7f-029c-4f8e-8dc6-040598768c96" (UID: "a197dc7f-029c-4f8e-8dc6-040598768c96"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:33:32.397158 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:32.397125 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a197dc7f-029c-4f8e-8dc6-040598768c96-kube-api-access-4n2s4" (OuterVolumeSpecName: "kube-api-access-4n2s4") pod "a197dc7f-029c-4f8e-8dc6-040598768c96" (UID: "a197dc7f-029c-4f8e-8dc6-040598768c96"). InnerVolumeSpecName "kube-api-access-4n2s4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:33:32.495618 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:32.495586 2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a197dc7f-029c-4f8e-8dc6-040598768c96-webhook-cert\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:33:32.495775 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:32.495634 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n2s4\" (UniqueName: \"kubernetes.io/projected/a197dc7f-029c-4f8e-8dc6-040598768c96-kube-api-access-4n2s4\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:33:33.076424 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:33.076394 2558 generic.go:356] "Generic (PLEG): container finished" podID="a197dc7f-029c-4f8e-8dc6-040598768c96" containerID="fdcdc6b207ef97cfd1da46845680c978bb20711e71e7bb6255c6ea5dbe8f8af4" exitCode=0 Jun 12 19:33:33.076424 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:33.076434 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b759ddc58-b8lsf" event={"ID":"a197dc7f-029c-4f8e-8dc6-040598768c96","Type":"ContainerDied","Data":"fdcdc6b207ef97cfd1da46845680c978bb20711e71e7bb6255c6ea5dbe8f8af4"} Jun 12 19:33:33.077126 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:33.076477 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b759ddc58-b8lsf" event={"ID":"a197dc7f-029c-4f8e-8dc6-040598768c96","Type":"ContainerDied","Data":"3b8b04dc71a3bdddb7a756ad8021014a812173b7aaa7d636d699572cd1aa8e19"} Jun 12 19:33:33.077126 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:33.076505 2558 scope.go:117] "RemoveContainer" containerID="fdcdc6b207ef97cfd1da46845680c978bb20711e71e7bb6255c6ea5dbe8f8af4" Jun 12 19:33:33.077126 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:33.076519 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b759ddc58-b8lsf" Jun 12 19:33:33.085844 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:33.085827 2558 scope.go:117] "RemoveContainer" containerID="fdcdc6b207ef97cfd1da46845680c978bb20711e71e7bb6255c6ea5dbe8f8af4" Jun 12 19:33:33.086072 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:33:33.086056 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdcdc6b207ef97cfd1da46845680c978bb20711e71e7bb6255c6ea5dbe8f8af4\": container with ID starting with fdcdc6b207ef97cfd1da46845680c978bb20711e71e7bb6255c6ea5dbe8f8af4 not found: ID does not exist" containerID="fdcdc6b207ef97cfd1da46845680c978bb20711e71e7bb6255c6ea5dbe8f8af4" Jun 12 19:33:33.086128 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:33.086080 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdcdc6b207ef97cfd1da46845680c978bb20711e71e7bb6255c6ea5dbe8f8af4"} err="failed to get container status \"fdcdc6b207ef97cfd1da46845680c978bb20711e71e7bb6255c6ea5dbe8f8af4\": rpc error: code = NotFound desc = could not find container \"fdcdc6b207ef97cfd1da46845680c978bb20711e71e7bb6255c6ea5dbe8f8af4\": container with ID starting with fdcdc6b207ef97cfd1da46845680c978bb20711e71e7bb6255c6ea5dbe8f8af4 not found: ID does not exist" Jun 12 19:33:33.100475 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:33.100451 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b759ddc58-b8lsf"] Jun 12 19:33:33.105687 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:33.105665 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b759ddc58-b8lsf"] Jun 12 19:33:33.792672 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:33.792643 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a197dc7f-029c-4f8e-8dc6-040598768c96" path="/var/lib/kubelet/pods/a197dc7f-029c-4f8e-8dc6-040598768c96/volumes" Jun 12 19:33:50.513305 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:50.513272 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5c6fc6cd84-sznk5"] Jun 12 19:33:50.513865 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:50.513848 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a197dc7f-029c-4f8e-8dc6-040598768c96" containerName="manager" Jun 12 19:33:50.513910 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:50.513869 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a197dc7f-029c-4f8e-8dc6-040598768c96" containerName="manager" Jun 12 19:33:50.513962 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:50.513951 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a197dc7f-029c-4f8e-8dc6-040598768c96" containerName="manager" Jun 12 19:33:50.517349 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:50.517332 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5c6fc6cd84-sznk5" Jun 12 19:33:50.520750 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:50.520725 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 12 19:33:50.520864 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:50.520841 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-xrwfk\"" Jun 12 19:33:50.529208 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:50.529188 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5c6fc6cd84-sznk5"] Jun 12 19:33:50.659404 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:50.659371 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92ab8ce4-2056-4e8d-8ae5-55d23e2973b0-openshift-service-ca\") pod \"maas-api-5c6fc6cd84-sznk5\" (UID: \"92ab8ce4-2056-4e8d-8ae5-55d23e2973b0\") " pod="opendatahub/maas-api-5c6fc6cd84-sznk5" Jun 12 19:33:50.659570 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:50.659417 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92ab8ce4-2056-4e8d-8ae5-55d23e2973b0-maas-api-tls\") pod \"maas-api-5c6fc6cd84-sznk5\" (UID: \"92ab8ce4-2056-4e8d-8ae5-55d23e2973b0\") " pod="opendatahub/maas-api-5c6fc6cd84-sznk5" Jun 12 19:33:50.659570 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:50.659451 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnbmq\" (UniqueName: \"kubernetes.io/projected/92ab8ce4-2056-4e8d-8ae5-55d23e2973b0-kube-api-access-dnbmq\") pod \"maas-api-5c6fc6cd84-sznk5\" (UID: \"92ab8ce4-2056-4e8d-8ae5-55d23e2973b0\") " pod="opendatahub/maas-api-5c6fc6cd84-sznk5" Jun 12 19:33:50.760861 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:50.760831 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92ab8ce4-2056-4e8d-8ae5-55d23e2973b0-openshift-service-ca\") pod \"maas-api-5c6fc6cd84-sznk5\" (UID: \"92ab8ce4-2056-4e8d-8ae5-55d23e2973b0\") " pod="opendatahub/maas-api-5c6fc6cd84-sznk5" Jun 12 19:33:50.761031 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:50.760875 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92ab8ce4-2056-4e8d-8ae5-55d23e2973b0-maas-api-tls\") pod \"maas-api-5c6fc6cd84-sznk5\" (UID: \"92ab8ce4-2056-4e8d-8ae5-55d23e2973b0\") " pod="opendatahub/maas-api-5c6fc6cd84-sznk5" Jun 12 19:33:50.761031 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:50.760921 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnbmq\" (UniqueName: \"kubernetes.io/projected/92ab8ce4-2056-4e8d-8ae5-55d23e2973b0-kube-api-access-dnbmq\") pod \"maas-api-5c6fc6cd84-sznk5\" (UID: \"92ab8ce4-2056-4e8d-8ae5-55d23e2973b0\") " pod="opendatahub/maas-api-5c6fc6cd84-sznk5" Jun 12 19:33:50.761533 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:50.761482 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/92ab8ce4-2056-4e8d-8ae5-55d23e2973b0-openshift-service-ca\") pod \"maas-api-5c6fc6cd84-sznk5\" (UID: \"92ab8ce4-2056-4e8d-8ae5-55d23e2973b0\") " pod="opendatahub/maas-api-5c6fc6cd84-sznk5" Jun 12 19:33:50.763561 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:50.763509 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/92ab8ce4-2056-4e8d-8ae5-55d23e2973b0-maas-api-tls\") pod \"maas-api-5c6fc6cd84-sznk5\" (UID: \"92ab8ce4-2056-4e8d-8ae5-55d23e2973b0\") " pod="opendatahub/maas-api-5c6fc6cd84-sznk5" Jun 12 19:33:50.770129 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:50.770110 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnbmq\" (UniqueName: \"kubernetes.io/projected/92ab8ce4-2056-4e8d-8ae5-55d23e2973b0-kube-api-access-dnbmq\") pod \"maas-api-5c6fc6cd84-sznk5\" (UID: \"92ab8ce4-2056-4e8d-8ae5-55d23e2973b0\") " pod="opendatahub/maas-api-5c6fc6cd84-sznk5" Jun 12 19:33:50.828783 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:50.828752 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5c6fc6cd84-sznk5" Jun 12 19:33:50.973034 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:50.973012 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5c6fc6cd84-sznk5"] Jun 12 19:33:50.975041 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:33:50.975005 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92ab8ce4_2056_4e8d_8ae5_55d23e2973b0.slice/crio-ea6d2f32edcc186157457bb2d5c43552142e5ee743ea21e88dd124bf8f47daba WatchSource:0}: Error finding container ea6d2f32edcc186157457bb2d5c43552142e5ee743ea21e88dd124bf8f47daba: Status 404 returned error can't find the container with id ea6d2f32edcc186157457bb2d5c43552142e5ee743ea21e88dd124bf8f47daba Jun 12 19:33:50.976543 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:50.976527 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 19:33:51.059496 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:51.059421 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-wg66p"] Jun 12 19:33:51.064149 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:51.064131 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-wg66p" Jun 12 19:33:51.067686 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:51.067664 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 12 19:33:51.067805 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:51.067666 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5p52m\"" Jun 12 19:33:51.071953 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:51.071928 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-wg66p"] Jun 12 19:33:51.163344 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:51.163125 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5c6fc6cd84-sznk5" event={"ID":"92ab8ce4-2056-4e8d-8ae5-55d23e2973b0","Type":"ContainerStarted","Data":"ea6d2f32edcc186157457bb2d5c43552142e5ee743ea21e88dd124bf8f47daba"} Jun 12 19:33:51.165825 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:51.165797 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkpmt\" (UniqueName: \"kubernetes.io/projected/b7529688-0301-4d63-b400-c7be09253ea9-kube-api-access-pkpmt\") pod \"payload-processing-699b6cd6c-wg66p\" (UID: \"b7529688-0301-4d63-b400-c7be09253ea9\") " pod="openshift-ingress/payload-processing-699b6cd6c-wg66p" Jun 12 19:33:51.267314 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:51.267275 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkpmt\" (UniqueName: \"kubernetes.io/projected/b7529688-0301-4d63-b400-c7be09253ea9-kube-api-access-pkpmt\") pod \"payload-processing-699b6cd6c-wg66p\" (UID: \"b7529688-0301-4d63-b400-c7be09253ea9\") " pod="openshift-ingress/payload-processing-699b6cd6c-wg66p" Jun 12 19:33:51.277620 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:51.277590 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkpmt\" (UniqueName: \"kubernetes.io/projected/b7529688-0301-4d63-b400-c7be09253ea9-kube-api-access-pkpmt\") pod \"payload-processing-699b6cd6c-wg66p\" (UID: \"b7529688-0301-4d63-b400-c7be09253ea9\") " pod="openshift-ingress/payload-processing-699b6cd6c-wg66p" Jun 12 19:33:51.376408 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:51.376320 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-wg66p" Jun 12 19:33:51.508622 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:51.508585 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-wg66p"] Jun 12 19:33:51.510236 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:33:51.510211 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7529688_0301_4d63_b400_c7be09253ea9.slice/crio-5489b0c5402575d4543e78e9d78cb54374c1ff6a60675b57b6cfd6761126df2d WatchSource:0}: Error finding container 5489b0c5402575d4543e78e9d78cb54374c1ff6a60675b57b6cfd6761126df2d: Status 404 returned error can't find the container with id 5489b0c5402575d4543e78e9d78cb54374c1ff6a60675b57b6cfd6761126df2d Jun 12 19:33:52.172315 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:52.172272 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-wg66p" event={"ID":"b7529688-0301-4d63-b400-c7be09253ea9","Type":"ContainerStarted","Data":"5489b0c5402575d4543e78e9d78cb54374c1ff6a60675b57b6cfd6761126df2d"} Jun 12 19:33:54.185207 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:54.185175 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-wg66p" event={"ID":"b7529688-0301-4d63-b400-c7be09253ea9","Type":"ContainerStarted","Data":"1b6d8abeb9477167a9fca7ab7c292f937f6365743f169d2c80c9da8ae5ac26d5"} Jun 12 19:33:54.185646 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:54.185250 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-wg66p" Jun 12 19:33:54.186692 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:54.186662 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5c6fc6cd84-sznk5" event={"ID":"92ab8ce4-2056-4e8d-8ae5-55d23e2973b0","Type":"ContainerStarted","Data":"3a0a53980459d743754db6bff364c58753f8c119219d6e609a05cb47de87321e"} Jun 12 19:33:54.186801 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:54.186784 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5c6fc6cd84-sznk5" Jun 12 19:33:54.207781 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:54.207689 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-wg66p" podStartSLOduration=0.728912601 podStartE2EDuration="3.207675955s" totalImagesPullingTime="2.478763354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:33:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:33:54.205433574 +0000 UTC m=+684.866125538" watchObservedRunningTime="2026-06-12 19:33:54.207675955 +0000 UTC m=+684.868367895" Jun 12 19:33:54.229046 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:33:54.229003 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5c6fc6cd84-sznk5" podStartSLOduration=1.260813844 podStartE2EDuration="4.228989007s" totalImagesPullingTime="2.968175163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:33:54.228480263 +0000 UTC m=+684.889172227" watchObservedRunningTime="2026-06-12 19:33:54.228989007 +0000 UTC m=+684.889680971" Jun 12 19:34:00.197863 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:34:00.197833 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5c6fc6cd84-sznk5" Jun 12 19:34:05.194548 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:34:05.194516 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-wg66p" Jun 12 19:36:04.430495 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:04.430399 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 19:36:04.431068 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:04.430681 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="f197e353-d5c5-4c5d-a3bb-683174711982" containerName="keycloak" containerID="cri-o://8f980247a4d68af75b10fc7306fe5714eafc5a78dd79c78ac6bdb2d48bc4c58e" gracePeriod=30 Jun 12 19:36:06.084767 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.084739 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 19:36:06.111332 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.111242 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwfv6\" (UniqueName: \"kubernetes.io/projected/f197e353-d5c5-4c5d-a3bb-683174711982-kube-api-access-fwfv6\") pod \"f197e353-d5c5-4c5d-a3bb-683174711982\" (UID: \"f197e353-d5c5-4c5d-a3bb-683174711982\") " Jun 12 19:36:06.113752 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.113714 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f197e353-d5c5-4c5d-a3bb-683174711982-kube-api-access-fwfv6" (OuterVolumeSpecName: "kube-api-access-fwfv6") pod "f197e353-d5c5-4c5d-a3bb-683174711982" (UID: "f197e353-d5c5-4c5d-a3bb-683174711982"). InnerVolumeSpecName "kube-api-access-fwfv6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:36:06.212214 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.212181 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwfv6\" (UniqueName: \"kubernetes.io/projected/f197e353-d5c5-4c5d-a3bb-683174711982-kube-api-access-fwfv6\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:36:06.816786 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.816751 2558 generic.go:356] "Generic (PLEG): container finished" podID="f197e353-d5c5-4c5d-a3bb-683174711982" containerID="8f980247a4d68af75b10fc7306fe5714eafc5a78dd79c78ac6bdb2d48bc4c58e" exitCode=143 Jun 12 19:36:06.816985 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.816794 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 19:36:06.816985 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.816810 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f197e353-d5c5-4c5d-a3bb-683174711982","Type":"ContainerDied","Data":"8f980247a4d68af75b10fc7306fe5714eafc5a78dd79c78ac6bdb2d48bc4c58e"} Jun 12 19:36:06.816985 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.816856 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f197e353-d5c5-4c5d-a3bb-683174711982","Type":"ContainerDied","Data":"95da68baba53de303e5d1d1701583065c33ac71067fcff41384c5edc66d6b2d8"} Jun 12 19:36:06.816985 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.816880 2558 scope.go:117] "RemoveContainer" containerID="8f980247a4d68af75b10fc7306fe5714eafc5a78dd79c78ac6bdb2d48bc4c58e" Jun 12 19:36:06.826458 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.826438 2558 scope.go:117] "RemoveContainer" containerID="8f980247a4d68af75b10fc7306fe5714eafc5a78dd79c78ac6bdb2d48bc4c58e" Jun 12 19:36:06.826734 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:36:06.826716 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f980247a4d68af75b10fc7306fe5714eafc5a78dd79c78ac6bdb2d48bc4c58e\": container with ID starting with 8f980247a4d68af75b10fc7306fe5714eafc5a78dd79c78ac6bdb2d48bc4c58e not found: ID does not exist" containerID="8f980247a4d68af75b10fc7306fe5714eafc5a78dd79c78ac6bdb2d48bc4c58e" Jun 12 19:36:06.826786 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.826742 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f980247a4d68af75b10fc7306fe5714eafc5a78dd79c78ac6bdb2d48bc4c58e"} err="failed to get container status \"8f980247a4d68af75b10fc7306fe5714eafc5a78dd79c78ac6bdb2d48bc4c58e\": rpc error: code = NotFound desc = could not find container \"8f980247a4d68af75b10fc7306fe5714eafc5a78dd79c78ac6bdb2d48bc4c58e\": container with ID starting with 8f980247a4d68af75b10fc7306fe5714eafc5a78dd79c78ac6bdb2d48bc4c58e not found: ID does not exist" Jun 12 19:36:06.840420 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.840399 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 19:36:06.846442 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.846423 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 19:36:06.875436 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.875410 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 19:36:06.875782 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.875769 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f197e353-d5c5-4c5d-a3bb-683174711982" containerName="keycloak" Jun 12 19:36:06.875826 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.875784 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f197e353-d5c5-4c5d-a3bb-683174711982" containerName="keycloak" Jun 12 19:36:06.875862 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.875858 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f197e353-d5c5-4c5d-a3bb-683174711982" containerName="keycloak" Jun 12 19:36:06.880273 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.880257 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 19:36:06.882799 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.882781 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 12 19:36:06.882885 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.882798 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 12 19:36:06.883039 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.883017 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 12 19:36:06.883136 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.883018 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-mxbzd\"" Jun 12 19:36:06.883136 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.883060 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 12 19:36:06.890644 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.890624 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 19:36:06.917808 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.917784 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhwlz\" (UniqueName: \"kubernetes.io/projected/c672f141-d5a7-4894-8e12-6ddf615a3350-kube-api-access-nhwlz\") pod \"maas-keycloak-0\" (UID: \"c672f141-d5a7-4894-8e12-6ddf615a3350\") " pod="keycloak-system/maas-keycloak-0" Jun 12 19:36:06.917928 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:06.917871 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/c672f141-d5a7-4894-8e12-6ddf615a3350-test-realms\") pod \"maas-keycloak-0\" (UID: \"c672f141-d5a7-4894-8e12-6ddf615a3350\") " pod="keycloak-system/maas-keycloak-0" Jun 12 19:36:07.018807 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:07.018773 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/c672f141-d5a7-4894-8e12-6ddf615a3350-test-realms\") pod \"maas-keycloak-0\" (UID: \"c672f141-d5a7-4894-8e12-6ddf615a3350\") " pod="keycloak-system/maas-keycloak-0" Jun 12 19:36:07.018962 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:07.018820 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhwlz\" (UniqueName: \"kubernetes.io/projected/c672f141-d5a7-4894-8e12-6ddf615a3350-kube-api-access-nhwlz\") pod \"maas-keycloak-0\" (UID: \"c672f141-d5a7-4894-8e12-6ddf615a3350\") " pod="keycloak-system/maas-keycloak-0" Jun 12 19:36:07.019504 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:07.019482 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/c672f141-d5a7-4894-8e12-6ddf615a3350-test-realms\") pod \"maas-keycloak-0\" (UID: \"c672f141-d5a7-4894-8e12-6ddf615a3350\") " pod="keycloak-system/maas-keycloak-0" Jun 12 19:36:07.027863 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:07.027837 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhwlz\" (UniqueName: \"kubernetes.io/projected/c672f141-d5a7-4894-8e12-6ddf615a3350-kube-api-access-nhwlz\") pod \"maas-keycloak-0\" (UID: \"c672f141-d5a7-4894-8e12-6ddf615a3350\") " pod="keycloak-system/maas-keycloak-0" Jun 12 19:36:07.189774 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:07.189688 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 19:36:07.326811 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:07.326783 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 19:36:07.328689 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:36:07.328664 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc672f141_d5a7_4894_8e12_6ddf615a3350.slice/crio-6eab050891b4a9785e502eaba600074faf4ddda70a2d51a5def40bbd51029ff8 WatchSource:0}: Error finding container 6eab050891b4a9785e502eaba600074faf4ddda70a2d51a5def40bbd51029ff8: Status 404 returned error can't find the container with id 6eab050891b4a9785e502eaba600074faf4ddda70a2d51a5def40bbd51029ff8 Jun 12 19:36:07.792621 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:07.792574 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f197e353-d5c5-4c5d-a3bb-683174711982" path="/var/lib/kubelet/pods/f197e353-d5c5-4c5d-a3bb-683174711982/volumes" Jun 12 19:36:07.826534 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:07.826501 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c672f141-d5a7-4894-8e12-6ddf615a3350","Type":"ContainerStarted","Data":"30404c8e3f48c82647fe43601ba0c04ade590311073e9e8795512f4a867d8989"} Jun 12 19:36:07.826733 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:07.826547 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c672f141-d5a7-4894-8e12-6ddf615a3350","Type":"ContainerStarted","Data":"6eab050891b4a9785e502eaba600074faf4ddda70a2d51a5def40bbd51029ff8"} Jun 12 19:36:07.846662 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:07.846593 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.528650507 podStartE2EDuration="1.846578295s" totalImagesPullingTime="317.927788ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:36:07.845602366 +0000 UTC m=+818.506294331" watchObservedRunningTime="2026-06-12 19:36:07.846578295 +0000 UTC m=+818.507270257" Jun 12 19:36:08.190625 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:08.190579 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 12 19:36:08.192088 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:08.192058 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c672f141-d5a7-4894-8e12-6ddf615a3350" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 12 19:36:09.191112 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:09.191064 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c672f141-d5a7-4894-8e12-6ddf615a3350" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 12 19:36:10.190493 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:10.190444 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c672f141-d5a7-4894-8e12-6ddf615a3350" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 12 19:36:11.190980 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:11.190917 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c672f141-d5a7-4894-8e12-6ddf615a3350" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 12 19:36:12.192786 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:12.192739 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c672f141-d5a7-4894-8e12-6ddf615a3350" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 12 19:36:13.190537 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:13.190488 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c672f141-d5a7-4894-8e12-6ddf615a3350" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 12 19:36:14.190594 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:14.190540 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c672f141-d5a7-4894-8e12-6ddf615a3350" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 12 19:36:15.190132 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:15.190072 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c672f141-d5a7-4894-8e12-6ddf615a3350" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 12 19:36:16.190499 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:16.190448 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c672f141-d5a7-4894-8e12-6ddf615a3350" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 12 19:36:17.190826 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:17.190785 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 12 19:36:17.191314 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:17.191095 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c672f141-d5a7-4894-8e12-6ddf615a3350" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 12 19:36:18.190691 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:18.190647 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c672f141-d5a7-4894-8e12-6ddf615a3350" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 12 19:36:19.191196 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:19.191140 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c672f141-d5a7-4894-8e12-6ddf615a3350" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 12 19:36:20.190693 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:20.190640 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c672f141-d5a7-4894-8e12-6ddf615a3350" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 12 19:36:21.311784 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:21.311746 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 12 19:36:21.330137 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:21.329816 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="c672f141-d5a7-4894-8e12-6ddf615a3350" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 19:36:31.318079 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:36:31.318043 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 12 19:37:08.663492 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.663456 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq"] Jun 12 19:37:08.668248 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.668224 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:08.672339 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.672316 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 12 19:37:08.672339 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.672330 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 12 19:37:08.672524 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.672367 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-k4tkc\"" Jun 12 19:37:08.672524 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.672316 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 12 19:37:08.679395 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.679371 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq"] Jun 12 19:37:08.714068 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.714041 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ghsgq\" (UID: \"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:08.714226 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.714097 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ghsgq\" (UID: \"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:08.714226 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.714186 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6t2f\" (UniqueName: \"kubernetes.io/projected/4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38-kube-api-access-t6t2f\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ghsgq\" (UID: \"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:08.714226 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.714209 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ghsgq\" (UID: \"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:08.714226 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.714226 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ghsgq\" (UID: \"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:08.714431 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.714250 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ghsgq\" (UID: \"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:08.814681 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.814640 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ghsgq\" (UID: \"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:08.814681 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.814687 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ghsgq\" (UID: \"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:08.814921 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.814722 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6t2f\" (UniqueName: \"kubernetes.io/projected/4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38-kube-api-access-t6t2f\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ghsgq\" (UID: \"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:08.814921 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.814740 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ghsgq\" (UID: \"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:08.814921 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.814760 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ghsgq\" (UID: \"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:08.814921 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.814785 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ghsgq\" (UID: \"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:08.815120 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.815086 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ghsgq\" (UID: \"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:08.815240 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.815217 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ghsgq\" (UID: \"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:08.815240 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.815234 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ghsgq\" (UID: \"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:08.817198 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.817174 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ghsgq\" (UID: \"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:08.817475 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.817457 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ghsgq\" (UID: \"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:08.824883 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:08.824852 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6t2f\" (UniqueName: \"kubernetes.io/projected/4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38-kube-api-access-t6t2f\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ghsgq\" (UID: \"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:09.005462 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:09.005423 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:09.151127 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:09.151099 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq"] Jun 12 19:37:09.152579 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:37:09.152554 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f216119_9d4f_4ad7_88e2_5d1e5f5e5c38.slice/crio-970083a952d1d6ced46d83da7f389518e0add5920baa260701c2b4450baf91dd WatchSource:0}: Error finding container 970083a952d1d6ced46d83da7f389518e0add5920baa260701c2b4450baf91dd: Status 404 returned error can't find the container with id 970083a952d1d6ced46d83da7f389518e0add5920baa260701c2b4450baf91dd Jun 12 19:37:10.159384 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:10.159291 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" event={"ID":"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38","Type":"ContainerStarted","Data":"970083a952d1d6ced46d83da7f389518e0add5920baa260701c2b4450baf91dd"} Jun 12 19:37:13.177322 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:13.177284 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" event={"ID":"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38","Type":"ContainerStarted","Data":"ef0d4dad336699372044860c318c5794db8ac2109c2eb5ceb94e9df0c85b9d36"} Jun 12 19:37:14.183671 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:14.183632 2558 generic.go:356] "Generic (PLEG): container finished" podID="4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38" containerID="ef0d4dad336699372044860c318c5794db8ac2109c2eb5ceb94e9df0c85b9d36" exitCode=0 Jun 12 19:37:14.184044 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:14.183712 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" event={"ID":"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38","Type":"ContainerDied","Data":"ef0d4dad336699372044860c318c5794db8ac2109c2eb5ceb94e9df0c85b9d36"} Jun 12 19:37:16.196851 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:16.196816 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" event={"ID":"4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38","Type":"ContainerStarted","Data":"c5bf9f1c2ed6a14d7532770920576ecb7fe0ca54d8ce8690ff9508829defbb86"} Jun 12 19:37:16.219742 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:16.219695 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" podStartSLOduration=2.627602581 podStartE2EDuration="8.219677861s" totalImagesPullingTime="4.384011588s" totalInitContainerRuntime="1.208063692s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:37:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:37:16.218375764 +0000 UTC m=+886.879067743" watchObservedRunningTime="2026-06-12 19:37:16.219677861 +0000 UTC m=+886.880369823" Jun 12 19:37:19.006046 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:19.006003 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:19.006438 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:19.006071 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:19.019274 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:19.019250 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:19.223455 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:19.223426 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ghsgq" Jun 12 19:37:29.813077 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:29.813050 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4ck7_7069475a-78c9-4feb-a9b4-f4099f73a3d7/ovn-acl-logging/0.log" Jun 12 19:37:29.813494 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:29.813245 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4ck7_7069475a-78c9-4feb-a9b4-f4099f73a3d7/ovn-acl-logging/0.log" Jun 12 19:37:48.573161 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.573122 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76"] Jun 12 19:37:48.577303 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.577274 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:37:48.580171 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.580143 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 12 19:37:48.587831 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.587810 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76"] Jun 12 19:37:48.670756 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.670728 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68186597-ac47-4c72-bc10-1838e8c6837d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mfb76\" (UID: \"68186597-ac47-4c72-bc10-1838e8c6837d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:37:48.670918 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.670777 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68186597-ac47-4c72-bc10-1838e8c6837d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mfb76\" (UID: \"68186597-ac47-4c72-bc10-1838e8c6837d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:37:48.670918 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.670855 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/68186597-ac47-4c72-bc10-1838e8c6837d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mfb76\" (UID: \"68186597-ac47-4c72-bc10-1838e8c6837d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:37:48.670991 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.670920 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68186597-ac47-4c72-bc10-1838e8c6837d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mfb76\" (UID: \"68186597-ac47-4c72-bc10-1838e8c6837d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:37:48.670991 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.670954 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68186597-ac47-4c72-bc10-1838e8c6837d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mfb76\" (UID: \"68186597-ac47-4c72-bc10-1838e8c6837d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:37:48.670991 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.670973 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk9sw\" (UniqueName: \"kubernetes.io/projected/68186597-ac47-4c72-bc10-1838e8c6837d-kube-api-access-kk9sw\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mfb76\" (UID: \"68186597-ac47-4c72-bc10-1838e8c6837d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:37:48.772180 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.772140 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68186597-ac47-4c72-bc10-1838e8c6837d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mfb76\" (UID: \"68186597-ac47-4c72-bc10-1838e8c6837d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:37:48.772334 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.772233 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/68186597-ac47-4c72-bc10-1838e8c6837d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mfb76\" (UID: \"68186597-ac47-4c72-bc10-1838e8c6837d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:37:48.772334 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.772273 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68186597-ac47-4c72-bc10-1838e8c6837d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mfb76\" (UID: \"68186597-ac47-4c72-bc10-1838e8c6837d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:37:48.772430 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.772404 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68186597-ac47-4c72-bc10-1838e8c6837d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mfb76\" (UID: \"68186597-ac47-4c72-bc10-1838e8c6837d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:37:48.772483 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.772450 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk9sw\" (UniqueName: \"kubernetes.io/projected/68186597-ac47-4c72-bc10-1838e8c6837d-kube-api-access-kk9sw\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mfb76\" (UID: \"68186597-ac47-4c72-bc10-1838e8c6837d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:37:48.772535 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.772514 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68186597-ac47-4c72-bc10-1838e8c6837d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mfb76\" (UID: \"68186597-ac47-4c72-bc10-1838e8c6837d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:37:48.772587 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.772552 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68186597-ac47-4c72-bc10-1838e8c6837d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mfb76\" (UID: \"68186597-ac47-4c72-bc10-1838e8c6837d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:37:48.772674 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.772599 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/68186597-ac47-4c72-bc10-1838e8c6837d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mfb76\" (UID: \"68186597-ac47-4c72-bc10-1838e8c6837d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:37:48.772871 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.772846 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68186597-ac47-4c72-bc10-1838e8c6837d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mfb76\" (UID: \"68186597-ac47-4c72-bc10-1838e8c6837d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:37:48.774867 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.774839 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68186597-ac47-4c72-bc10-1838e8c6837d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mfb76\" (UID: \"68186597-ac47-4c72-bc10-1838e8c6837d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:37:48.774952 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.774917 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68186597-ac47-4c72-bc10-1838e8c6837d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mfb76\" (UID: \"68186597-ac47-4c72-bc10-1838e8c6837d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:37:48.787062 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.787035 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk9sw\" (UniqueName: \"kubernetes.io/projected/68186597-ac47-4c72-bc10-1838e8c6837d-kube-api-access-kk9sw\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mfb76\" (UID: \"68186597-ac47-4c72-bc10-1838e8c6837d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:37:48.888887 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:48.888802 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:37:49.025175 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:49.025151 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76"] Jun 12 19:37:49.027123 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:37:49.027097 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68186597_ac47_4c72_bc10_1838e8c6837d.slice/crio-dea3a144c6e974339fe29e9452d1161821a7627f8657403e4cfb652d10b7f3cd WatchSource:0}: Error finding container dea3a144c6e974339fe29e9452d1161821a7627f8657403e4cfb652d10b7f3cd: Status 404 returned error can't find the container with id dea3a144c6e974339fe29e9452d1161821a7627f8657403e4cfb652d10b7f3cd Jun 12 19:37:49.358624 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:49.358575 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" event={"ID":"68186597-ac47-4c72-bc10-1838e8c6837d","Type":"ContainerStarted","Data":"79fdf2d9a4cd2fb08dfd916d082e35b652f220a4d3622f442d8ca1d8cecb7441"} Jun 12 19:37:49.358624 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:37:49.358624 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" event={"ID":"68186597-ac47-4c72-bc10-1838e8c6837d","Type":"ContainerStarted","Data":"dea3a144c6e974339fe29e9452d1161821a7627f8657403e4cfb652d10b7f3cd"} Jun 12 19:38:42.620290 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:38:42.620206 2558 generic.go:356] "Generic (PLEG): container finished" podID="68186597-ac47-4c72-bc10-1838e8c6837d" containerID="79fdf2d9a4cd2fb08dfd916d082e35b652f220a4d3622f442d8ca1d8cecb7441" exitCode=0 Jun 12 19:38:42.620290 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:38:42.620278 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" event={"ID":"68186597-ac47-4c72-bc10-1838e8c6837d","Type":"ContainerDied","Data":"79fdf2d9a4cd2fb08dfd916d082e35b652f220a4d3622f442d8ca1d8cecb7441"} Jun 12 19:38:43.627152 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:38:43.627112 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" event={"ID":"68186597-ac47-4c72-bc10-1838e8c6837d","Type":"ContainerStarted","Data":"f7001ce78367de5d4b5cf1b85bc8cd2d9a578003574da63b4aa258ff87a45923"} Jun 12 19:38:43.650239 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:38:43.650185 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" podStartSLOduration=2.217434332 podStartE2EDuration="55.650170569s" totalImagesPullingTime="207.290401ms" totalInitContainerRuntime="53.225445836s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:38:43.648285814 +0000 UTC m=+974.308977777" watchObservedRunningTime="2026-06-12 19:38:43.650170569 +0000 UTC m=+974.310862531" Jun 12 19:38:48.889170 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:38:48.889122 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:38:48.889170 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:38:48.889181 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:38:48.901771 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:38:48.901749 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:38:49.667340 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:38:49.667310 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mfb76" Jun 12 19:39:00.689846 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:00.689814 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5ccbb9675b-l8tf7"] Jun 12 19:39:00.693580 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:00.693560 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5ccbb9675b-l8tf7" Jun 12 19:39:00.702753 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:00.702730 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5ccbb9675b-l8tf7"] Jun 12 19:39:00.845232 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:00.845196 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d697d6d-4405-47ff-85ed-3a199f212f2a-webhook-cert\") pod \"maas-controller-5ccbb9675b-l8tf7\" (UID: \"9d697d6d-4405-47ff-85ed-3a199f212f2a\") " pod="opendatahub/maas-controller-5ccbb9675b-l8tf7" Jun 12 19:39:00.845386 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:00.845309 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcglb\" (UniqueName: \"kubernetes.io/projected/9d697d6d-4405-47ff-85ed-3a199f212f2a-kube-api-access-jcglb\") pod \"maas-controller-5ccbb9675b-l8tf7\" (UID: \"9d697d6d-4405-47ff-85ed-3a199f212f2a\") " pod="opendatahub/maas-controller-5ccbb9675b-l8tf7" Jun 12 19:39:00.946181 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:00.946101 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcglb\" (UniqueName: \"kubernetes.io/projected/9d697d6d-4405-47ff-85ed-3a199f212f2a-kube-api-access-jcglb\") pod \"maas-controller-5ccbb9675b-l8tf7\" (UID: \"9d697d6d-4405-47ff-85ed-3a199f212f2a\") " pod="opendatahub/maas-controller-5ccbb9675b-l8tf7" Jun 12 19:39:00.946181 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:00.946156 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d697d6d-4405-47ff-85ed-3a199f212f2a-webhook-cert\") pod \"maas-controller-5ccbb9675b-l8tf7\" (UID: \"9d697d6d-4405-47ff-85ed-3a199f212f2a\") " pod="opendatahub/maas-controller-5ccbb9675b-l8tf7" Jun 12 19:39:00.948660 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:00.948632 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d697d6d-4405-47ff-85ed-3a199f212f2a-webhook-cert\") pod \"maas-controller-5ccbb9675b-l8tf7\" (UID: \"9d697d6d-4405-47ff-85ed-3a199f212f2a\") " pod="opendatahub/maas-controller-5ccbb9675b-l8tf7" Jun 12 19:39:00.957511 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:00.957487 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcglb\" (UniqueName: \"kubernetes.io/projected/9d697d6d-4405-47ff-85ed-3a199f212f2a-kube-api-access-jcglb\") pod \"maas-controller-5ccbb9675b-l8tf7\" (UID: \"9d697d6d-4405-47ff-85ed-3a199f212f2a\") " pod="opendatahub/maas-controller-5ccbb9675b-l8tf7" Jun 12 19:39:01.004084 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:01.004061 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5ccbb9675b-l8tf7" Jun 12 19:39:01.150417 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:01.149067 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5ccbb9675b-l8tf7"] Jun 12 19:39:01.151249 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:01.151227 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 19:39:01.549538 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:01.549513 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 12 19:39:01.718104 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:01.718067 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5ccbb9675b-l8tf7" event={"ID":"9d697d6d-4405-47ff-85ed-3a199f212f2a","Type":"ContainerStarted","Data":"3e4345bdc2752120b6a92ae7847568b4aabfc34152c444104c1edb10281f6aa9"} Jun 12 19:39:01.718485 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:01.718117 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5ccbb9675b-l8tf7" event={"ID":"9d697d6d-4405-47ff-85ed-3a199f212f2a","Type":"ContainerStarted","Data":"11a60784730783742e00313099a9d45f5632580cf11f9d80e1499c89d70b6ff4"} Jun 12 19:39:01.718485 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:01.718155 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5ccbb9675b-l8tf7" Jun 12 19:39:01.738659 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:01.738591 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5ccbb9675b-l8tf7" podStartSLOduration=1.343652863 podStartE2EDuration="1.738576124s" totalImagesPullingTime="394.923261ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:39:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:39:01.737205679 +0000 UTC m=+992.397897647" watchObservedRunningTime="2026-06-12 19:39:01.738576124 +0000 UTC m=+992.399268086" Jun 12 19:39:12.731972 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:12.731938 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5ccbb9675b-l8tf7" Jun 12 19:39:12.786050 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:12.786019 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84ccb868f8-9qdlt"] Jun 12 19:39:12.786269 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:12.786244 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-84ccb868f8-9qdlt" podUID="5db7ab02-348c-48ed-a355-dfbd41f57f2e" containerName="manager" containerID="cri-o://60f95933af005e6ebddd1ab4e325b12ae8b0e6e48f50ba6d58e27bca3904246c" gracePeriod=30 Jun 12 19:39:13.043577 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:13.043550 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84ccb868f8-9qdlt" Jun 12 19:39:13.161085 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:13.161054 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fht9n\" (UniqueName: \"kubernetes.io/projected/5db7ab02-348c-48ed-a355-dfbd41f57f2e-kube-api-access-fht9n\") pod \"5db7ab02-348c-48ed-a355-dfbd41f57f2e\" (UID: \"5db7ab02-348c-48ed-a355-dfbd41f57f2e\") " Jun 12 19:39:13.161259 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:13.161099 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5db7ab02-348c-48ed-a355-dfbd41f57f2e-webhook-cert\") pod \"5db7ab02-348c-48ed-a355-dfbd41f57f2e\" (UID: \"5db7ab02-348c-48ed-a355-dfbd41f57f2e\") " Jun 12 19:39:13.163260 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:13.163229 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5db7ab02-348c-48ed-a355-dfbd41f57f2e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5db7ab02-348c-48ed-a355-dfbd41f57f2e" (UID: "5db7ab02-348c-48ed-a355-dfbd41f57f2e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:39:13.163370 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:13.163266 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5db7ab02-348c-48ed-a355-dfbd41f57f2e-kube-api-access-fht9n" (OuterVolumeSpecName: "kube-api-access-fht9n") pod "5db7ab02-348c-48ed-a355-dfbd41f57f2e" (UID: "5db7ab02-348c-48ed-a355-dfbd41f57f2e"). InnerVolumeSpecName "kube-api-access-fht9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:39:13.262207 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:13.262158 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fht9n\" (UniqueName: \"kubernetes.io/projected/5db7ab02-348c-48ed-a355-dfbd41f57f2e-kube-api-access-fht9n\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:39:13.262207 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:13.262202 2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5db7ab02-348c-48ed-a355-dfbd41f57f2e-webhook-cert\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:39:13.780824 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:13.780788 2558 generic.go:356] "Generic (PLEG): container finished" podID="5db7ab02-348c-48ed-a355-dfbd41f57f2e" containerID="60f95933af005e6ebddd1ab4e325b12ae8b0e6e48f50ba6d58e27bca3904246c" exitCode=0 Jun 12 19:39:13.781292 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:13.780842 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84ccb868f8-9qdlt" Jun 12 19:39:13.781292 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:13.780871 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84ccb868f8-9qdlt" event={"ID":"5db7ab02-348c-48ed-a355-dfbd41f57f2e","Type":"ContainerDied","Data":"60f95933af005e6ebddd1ab4e325b12ae8b0e6e48f50ba6d58e27bca3904246c"} Jun 12 19:39:13.781292 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:13.780966 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84ccb868f8-9qdlt" event={"ID":"5db7ab02-348c-48ed-a355-dfbd41f57f2e","Type":"ContainerDied","Data":"65f385fcfc643bbcc6e388ab641a48432ea2f5bee90515324072dbff2a69406c"} Jun 12 19:39:13.781292 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:13.781000 2558 scope.go:117] "RemoveContainer" containerID="60f95933af005e6ebddd1ab4e325b12ae8b0e6e48f50ba6d58e27bca3904246c" Jun 12 19:39:13.790540 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:13.790371 2558 scope.go:117] "RemoveContainer" containerID="60f95933af005e6ebddd1ab4e325b12ae8b0e6e48f50ba6d58e27bca3904246c" Jun 12 19:39:13.790661 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:39:13.790644 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60f95933af005e6ebddd1ab4e325b12ae8b0e6e48f50ba6d58e27bca3904246c\": container with ID starting with 60f95933af005e6ebddd1ab4e325b12ae8b0e6e48f50ba6d58e27bca3904246c not found: ID does not exist" containerID="60f95933af005e6ebddd1ab4e325b12ae8b0e6e48f50ba6d58e27bca3904246c" Jun 12 19:39:13.790715 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:13.790668 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60f95933af005e6ebddd1ab4e325b12ae8b0e6e48f50ba6d58e27bca3904246c"} err="failed to get container status \"60f95933af005e6ebddd1ab4e325b12ae8b0e6e48f50ba6d58e27bca3904246c\": rpc error: code = NotFound desc = could not find container \"60f95933af005e6ebddd1ab4e325b12ae8b0e6e48f50ba6d58e27bca3904246c\": container with ID starting with 60f95933af005e6ebddd1ab4e325b12ae8b0e6e48f50ba6d58e27bca3904246c not found: ID does not exist" Jun 12 19:39:13.804924 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:13.804893 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84ccb868f8-9qdlt"] Jun 12 19:39:13.809993 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:13.809970 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84ccb868f8-9qdlt"] Jun 12 19:39:15.792888 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:39:15.792858 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5db7ab02-348c-48ed-a355-dfbd41f57f2e" path="/var/lib/kubelet/pods/5db7ab02-348c-48ed-a355-dfbd41f57f2e/volumes" Jun 12 19:40:38.365206 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:38.365163 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5ccbb9675b-l8tf7"] Jun 12 19:40:38.365759 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:38.365393 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5ccbb9675b-l8tf7" podUID="9d697d6d-4405-47ff-85ed-3a199f212f2a" containerName="manager" containerID="cri-o://3e4345bdc2752120b6a92ae7847568b4aabfc34152c444104c1edb10281f6aa9" gracePeriod=30 Jun 12 19:40:38.620289 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:38.620228 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5ccbb9675b-l8tf7" Jun 12 19:40:38.656949 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:38.656919 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcglb\" (UniqueName: \"kubernetes.io/projected/9d697d6d-4405-47ff-85ed-3a199f212f2a-kube-api-access-jcglb\") pod \"9d697d6d-4405-47ff-85ed-3a199f212f2a\" (UID: \"9d697d6d-4405-47ff-85ed-3a199f212f2a\") " Jun 12 19:40:38.656949 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:38.656958 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d697d6d-4405-47ff-85ed-3a199f212f2a-webhook-cert\") pod \"9d697d6d-4405-47ff-85ed-3a199f212f2a\" (UID: \"9d697d6d-4405-47ff-85ed-3a199f212f2a\") " Jun 12 19:40:38.659196 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:38.659172 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d697d6d-4405-47ff-85ed-3a199f212f2a-kube-api-access-jcglb" (OuterVolumeSpecName: "kube-api-access-jcglb") pod "9d697d6d-4405-47ff-85ed-3a199f212f2a" (UID: "9d697d6d-4405-47ff-85ed-3a199f212f2a"). InnerVolumeSpecName "kube-api-access-jcglb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:40:38.659380 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:38.659361 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d697d6d-4405-47ff-85ed-3a199f212f2a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9d697d6d-4405-47ff-85ed-3a199f212f2a" (UID: "9d697d6d-4405-47ff-85ed-3a199f212f2a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:40:38.757760 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:38.757727 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcglb\" (UniqueName: \"kubernetes.io/projected/9d697d6d-4405-47ff-85ed-3a199f212f2a-kube-api-access-jcglb\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:40:38.757760 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:38.757757 2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d697d6d-4405-47ff-85ed-3a199f212f2a-webhook-cert\") on node \"ip-10-0-135-76.ec2.internal\" DevicePath \"\"" Jun 12 19:40:39.194172 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:39.194136 2558 generic.go:356] "Generic (PLEG): container finished" podID="9d697d6d-4405-47ff-85ed-3a199f212f2a" containerID="3e4345bdc2752120b6a92ae7847568b4aabfc34152c444104c1edb10281f6aa9" exitCode=0 Jun 12 19:40:39.194377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:39.194178 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5ccbb9675b-l8tf7" Jun 12 19:40:39.194377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:39.194223 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5ccbb9675b-l8tf7" event={"ID":"9d697d6d-4405-47ff-85ed-3a199f212f2a","Type":"ContainerDied","Data":"3e4345bdc2752120b6a92ae7847568b4aabfc34152c444104c1edb10281f6aa9"} Jun 12 19:40:39.194377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:39.194277 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5ccbb9675b-l8tf7" event={"ID":"9d697d6d-4405-47ff-85ed-3a199f212f2a","Type":"ContainerDied","Data":"11a60784730783742e00313099a9d45f5632580cf11f9d80e1499c89d70b6ff4"} Jun 12 19:40:39.194377 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:39.194305 2558 scope.go:117] "RemoveContainer" containerID="3e4345bdc2752120b6a92ae7847568b4aabfc34152c444104c1edb10281f6aa9" Jun 12 19:40:39.203800 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:39.203779 2558 scope.go:117] "RemoveContainer" containerID="3e4345bdc2752120b6a92ae7847568b4aabfc34152c444104c1edb10281f6aa9" Jun 12 19:40:39.204105 ip-10-0-135-76 kubenswrapper[2558]: E0612 19:40:39.204087 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e4345bdc2752120b6a92ae7847568b4aabfc34152c444104c1edb10281f6aa9\": container with ID starting with 3e4345bdc2752120b6a92ae7847568b4aabfc34152c444104c1edb10281f6aa9 not found: ID does not exist" containerID="3e4345bdc2752120b6a92ae7847568b4aabfc34152c444104c1edb10281f6aa9" Jun 12 19:40:39.204149 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:39.204114 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e4345bdc2752120b6a92ae7847568b4aabfc34152c444104c1edb10281f6aa9"} err="failed to get container status \"3e4345bdc2752120b6a92ae7847568b4aabfc34152c444104c1edb10281f6aa9\": rpc error: code = NotFound desc = could not find container \"3e4345bdc2752120b6a92ae7847568b4aabfc34152c444104c1edb10281f6aa9\": container with ID starting with 3e4345bdc2752120b6a92ae7847568b4aabfc34152c444104c1edb10281f6aa9 not found: ID does not exist" Jun 12 19:40:39.217350 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:39.217325 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5ccbb9675b-l8tf7"] Jun 12 19:40:39.221397 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:39.221373 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5ccbb9675b-l8tf7"] Jun 12 19:40:39.792627 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:39.792585 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d697d6d-4405-47ff-85ed-3a199f212f2a" path="/var/lib/kubelet/pods/9d697d6d-4405-47ff-85ed-3a199f212f2a/volumes" Jun 12 19:40:40.044098 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:40.044015 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5ccbb9675b-7m9s8"] Jun 12 19:40:40.044421 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:40.044408 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d697d6d-4405-47ff-85ed-3a199f212f2a" containerName="manager" Jun 12 19:40:40.044463 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:40.044422 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d697d6d-4405-47ff-85ed-3a199f212f2a" containerName="manager" Jun 12 19:40:40.044463 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:40.044443 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5db7ab02-348c-48ed-a355-dfbd41f57f2e" containerName="manager" Jun 12 19:40:40.044463 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:40.044449 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5db7ab02-348c-48ed-a355-dfbd41f57f2e" containerName="manager" Jun 12 19:40:40.044558 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:40.044537 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5db7ab02-348c-48ed-a355-dfbd41f57f2e" containerName="manager" Jun 12 19:40:40.044558 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:40.044548 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d697d6d-4405-47ff-85ed-3a199f212f2a" containerName="manager" Jun 12 19:40:40.049214 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:40.049196 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5ccbb9675b-7m9s8" Jun 12 19:40:40.052820 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:40.052788 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 12 19:40:40.053027 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:40.052821 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sjgx9\"" Jun 12 19:40:40.053027 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:40.052829 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 12 19:40:40.058543 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:40.058523 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5ccbb9675b-7m9s8"] Jun 12 19:40:40.171719 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:40.171684 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d85c754-de64-40d7-8089-89ea323cc18e-webhook-cert\") pod \"maas-controller-5ccbb9675b-7m9s8\" (UID: \"1d85c754-de64-40d7-8089-89ea323cc18e\") " pod="opendatahub/maas-controller-5ccbb9675b-7m9s8" Jun 12 19:40:40.171924 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:40.171745 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh9xg\" (UniqueName: \"kubernetes.io/projected/1d85c754-de64-40d7-8089-89ea323cc18e-kube-api-access-qh9xg\") pod \"maas-controller-5ccbb9675b-7m9s8\" (UID: \"1d85c754-de64-40d7-8089-89ea323cc18e\") " pod="opendatahub/maas-controller-5ccbb9675b-7m9s8" Jun 12 19:40:40.272903 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:40.272861 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh9xg\" (UniqueName: \"kubernetes.io/projected/1d85c754-de64-40d7-8089-89ea323cc18e-kube-api-access-qh9xg\") pod \"maas-controller-5ccbb9675b-7m9s8\" (UID: \"1d85c754-de64-40d7-8089-89ea323cc18e\") " pod="opendatahub/maas-controller-5ccbb9675b-7m9s8" Jun 12 19:40:40.273113 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:40.272995 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d85c754-de64-40d7-8089-89ea323cc18e-webhook-cert\") pod \"maas-controller-5ccbb9675b-7m9s8\" (UID: \"1d85c754-de64-40d7-8089-89ea323cc18e\") " pod="opendatahub/maas-controller-5ccbb9675b-7m9s8" Jun 12 19:40:40.275584 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:40.275557 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d85c754-de64-40d7-8089-89ea323cc18e-webhook-cert\") pod \"maas-controller-5ccbb9675b-7m9s8\" (UID: \"1d85c754-de64-40d7-8089-89ea323cc18e\") " pod="opendatahub/maas-controller-5ccbb9675b-7m9s8" Jun 12 19:40:40.282389 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:40.282358 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh9xg\" (UniqueName: \"kubernetes.io/projected/1d85c754-de64-40d7-8089-89ea323cc18e-kube-api-access-qh9xg\") pod \"maas-controller-5ccbb9675b-7m9s8\" (UID: \"1d85c754-de64-40d7-8089-89ea323cc18e\") " pod="opendatahub/maas-controller-5ccbb9675b-7m9s8" Jun 12 19:40:40.361354 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:40.361251 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5ccbb9675b-7m9s8" Jun 12 19:40:40.499796 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:40.499772 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5ccbb9675b-7m9s8"] Jun 12 19:40:40.501394 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:40:40.501363 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d85c754_de64_40d7_8089_89ea323cc18e.slice/crio-44dbb56ddc048a69e4002503ab38c73728ce3d196bde1e8f298809e144adcf29 WatchSource:0}: Error finding container 44dbb56ddc048a69e4002503ab38c73728ce3d196bde1e8f298809e144adcf29: Status 404 returned error can't find the container with id 44dbb56ddc048a69e4002503ab38c73728ce3d196bde1e8f298809e144adcf29 Jun 12 19:40:41.206042 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:41.205952 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5ccbb9675b-7m9s8" event={"ID":"1d85c754-de64-40d7-8089-89ea323cc18e","Type":"ContainerStarted","Data":"71303db83c3499c477d755b011b2b757a557a56cba016603df7a3598bcd66a17"} Jun 12 19:40:41.206042 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:41.206015 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5ccbb9675b-7m9s8" event={"ID":"1d85c754-de64-40d7-8089-89ea323cc18e","Type":"ContainerStarted","Data":"44dbb56ddc048a69e4002503ab38c73728ce3d196bde1e8f298809e144adcf29"} Jun 12 19:40:41.206641 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:41.206087 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5ccbb9675b-7m9s8" Jun 12 19:40:41.225931 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:41.225887 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5ccbb9675b-7m9s8" podStartSLOduration=0.805248089 podStartE2EDuration="1.225874333s" totalImagesPullingTime="420.626244ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:40:41.224199055 +0000 UTC m=+1091.884891018" watchObservedRunningTime="2026-06-12 19:40:41.225874333 +0000 UTC m=+1091.886566295" Jun 12 19:40:52.218054 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:40:52.218017 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5ccbb9675b-7m9s8" Jun 12 19:42:29.845405 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:42:29.845377 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4ck7_7069475a-78c9-4feb-a9b4-f4099f73a3d7/ovn-acl-logging/0.log" Jun 12 19:42:29.847892 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:42:29.847873 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4ck7_7069475a-78c9-4feb-a9b4-f4099f73a3d7/ovn-acl-logging/0.log" Jun 12 19:47:29.876116 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:47:29.876081 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4ck7_7069475a-78c9-4feb-a9b4-f4099f73a3d7/ovn-acl-logging/0.log" Jun 12 19:47:29.880567 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:47:29.880544 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4ck7_7069475a-78c9-4feb-a9b4-f4099f73a3d7/ovn-acl-logging/0.log" Jun 12 19:52:29.913196 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:52:29.913166 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4ck7_7069475a-78c9-4feb-a9b4-f4099f73a3d7/ovn-acl-logging/0.log" Jun 12 19:52:29.918962 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:52:29.918941 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4ck7_7069475a-78c9-4feb-a9b4-f4099f73a3d7/ovn-acl-logging/0.log" Jun 12 19:57:29.948628 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:29.948578 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4ck7_7069475a-78c9-4feb-a9b4-f4099f73a3d7/ovn-acl-logging/0.log" Jun 12 19:57:29.961886 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:29.961855 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-r4ck7_7069475a-78c9-4feb-a9b4-f4099f73a3d7/ovn-acl-logging/0.log" Jun 12 19:57:41.305107 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:41.305072 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5c6fc6cd84-sznk5_92ab8ce4-2056-4e8d-8ae5-55d23e2973b0/maas-api/0.log" Jun 12 19:57:41.531448 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:41.531418 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5ccbb9675b-7m9s8_1d85c754-de64-40d7-8089-89ea323cc18e/manager/0.log" Jun 12 19:57:42.018982 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:42.018949 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-789f988849-mdzqv_45d1f165-6a93-4cc0-9f04-ebe6cb5b5171/copy-manifests/0.log" Jun 12 19:57:42.033997 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:42.033968 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-789f988849-mdzqv_45d1f165-6a93-4cc0-9f04-ebe6cb5b5171/manager/0.log" Jun 12 19:57:43.772922 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:43.772894 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-vjhjw_0d37a630-12a3-4202-9f14-632c80b9eb8f/manager/0.log" Jun 12 19:57:43.886433 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:43.886401 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vrk6s_73014c53-b67a-440f-8fa1-eea76bf443d3/kuadrant-console-plugin/0.log" Jun 12 19:57:44.361805 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:44.361777 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-q42p2_c405af12-d0b7-4ec1-90fc-853bdeb046f6/manager/0.log" Jun 12 19:57:44.921071 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:44.921039 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b5796c76f-hghxr_c4391dd6-b95f-430d-a93b-80432f60bc00/kube-auth-proxy/0.log" Jun 12 19:57:45.381937 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:45.381910 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wg66p_b7529688-0301-4d63-b400-c7be09253ea9/payload-processing/0.log" Jun 12 19:57:45.953048 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:45.953018 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-ghsgq_4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38/storage-initializer/0.log" Jun 12 19:57:45.963018 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:45.962995 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-ghsgq_4f216119-9d4f-4ad7-88e2-5d1e5f5e5c38/main/0.log" Jun 12 19:57:46.436897 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:46.436868 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-mfb76_68186597-ac47-4c72-bc10-1838e8c6837d/storage-initializer/0.log" Jun 12 19:57:46.444955 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:46.444934 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-mfb76_68186597-ac47-4c72-bc10-1838e8c6837d/main/0.log" Jun 12 19:57:53.813445 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:53.813415 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j8228_41a1faa1-36af-4860-ad2c-d355620f8ec0/global-pull-secret-syncer/0.log" Jun 12 19:57:53.900691 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:53.900634 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vkjc9_d2813bc5-36e5-4b5e-a3b4-19aeafb3f656/konnectivity-agent/0.log" Jun 12 19:57:54.013477 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:54.013450 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-76.ec2.internal_7214cad85fb5cf585612f0e29bb8de97/haproxy/0.log" Jun 12 19:57:59.059224 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:59.059187 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-vjhjw_0d37a630-12a3-4202-9f14-632c80b9eb8f/manager/0.log" Jun 12 19:57:59.088150 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:59.088127 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vrk6s_73014c53-b67a-440f-8fa1-eea76bf443d3/kuadrant-console-plugin/0.log" Jun 12 19:57:59.323227 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:57:59.323151 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-q42p2_c405af12-d0b7-4ec1-90fc-853bdeb046f6/manager/0.log" Jun 12 19:58:00.980905 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:00.980877 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_68f8dbdf-4641-40a6-bf81-595089bb7f49/alertmanager/0.log" Jun 12 19:58:01.009729 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.009706 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_68f8dbdf-4641-40a6-bf81-595089bb7f49/config-reloader/0.log" Jun 12 19:58:01.035421 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.035354 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_68f8dbdf-4641-40a6-bf81-595089bb7f49/kube-rbac-proxy-web/0.log" Jun 12 19:58:01.061505 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.061478 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_68f8dbdf-4641-40a6-bf81-595089bb7f49/kube-rbac-proxy/0.log" Jun 12 19:58:01.086790 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.086761 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_68f8dbdf-4641-40a6-bf81-595089bb7f49/kube-rbac-proxy-metric/0.log" Jun 12 19:58:01.112545 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.112523 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_68f8dbdf-4641-40a6-bf81-595089bb7f49/prom-label-proxy/0.log" Jun 12 19:58:01.138808 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.138784 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_68f8dbdf-4641-40a6-bf81-595089bb7f49/init-config-reloader/0.log" Jun 12 19:58:01.224916 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.224888 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-5gwnt_f1ee4965-f678-4bad-9a72-dfb5dce76731/kube-state-metrics/0.log" Jun 12 19:58:01.247550 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.247521 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-5gwnt_f1ee4965-f678-4bad-9a72-dfb5dce76731/kube-rbac-proxy-main/0.log" Jun 12 19:58:01.273717 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.273690 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-5gwnt_f1ee4965-f678-4bad-9a72-dfb5dce76731/kube-rbac-proxy-self/0.log" Jun 12 19:58:01.305116 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.305032 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7bff96ccb-r6bg4_ff9bab00-1b0e-4299-be03-8ec64317cccd/metrics-server/0.log" Jun 12 19:58:01.340929 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.340904 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-qqb6s_414aedc3-d438-4187-ade2-06def9a8597f/monitoring-plugin/0.log" Jun 12 19:58:01.374038 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.374009 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hbg7b_ca6b05a0-5a22-48f1-be2d-2d12f476b21e/node-exporter/0.log" Jun 12 19:58:01.399133 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.399112 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hbg7b_ca6b05a0-5a22-48f1-be2d-2d12f476b21e/kube-rbac-proxy/0.log" Jun 12 19:58:01.426022 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.426000 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hbg7b_ca6b05a0-5a22-48f1-be2d-2d12f476b21e/init-textfile/0.log" Jun 12 19:58:01.715044 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.714964 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c/prometheus/0.log" Jun 12 19:58:01.738766 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.738742 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c/config-reloader/0.log" Jun 12 19:58:01.766218 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.766190 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c/thanos-sidecar/0.log" Jun 12 19:58:01.796120 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.796096 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c/kube-rbac-proxy-web/0.log" Jun 12 19:58:01.820854 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.820824 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c/kube-rbac-proxy/0.log" Jun 12 19:58:01.845988 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.845961 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c/kube-rbac-proxy-thanos/0.log" Jun 12 19:58:01.875627 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.875576 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f0e7088b-5cbb-4ff2-b9c1-7de3aa54b76c/init-config-reloader/0.log" Jun 12 19:58:01.917788 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.917760 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-ldnxj_711103d7-2a43-4136-a2a4-72faec23720f/prometheus-operator/0.log" Jun 12 19:58:01.940384 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.940356 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-ldnxj_711103d7-2a43-4136-a2a4-72faec23720f/kube-rbac-proxy/0.log" Jun 12 19:58:01.990644 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:01.990597 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-6ggb8_26fa8283-905c-4337-80e8-24beea30be83/prometheus-operator-admission-webhook/0.log" Jun 12 19:58:02.146158 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:02.146128 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58f5cb5c88-nx2rp_30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce/thanos-query/0.log" Jun 12 19:58:02.172566 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:02.172533 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58f5cb5c88-nx2rp_30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce/kube-rbac-proxy-web/0.log" Jun 12 19:58:02.207491 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:02.207458 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58f5cb5c88-nx2rp_30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce/kube-rbac-proxy/0.log" Jun 12 19:58:02.240526 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:02.240497 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58f5cb5c88-nx2rp_30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce/prom-label-proxy/0.log" Jun 12 19:58:02.274988 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:02.274910 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58f5cb5c88-nx2rp_30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce/kube-rbac-proxy-rules/0.log" Jun 12 19:58:02.304120 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:02.304092 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58f5cb5c88-nx2rp_30bcb6cc-2daf-4e8a-86e6-ec5cce1b31ce/kube-rbac-proxy-metrics/0.log" Jun 12 19:58:05.108486 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.108455 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-sn4jn_a3a121e0-b8e7-4f72-98f0-d40f786dc27a/download-server/0.log" Jun 12 19:58:05.451307 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.451092 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p"] Jun 12 19:58:05.454844 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.454823 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" Jun 12 19:58:05.457248 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.457228 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7nt9m\"/\"openshift-service-ca.crt\"" Jun 12 19:58:05.457358 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.457320 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7nt9m\"/\"default-dockercfg-q9h6h\"" Jun 12 19:58:05.458353 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.458339 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7nt9m\"/\"kube-root-ca.crt\"" Jun 12 19:58:05.465220 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.465200 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p"] Jun 12 19:58:05.564856 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.564821 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a491bcb-8114-431c-addc-adc8c4876e3d-podres\") pod \"perf-node-gather-daemonset-w488p\" (UID: \"6a491bcb-8114-431c-addc-adc8c4876e3d\") " pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" Jun 12 19:58:05.565037 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.564875 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a491bcb-8114-431c-addc-adc8c4876e3d-lib-modules\") pod \"perf-node-gather-daemonset-w488p\" (UID: \"6a491bcb-8114-431c-addc-adc8c4876e3d\") " pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" Jun 12 19:58:05.565037 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.564922 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a491bcb-8114-431c-addc-adc8c4876e3d-proc\") pod \"perf-node-gather-daemonset-w488p\" (UID: \"6a491bcb-8114-431c-addc-adc8c4876e3d\") " pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" Jun 12 19:58:05.565037 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.564943 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a491bcb-8114-431c-addc-adc8c4876e3d-sys\") pod \"perf-node-gather-daemonset-w488p\" (UID: \"6a491bcb-8114-431c-addc-adc8c4876e3d\") " pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" Jun 12 19:58:05.565037 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.564970 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h67f\" (UniqueName: \"kubernetes.io/projected/6a491bcb-8114-431c-addc-adc8c4876e3d-kube-api-access-9h67f\") pod \"perf-node-gather-daemonset-w488p\" (UID: \"6a491bcb-8114-431c-addc-adc8c4876e3d\") " pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" Jun 12 19:58:05.665757 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.665726 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a491bcb-8114-431c-addc-adc8c4876e3d-lib-modules\") pod \"perf-node-gather-daemonset-w488p\" (UID: \"6a491bcb-8114-431c-addc-adc8c4876e3d\") " pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" Jun 12 19:58:05.665757 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.665762 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a491bcb-8114-431c-addc-adc8c4876e3d-proc\") pod \"perf-node-gather-daemonset-w488p\" (UID: \"6a491bcb-8114-431c-addc-adc8c4876e3d\") " pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" Jun 12 19:58:05.665994 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.665822 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a491bcb-8114-431c-addc-adc8c4876e3d-proc\") pod \"perf-node-gather-daemonset-w488p\" (UID: \"6a491bcb-8114-431c-addc-adc8c4876e3d\") " pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" Jun 12 19:58:05.665994 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.665836 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a491bcb-8114-431c-addc-adc8c4876e3d-sys\") pod \"perf-node-gather-daemonset-w488p\" (UID: \"6a491bcb-8114-431c-addc-adc8c4876e3d\") " pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" Jun 12 19:58:05.665994 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.665890 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a491bcb-8114-431c-addc-adc8c4876e3d-lib-modules\") pod \"perf-node-gather-daemonset-w488p\" (UID: \"6a491bcb-8114-431c-addc-adc8c4876e3d\") " pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" Jun 12 19:58:05.665994 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.665892 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h67f\" (UniqueName: \"kubernetes.io/projected/6a491bcb-8114-431c-addc-adc8c4876e3d-kube-api-access-9h67f\") pod \"perf-node-gather-daemonset-w488p\" (UID: \"6a491bcb-8114-431c-addc-adc8c4876e3d\") " pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" Jun 12 19:58:05.665994 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.665932 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a491bcb-8114-431c-addc-adc8c4876e3d-sys\") pod \"perf-node-gather-daemonset-w488p\" (UID: \"6a491bcb-8114-431c-addc-adc8c4876e3d\") " pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" Jun 12 19:58:05.665994 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.665991 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a491bcb-8114-431c-addc-adc8c4876e3d-podres\") pod \"perf-node-gather-daemonset-w488p\" (UID: \"6a491bcb-8114-431c-addc-adc8c4876e3d\") " pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" Jun 12 19:58:05.666209 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.666098 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a491bcb-8114-431c-addc-adc8c4876e3d-podres\") pod \"perf-node-gather-daemonset-w488p\" (UID: \"6a491bcb-8114-431c-addc-adc8c4876e3d\") " pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" Jun 12 19:58:05.674903 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.674883 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h67f\" (UniqueName: \"kubernetes.io/projected/6a491bcb-8114-431c-addc-adc8c4876e3d-kube-api-access-9h67f\") pod \"perf-node-gather-daemonset-w488p\" (UID: \"6a491bcb-8114-431c-addc-adc8c4876e3d\") " pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" Jun 12 19:58:05.766046 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.766020 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" Jun 12 19:58:05.901400 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:05.901374 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p"] Jun 12 19:58:05.903309 ip-10-0-135-76 kubenswrapper[2558]: W0612 19:58:05.903278 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6a491bcb_8114_431c_addc_adc8c4876e3d.slice/crio-c56e8a496c72dc5775acfee6fbc10e29ab93dba141a3d532c28221613527adc2 WatchSource:0}: Error finding container c56e8a496c72dc5775acfee6fbc10e29ab93dba141a3d532c28221613527adc2: Status 404 returned error can't find the container with id c56e8a496c72dc5775acfee6fbc10e29ab93dba141a3d532c28221613527adc2 Jun 12 19:58:06.380624 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:06.380521 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" event={"ID":"6a491bcb-8114-431c-addc-adc8c4876e3d","Type":"ContainerStarted","Data":"298e1e48cb4e5f69b689f4695d58dbf6cfe5b8164375e92a3c0bd8f7975a4d0b"} Jun 12 19:58:06.380982 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:06.380641 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" event={"ID":"6a491bcb-8114-431c-addc-adc8c4876e3d","Type":"ContainerStarted","Data":"c56e8a496c72dc5775acfee6fbc10e29ab93dba141a3d532c28221613527adc2"} Jun 12 19:58:06.380982 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:06.380672 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" Jun 12 19:58:06.396458 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:06.396405 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" podStartSLOduration=1.39638715 podStartE2EDuration="1.39638715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:58:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:58:06.396143152 +0000 UTC m=+2137.056835112" watchObservedRunningTime="2026-06-12 19:58:06.39638715 +0000 UTC m=+2137.057079301" Jun 12 19:58:07.091133 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:07.091107 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6q46h_7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c/dns/0.log" Jun 12 19:58:07.116524 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:07.116500 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6q46h_7cd2e7d7-64e1-4c2f-9ca8-a956a8ed9e8c/kube-rbac-proxy/0.log" Jun 12 19:58:07.319657 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:07.319632 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xfm4h_330b534e-744d-45f2-9c04-255693d72982/dns-node-resolver/0.log" Jun 12 19:58:07.887888 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:07.887860 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-789b778c76-rx8vs_0006ddb5-24bf-4f95-a28b-c2b706d0e440/registry/0.log" Jun 12 19:58:07.964792 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:07.964763 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kvspx_3d5ca329-7e77-4d1a-9066-4f2e999eed4f/node-ca/0.log" Jun 12 19:58:09.069078 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:09.069038 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b5796c76f-hghxr_c4391dd6-b95f-430d-a93b-80432f60bc00/kube-auth-proxy/0.log" Jun 12 19:58:09.282229 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:09.282200 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wg66p_b7529688-0301-4d63-b400-c7be09253ea9/payload-processing/0.log" Jun 12 19:58:09.968510 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:09.968476 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7hjk5_5c4a6d5d-705b-47a0-8baa-8055c7214270/serve-healthcheck-canary/0.log" Jun 12 19:58:10.732462 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:10.732433 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xcz4h_89059048-04a1-41d4-b539-5bff3d33fcc0/kube-rbac-proxy/0.log" Jun 12 19:58:10.756265 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:10.756236 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xcz4h_89059048-04a1-41d4-b539-5bff3d33fcc0/exporter/0.log" Jun 12 19:58:10.779124 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:10.779100 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xcz4h_89059048-04a1-41d4-b539-5bff3d33fcc0/extractor/0.log" Jun 12 19:58:12.396697 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:12.396668 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7nt9m/perf-node-gather-daemonset-w488p" Jun 12 19:58:13.193122 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:13.193089 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5c6fc6cd84-sznk5_92ab8ce4-2056-4e8d-8ae5-55d23e2973b0/maas-api/0.log" Jun 12 19:58:13.282810 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:13.282784 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5ccbb9675b-7m9s8_1d85c754-de64-40d7-8089-89ea323cc18e/manager/0.log" Jun 12 19:58:13.509177 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:13.509147 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-789f988849-mdzqv_45d1f165-6a93-4cc0-9f04-ebe6cb5b5171/manager/0.log" Jun 12 19:58:13.527809 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:13.527787 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-789f988849-mdzqv_45d1f165-6a93-4cc0-9f04-ebe6cb5b5171/copy-manifests/0.log" Jun 12 19:58:15.494900 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:15.494876 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-796f4f9d48-v4hbp_94d084ea-6afc-4d76-931f-0b962f537b7a/manager/0.log" Jun 12 19:58:20.269508 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:20.269477 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b5796c76f-hghxr_c4391dd6-b95f-430d-a93b-80432f60bc00/kube-auth-proxy/0.log" Jun 12 19:58:20.439090 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:20.439052 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wg66p_b7529688-0301-4d63-b400-c7be09253ea9/payload-processing/0.log" Jun 12 19:58:21.699302 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:21.699279 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b5796c76f-hghxr_c4391dd6-b95f-430d-a93b-80432f60bc00/kube-auth-proxy/0.log" Jun 12 19:58:21.879958 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:21.879927 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wg66p_b7529688-0301-4d63-b400-c7be09253ea9/payload-processing/0.log" Jun 12 19:58:22.740383 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:22.740354 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4wt2m_5f3c2d7b-2199-4bfe-b371-9c278e9c4e71/kube-multus/0.log" Jun 12 19:58:23.289409 ip-10-0-135-76 kubenswrapper[2558]: I0612 19:58:23.289380 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wdl8m_2a3407af-1617-4eaf-b76b-cee74b3ef99d/kube-multus-additional-cni-plugins/0.log"