Jun 09 14:47:57.637305 ip-10-0-135-90 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 14:47:57.637320 ip-10-0-135-90 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 14:47:57.637329 ip-10-0-135-90 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 14:47:57.637543 ip-10-0-135-90 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 14:48:07.785653 ip-10-0-135-90 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 14:48:07.785672 ip-10-0-135-90 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 915c26fb5d154920a6816b2e7b3dd66a -- Jun 09 14:50:51.729785 ip-10-0-135-90 systemd[1]: Starting Kubernetes Kubelet... Jun 09 14:50:52.163562 ip-10-0-135-90 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 14:50:52.163562 ip-10-0-135-90 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 14:50:52.163562 ip-10-0-135-90 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 14:50:52.163562 ip-10-0-135-90 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 14:50:52.163562 ip-10-0-135-90 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 14:50:52.165596 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.165510 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 14:50:52.169206 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169190 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:50:52.169206 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169206 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:50:52.169269 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169210 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:50:52.169269 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169213 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:50:52.169269 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169217 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:50:52.169269 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169220 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:50:52.169269 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169223 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:50:52.169269 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169226 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:50:52.169269 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169229 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:50:52.169269 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169232 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:50:52.169269 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169234 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:50:52.169269 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169237 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:50:52.169269 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169240 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:50:52.169269 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169243 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:50:52.169269 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169248 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:50:52.169269 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169251 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:50:52.169269 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169254 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:50:52.169269 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169257 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:50:52.169269 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169260 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:50:52.169269 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169263 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:50:52.169269 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169266 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:50:52.169747 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169268 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:50:52.169747 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169271 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:50:52.169747 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169274 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:50:52.169747 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169277 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:50:52.169747 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169280 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:50:52.169747 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169282 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:50:52.169747 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169285 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:50:52.169747 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169287 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:50:52.169747 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169290 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:50:52.169747 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169292 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:50:52.169747 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169295 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:50:52.169747 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169297 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:50:52.169747 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169300 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:50:52.169747 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169302 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:50:52.169747 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169305 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:50:52.169747 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169307 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:50:52.169747 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169310 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:50:52.169747 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169312 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:50:52.169747 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169315 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:50:52.169747 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169317 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:50:52.170260 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169320 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:50:52.170260 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169323 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:50:52.170260 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169325 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:50:52.170260 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169327 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:50:52.170260 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169330 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:50:52.170260 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169333 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:50:52.170260 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169335 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:50:52.170260 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169337 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:50:52.170260 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169340 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:50:52.170260 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169344 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:50:52.170260 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169348 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:50:52.170260 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169350 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:50:52.170260 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169353 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:50:52.170260 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169356 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:50:52.170260 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169359 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:50:52.170260 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169361 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:50:52.170260 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169365 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:50:52.170260 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169367 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:50:52.170260 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169370 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:50:52.170824 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169372 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:50:52.170824 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169374 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:50:52.170824 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169377 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:50:52.170824 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169379 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:50:52.170824 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169382 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:50:52.170824 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169384 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:50:52.170824 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169387 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:50:52.170824 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169389 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:50:52.170824 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169391 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:50:52.170824 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169394 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:50:52.170824 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169396 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:50:52.170824 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169399 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:50:52.170824 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169402 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:50:52.170824 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169404 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:50:52.170824 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169407 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:50:52.170824 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169409 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:50:52.170824 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169412 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:50:52.170824 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169415 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:50:52.170824 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169417 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:50:52.170824 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169419 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:50:52.171304 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169422 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:50:52.171304 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169424 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:50:52.171304 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169428 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:50:52.171304 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169430 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:50:52.171304 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169433 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:50:52.171304 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169435 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:50:52.171304 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169438 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:50:52.171304 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169441 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:50:52.171304 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169454 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:50:52.171304 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169457 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:50:52.171304 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169460 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:50:52.171304 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169463 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:50:52.171304 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169466 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:50:52.171304 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169480 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:50:52.171304 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169483 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:50:52.171304 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169486 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:50:52.171304 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169488 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:50:52.171304 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169493 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:50:52.171304 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.169497 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:50:52.171304 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170212 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:50:52.171813 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170220 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:50:52.171813 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170223 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:50:52.171813 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170226 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:50:52.171813 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170229 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:50:52.171813 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170233 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:50:52.171813 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170236 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:50:52.171813 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170239 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:50:52.171813 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170241 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:50:52.171813 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170244 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:50:52.171813 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170246 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:50:52.171813 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170250 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:50:52.171813 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170253 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:50:52.171813 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170255 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:50:52.171813 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170258 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:50:52.171813 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170260 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:50:52.171813 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170263 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:50:52.171813 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170266 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:50:52.171813 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170268 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:50:52.171813 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170272 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:50:52.171813 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170274 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:50:52.172345 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170277 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:50:52.172345 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170280 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:50:52.172345 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170282 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:50:52.172345 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170285 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:50:52.172345 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170287 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:50:52.172345 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170290 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:50:52.172345 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170292 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:50:52.172345 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170295 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:50:52.172345 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170297 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:50:52.172345 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170300 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:50:52.172345 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170302 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:50:52.172345 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170305 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:50:52.172345 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170307 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:50:52.172345 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170310 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:50:52.172345 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170312 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:50:52.172345 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170314 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:50:52.172345 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170317 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:50:52.172345 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170320 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:50:52.172345 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170322 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:50:52.172345 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170325 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:50:52.172859 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170327 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:50:52.172859 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170330 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:50:52.172859 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170333 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:50:52.172859 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170335 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:50:52.172859 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170338 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:50:52.172859 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170341 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:50:52.172859 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170343 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:50:52.172859 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170345 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:50:52.172859 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170348 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:50:52.172859 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170351 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:50:52.172859 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170354 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:50:52.172859 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170356 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:50:52.172859 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170359 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:50:52.172859 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170362 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:50:52.172859 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170365 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:50:52.172859 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170367 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:50:52.172859 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170370 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:50:52.172859 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170372 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:50:52.172859 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170375 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:50:52.172859 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170378 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:50:52.173348 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170380 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:50:52.173348 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170382 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:50:52.173348 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170385 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:50:52.173348 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170387 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:50:52.173348 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170390 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:50:52.173348 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170392 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:50:52.173348 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170395 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:50:52.173348 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170397 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:50:52.173348 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170399 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:50:52.173348 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170402 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:50:52.173348 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170407 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:50:52.173348 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170411 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:50:52.173348 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170414 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:50:52.173348 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170417 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:50:52.173348 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170420 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:50:52.173348 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170423 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:50:52.173348 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170425 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:50:52.173348 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170428 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:50:52.173348 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170430 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:50:52.173826 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170433 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:50:52.173826 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170438 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:50:52.173826 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170441 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:50:52.173826 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170445 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:50:52.173826 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170448 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:50:52.173826 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170451 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:50:52.173826 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170454 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:50:52.173826 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170457 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:50:52.173826 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170460 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:50:52.173826 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170463 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:50:52.173826 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170466 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:50:52.173826 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170486 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:50:52.173826 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170490 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:50:52.173826 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170494 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:50:52.173826 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170497 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:50:52.173826 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170499 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:50:52.173826 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170502 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:50:52.173826 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170505 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:50:52.173826 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170507 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:50:52.174298 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170978 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:50:52.174298 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170985 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:50:52.174298 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170989 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:50:52.174298 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170993 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:50:52.174298 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.170997 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:50:52.174298 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171000 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:50:52.174298 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171002 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:50:52.174298 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171005 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:50:52.174298 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171008 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:50:52.174298 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171011 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:50:52.174298 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171013 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:50:52.174298 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171016 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:50:52.174298 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171018 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:50:52.174298 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171021 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:50:52.174298 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171024 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:50:52.174298 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171026 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:50:52.174298 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171029 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:50:52.174298 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171031 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:50:52.174298 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171034 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:50:52.174298 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171037 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:50:52.174800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171039 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:50:52.174800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171043 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:50:52.174800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171046 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:50:52.174800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171049 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:50:52.174800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171052 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:50:52.174800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171054 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:50:52.174800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171057 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:50:52.174800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171060 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:50:52.174800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171062 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:50:52.174800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171065 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:50:52.174800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171068 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:50:52.174800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171071 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:50:52.174800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171073 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:50:52.174800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171075 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:50:52.174800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171079 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:50:52.174800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171081 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:50:52.174800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171084 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:50:52.174800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171087 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:50:52.174800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171089 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:50:52.175259 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171094 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:50:52.175259 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171097 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:50:52.175259 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171100 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:50:52.175259 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171102 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:50:52.175259 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171104 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:50:52.175259 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171107 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:50:52.175259 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171110 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:50:52.175259 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171112 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:50:52.175259 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171115 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:50:52.175259 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171117 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:50:52.175259 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171120 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:50:52.175259 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171122 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:50:52.175259 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171125 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:50:52.175259 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171127 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:50:52.175259 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171130 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:50:52.175259 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171132 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:50:52.175259 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171135 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:50:52.175259 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171138 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:50:52.175259 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171140 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:50:52.175259 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171143 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:50:52.175795 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171145 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:50:52.175795 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171147 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:50:52.175795 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171151 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:50:52.175795 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171154 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:50:52.175795 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171157 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:50:52.175795 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171160 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:50:52.175795 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171162 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:50:52.175795 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171165 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:50:52.175795 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171167 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:50:52.175795 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171169 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:50:52.175795 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171172 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:50:52.175795 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171175 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:50:52.175795 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171180 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:50:52.175795 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171182 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:50:52.175795 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171185 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:50:52.175795 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171187 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:50:52.175795 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171190 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:50:52.175795 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171192 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:50:52.175795 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171195 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:50:52.176289 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171197 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:50:52.176289 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171200 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:50:52.176289 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171202 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:50:52.176289 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171205 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:50:52.176289 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171207 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:50:52.176289 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171209 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:50:52.176289 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171212 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:50:52.176289 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171214 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:50:52.176289 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171216 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:50:52.176289 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171219 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:50:52.176289 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171221 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:50:52.176289 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171224 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:50:52.176289 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171226 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:50:52.176289 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171228 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:50:52.176289 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171231 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:50:52.176289 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171233 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:50:52.176289 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171235 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:50:52.176289 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171238 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:50:52.176289 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171240 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:50:52.176289 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171243 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171245 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171314 2578 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171323 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171332 2578 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171339 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171348 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171353 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171359 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171363 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171366 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171370 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171374 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171377 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171380 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171383 2578 flags.go:64] FLAG: --cgroup-root="" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171386 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171389 2578 flags.go:64] FLAG: --client-ca-file="" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171392 2578 flags.go:64] FLAG: --cloud-provider="external" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171395 2578 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171400 2578 flags.go:64] FLAG: --cluster-domain="" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171403 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171406 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171409 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 14:50:52.176784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171412 2578 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171416 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171419 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171422 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171425 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171428 2578 flags.go:64] FLAG: --contention-profiling="false" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171431 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171433 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171436 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171439 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171443 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171449 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171452 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171455 2578 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171458 2578 flags.go:64] FLAG: --enable-server="true" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171461 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171465 2578 flags.go:64] FLAG: --event-burst="100" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171481 2578 flags.go:64] FLAG: --event-qps="50" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171484 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171487 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171490 2578 flags.go:64] FLAG: --eviction-hard="" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171494 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171497 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171500 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171503 2578 flags.go:64] FLAG: --eviction-soft="" Jun 09 14:50:52.177371 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171505 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171508 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171511 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171514 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171517 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171520 2578 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171522 2578 flags.go:64] FLAG: --feature-gates="" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171526 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171529 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171532 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171535 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171538 2578 flags.go:64] FLAG: --healthz-port="10248" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171541 2578 flags.go:64] FLAG: --help="false" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171544 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-135-90.ec2.internal" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171547 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171550 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171552 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171556 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171561 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171564 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171566 2578 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171569 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171572 2578 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 14:50:52.177971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171576 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171579 2578 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171582 2578 flags.go:64] FLAG: --kube-reserved="" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171585 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171587 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171590 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171593 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171595 2578 flags.go:64] FLAG: --lock-file="" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171598 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171601 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171604 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171609 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171612 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171615 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171617 2578 flags.go:64] FLAG: --logging-format="text" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171620 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171623 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171626 2578 flags.go:64] FLAG: --manifest-url="" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171629 2578 flags.go:64] FLAG: --manifest-url-header="" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171633 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171635 2578 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171639 2578 flags.go:64] FLAG: --max-pods="110" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171643 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171645 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171648 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 14:50:52.178585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171651 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171654 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171658 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171661 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171671 2578 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171674 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171677 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171679 2578 flags.go:64] FLAG: --pod-cidr="" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171683 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171688 2578 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171691 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171694 2578 flags.go:64] FLAG: --pods-per-core="0" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171697 2578 flags.go:64] FLAG: --port="10250" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171700 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171703 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09b4c0663ed76fa26" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171706 2578 flags.go:64] FLAG: --qos-reserved="" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171708 2578 flags.go:64] FLAG: --read-only-port="10255" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171711 2578 flags.go:64] FLAG: --register-node="true" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171714 2578 flags.go:64] FLAG: --register-with-taints="" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171718 2578 flags.go:64] FLAG: --registry-burst="10" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171721 2578 flags.go:64] FLAG: --registry-qps="5" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171723 2578 flags.go:64] FLAG: --reserved-cpus="" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171726 2578 flags.go:64] FLAG: --reserved-memory="" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171729 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171732 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 14:50:52.179188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171735 2578 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171738 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171740 2578 flags.go:64] FLAG: --runonce="false" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171743 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171748 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171750 2578 flags.go:64] FLAG: --seccomp-default="false" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171753 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171756 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171759 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171762 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171767 2578 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171770 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171772 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171775 2578 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171778 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171781 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171784 2578 flags.go:64] FLAG: --system-cgroups="" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171787 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171792 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171795 2578 flags.go:64] FLAG: --tls-cert-file="" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171798 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171802 2578 flags.go:64] FLAG: --tls-min-version="" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171805 2578 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171808 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171810 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 14:50:52.179843 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171813 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171816 2578 flags.go:64] FLAG: --v="2" Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171820 2578 flags.go:64] FLAG: --version="false" Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171824 2578 flags.go:64] FLAG: --vmodule="" Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171828 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.171831 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171980 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171984 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171988 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171991 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171993 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.171998 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172000 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172003 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172005 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172008 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172010 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172014 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172017 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172019 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172022 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:50:52.180465 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172024 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:50:52.180990 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172027 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:50:52.180990 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172029 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:50:52.180990 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172032 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:50:52.180990 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172035 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:50:52.180990 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172037 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:50:52.180990 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172040 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:50:52.180990 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172042 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:50:52.180990 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172044 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:50:52.180990 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172047 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:50:52.180990 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172049 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:50:52.180990 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172052 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:50:52.180990 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172055 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:50:52.180990 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172057 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:50:52.180990 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172060 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:50:52.180990 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172063 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:50:52.180990 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172065 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:50:52.180990 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172067 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:50:52.180990 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172070 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:50:52.180990 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172073 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:50:52.180990 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172075 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:50:52.181487 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172078 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:50:52.181487 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172082 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:50:52.181487 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172085 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:50:52.181487 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172088 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:50:52.181487 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172092 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:50:52.181487 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172095 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:50:52.181487 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172098 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:50:52.181487 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172102 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:50:52.181487 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172105 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:50:52.181487 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172108 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:50:52.181487 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172110 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:50:52.181487 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172113 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:50:52.181487 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172115 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:50:52.181487 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172117 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:50:52.181487 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172120 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:50:52.181487 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172123 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:50:52.181487 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172126 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:50:52.181487 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172129 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:50:52.181487 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172131 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:50:52.181487 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172133 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:50:52.181978 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172137 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:50:52.181978 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172141 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:50:52.181978 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172143 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:50:52.181978 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172146 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:50:52.181978 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172149 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:50:52.181978 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172152 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:50:52.181978 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172154 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:50:52.181978 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172157 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:50:52.181978 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172159 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:50:52.181978 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172162 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:50:52.181978 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172164 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:50:52.181978 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172167 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:50:52.181978 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172169 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:50:52.181978 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172173 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:50:52.181978 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172177 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:50:52.181978 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172180 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:50:52.181978 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172182 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:50:52.181978 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172185 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:50:52.181978 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172187 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:50:52.182444 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172191 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:50:52.182444 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172194 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:50:52.182444 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172196 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:50:52.182444 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172199 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:50:52.182444 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172201 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:50:52.182444 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172204 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:50:52.182444 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172207 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:50:52.182444 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172209 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:50:52.182444 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172212 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:50:52.182444 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172215 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:50:52.182444 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172217 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:50:52.182444 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172220 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:50:52.182444 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172222 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:50:52.182444 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172224 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:50:52.182444 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172227 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:50:52.182444 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172229 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:50:52.182444 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172232 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:50:52.182444 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172235 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:50:52.182444 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172237 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:50:52.182444 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172240 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:50:52.182964 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172242 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:50:52.182964 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172245 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:50:52.182964 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172247 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:50:52.182964 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.172250 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:50:52.182964 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.172934 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 14:50:52.182964 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.179738 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 14:50:52.182964 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.179753 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 14:50:52.182964 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.179771 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 14:50:52.182964 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.179777 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 14:50:52.182964 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179834 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:50:52.182964 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179838 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:50:52.182964 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179842 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:50:52.182964 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179845 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:50:52.182964 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179848 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:50:52.183302 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179851 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:50:52.183302 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179854 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:50:52.183302 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179856 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:50:52.183302 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179859 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:50:52.183302 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179862 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:50:52.183302 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179865 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:50:52.183302 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179877 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:50:52.183302 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179881 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:50:52.183302 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179884 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:50:52.183302 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179887 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:50:52.183302 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179890 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:50:52.183302 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179892 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:50:52.183302 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179895 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:50:52.183302 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179898 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:50:52.183302 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179900 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:50:52.183302 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179903 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:50:52.183302 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179905 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:50:52.183302 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179908 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:50:52.183302 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179911 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:50:52.183302 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179913 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:50:52.183800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179916 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:50:52.183800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179918 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:50:52.183800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179921 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:50:52.183800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179923 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:50:52.183800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179928 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:50:52.183800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179931 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:50:52.183800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179934 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:50:52.183800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179938 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:50:52.183800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179942 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:50:52.183800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179945 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:50:52.183800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179947 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:50:52.183800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179950 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:50:52.183800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179952 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:50:52.183800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179955 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:50:52.183800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179957 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:50:52.183800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179960 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:50:52.183800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179962 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:50:52.183800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179965 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:50:52.183800 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179967 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:50:52.184264 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179971 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:50:52.184264 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179974 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:50:52.184264 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179977 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:50:52.184264 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179980 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:50:52.184264 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179983 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:50:52.184264 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179985 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:50:52.184264 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179988 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:50:52.184264 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179990 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:50:52.184264 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179993 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:50:52.184264 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179995 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:50:52.184264 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.179998 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:50:52.184264 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180000 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:50:52.184264 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180003 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:50:52.184264 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180005 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:50:52.184264 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180008 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:50:52.184264 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180010 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:50:52.184264 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180012 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:50:52.184264 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180015 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:50:52.184264 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180018 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:50:52.184264 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180021 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:50:52.184792 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180023 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:50:52.184792 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180026 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:50:52.184792 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180030 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:50:52.184792 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180033 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:50:52.184792 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180035 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:50:52.184792 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180038 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:50:52.184792 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180041 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:50:52.184792 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180043 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:50:52.184792 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180046 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:50:52.184792 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180048 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:50:52.184792 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180051 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:50:52.184792 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180053 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:50:52.184792 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180055 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:50:52.184792 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180058 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:50:52.184792 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180061 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:50:52.184792 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180063 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:50:52.184792 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180066 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:50:52.184792 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180068 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:50:52.184792 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180071 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:50:52.184792 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180073 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:50:52.185266 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180075 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:50:52.185266 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180078 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:50:52.185266 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180080 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:50:52.185266 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180083 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:50:52.185266 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180085 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:50:52.185266 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180088 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:50:52.185266 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180090 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:50:52.185266 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180092 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:50:52.185266 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180095 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:50:52.185266 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180098 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:50:52.185266 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180101 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:50:52.185266 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180104 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:50:52.185266 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180106 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:50:52.185266 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180109 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:50:52.185266 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180111 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:50:52.185658 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.180116 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 14:50:52.185658 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180225 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:50:52.185658 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180229 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:50:52.185658 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180232 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:50:52.185658 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180235 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:50:52.185658 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180238 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:50:52.185658 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180242 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:50:52.185658 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180245 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:50:52.185658 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180247 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:50:52.185658 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180250 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:50:52.185658 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180253 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:50:52.185658 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180255 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:50:52.185658 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180258 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:50:52.185658 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180260 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:50:52.185658 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180263 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:50:52.186032 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180265 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:50:52.186032 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180268 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:50:52.186032 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180270 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:50:52.186032 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180272 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:50:52.186032 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180275 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:50:52.186032 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180277 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:50:52.186032 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180280 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:50:52.186032 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180282 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:50:52.186032 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180284 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:50:52.186032 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180287 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:50:52.186032 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180289 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:50:52.186032 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180292 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:50:52.186032 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180295 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:50:52.186032 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180298 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:50:52.186032 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180300 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:50:52.186032 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180303 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:50:52.186032 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180306 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:50:52.186032 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180308 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:50:52.186032 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180311 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:50:52.186032 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180313 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:50:52.186512 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180316 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:50:52.186512 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180318 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:50:52.186512 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180320 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:50:52.186512 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180323 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:50:52.186512 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180325 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:50:52.186512 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180328 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:50:52.186512 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180330 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:50:52.186512 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180333 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:50:52.186512 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180335 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:50:52.186512 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180338 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:50:52.186512 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180340 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:50:52.186512 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180343 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:50:52.186512 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180345 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:50:52.186512 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180347 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:50:52.186512 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180350 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:50:52.186512 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180352 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:50:52.186512 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180354 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:50:52.186512 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180357 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:50:52.186512 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180359 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:50:52.186512 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180362 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:50:52.186991 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180364 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:50:52.186991 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180367 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:50:52.186991 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180369 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:50:52.186991 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180371 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:50:52.186991 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180374 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:50:52.186991 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180376 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:50:52.186991 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180379 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:50:52.186991 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180383 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:50:52.186991 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180387 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:50:52.186991 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180389 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:50:52.186991 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180392 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:50:52.186991 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180394 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:50:52.186991 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180397 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:50:52.186991 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180399 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:50:52.186991 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180401 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:50:52.186991 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180404 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:50:52.186991 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180407 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:50:52.186991 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180410 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:50:52.186991 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180413 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:50:52.187442 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180416 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:50:52.187442 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180418 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:50:52.187442 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180422 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:50:52.187442 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180425 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:50:52.187442 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180428 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:50:52.187442 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180431 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:50:52.187442 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180434 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:50:52.187442 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180436 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:50:52.187442 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180439 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:50:52.187442 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180442 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:50:52.187442 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180444 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:50:52.187442 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180447 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:50:52.187442 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180449 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:50:52.187442 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180452 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:50:52.187442 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180454 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:50:52.187442 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180456 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:50:52.187442 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180459 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:50:52.187442 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180461 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:50:52.187442 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180464 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:50:52.188027 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180466 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:50:52.188027 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180482 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:50:52.188027 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180485 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:50:52.188027 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180488 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:50:52.188027 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180491 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:50:52.188027 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180494 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:50:52.188027 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:52.180496 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:50:52.188027 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.180502 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 14:50:52.188027 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.180622 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 14:50:52.188027 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.182875 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 14:50:52.188027 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.184416 2578 server.go:1019] "Starting client certificate rotation" Jun 09 14:50:52.188027 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.184520 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 14:50:52.188027 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.184588 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 14:50:52.188339 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.187191 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 14:50:52.200872 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.200840 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 14:50:52.209105 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.209085 2578 log.go:25] "Validated CRI v1 runtime API" Jun 09 14:50:52.211692 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.211677 2578 log.go:25] "Validated CRI v1 image API" Jun 09 14:50:52.212618 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.212600 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 14:50:52.216155 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.216122 2578 fs.go:135] Filesystem UUIDs: map[30ef1c7f-388b-49d7-a0bc-23e086e1195b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f09b71cc-c3bd-4967-a2bf-51b7f3e2c585:/dev/nvme0n1p4] Jun 09 14:50:52.216155 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.216148 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 14:50:52.220769 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.220661 2578 manager.go:216] Machine: {Timestamp:2026-06-09 14:50:52.22011423 +0000 UTC m=+0.364695206 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104106 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d41298ebde6f3ebf3cbfc4b0220ea SystemUUID:ec2d4129-8ebd-e6f3-ebf3-cbfc4b0220ea BootID:915c26fb-5d15-4920-a681-6b2e7b3dd66a Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d5:e3:12:b2:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d5:e3:12:b2:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:c5:9a:8b:78:93 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 14:50:52.220769 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.220763 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 14:50:52.220881 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.220840 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 14:50:52.224193 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.224166 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 14:50:52.224343 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.224197 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-90.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 14:50:52.225090 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.225079 2578 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 14:50:52.225128 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.225094 2578 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 14:50:52.225128 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.225105 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 14:50:52.225729 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.225718 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 14:50:52.226650 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.226640 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 14:50:52.229436 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.229425 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 09 14:50:52.229749 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.229739 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 14:50:52.229787 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.229775 2578 kubelet.go:486] "Attempting to sync node with API server" Jun 09 14:50:52.229816 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.229788 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 14:50:52.229816 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.229803 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 14:50:52.229816 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.229814 2578 kubelet.go:398] "Adding apiserver pod source" Jun 09 14:50:52.229895 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.229822 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 14:50:52.230251 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.230239 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 14:50:52.230286 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.230267 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 14:50:52.236323 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.236299 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 14:50:52.236427 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.236352 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 14:50:52.238202 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.238182 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 14:50:52.238283 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.238224 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 14:50:52.239303 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.239288 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 14:50:52.239370 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.239313 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 14:50:52.239370 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.239323 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 14:50:52.239370 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.239333 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 14:50:52.239370 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.239346 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 14:50:52.239370 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.239355 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 14:50:52.239370 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.239367 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 14:50:52.239591 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.239375 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 14:50:52.239591 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.239385 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 14:50:52.239591 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.239394 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 14:50:52.239591 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.239414 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 14:50:52.239591 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.239425 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 14:50:52.240275 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.240262 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 14:50:52.240329 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.240279 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 14:50:52.243003 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.242983 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-90.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 14:50:52.243589 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:52.243554 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 14:50:52.243671 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.243650 2578 server.go:1268] "Started kubelet" Jun 09 14:50:52.243809 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.243779 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 14:50:52.243970 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.243948 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 14:50:52.248456 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.248430 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 14:50:52.248873 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:52.248458 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-90.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 14:50:52.249230 ip-10-0-135-90 systemd[1]: Started Kubernetes Kubelet. Jun 09 14:50:52.251673 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.251657 2578 server.go:310] "Adding debug handlers to kubelet server" Jun 09 14:50:52.253014 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.252997 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 14:50:52.257100 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:52.257083 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 14:50:52.257892 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:52.256486 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-90.ec2.internal.18b7713580093963 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-90.ec2.internal,UID:ip-10-0-135-90.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-90.ec2.internal,},FirstTimestamp:2026-06-09 14:50:52.243614051 +0000 UTC m=+0.388195028,LastTimestamp:2026-06-09 14:50:52.243614051 +0000 UTC m=+0.388195028,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-90.ec2.internal,}" Jun 09 14:50:52.258548 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.258528 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-57czs" Jun 09 14:50:52.258599 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.258558 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 14:50:52.258599 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.258580 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 14:50:52.258695 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:52.258642 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-90.ec2.internal\" not found" Jun 09 14:50:52.259404 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.259377 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 14:50:52.259523 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.259428 2578 factory.go:55] Registering systemd factory Jun 09 14:50:52.259523 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.259491 2578 factory.go:223] Registration of the systemd container factory successfully Jun 09 14:50:52.259523 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.259514 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 14:50:52.259655 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.259508 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 14:50:52.259655 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.259579 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 14:50:52.259724 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.259678 2578 reconstruct.go:97] "Volume reconstruction finished" Jun 09 14:50:52.259724 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.259687 2578 reconciler.go:29] "Reconciler: start to sync state" Jun 09 14:50:52.259815 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.259800 2578 factory.go:153] Registering CRI-O factory Jun 09 14:50:52.259856 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.259819 2578 factory.go:223] Registration of the crio container factory successfully Jun 09 14:50:52.259856 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.259838 2578 factory.go:103] Registering Raw factory Jun 09 14:50:52.259856 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.259855 2578 manager.go:1196] Started watching for new ooms in manager Jun 09 14:50:52.260296 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.260280 2578 manager.go:349] Starting recovery of all containers Jun 09 14:50:52.267269 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.267063 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-57czs" Jun 09 14:50:52.268928 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.268898 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 14:50:52.269561 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:52.269535 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 14:50:52.269659 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:52.269589 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-90.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 14:50:52.271513 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.271449 2578 manager.go:354] Recovery completed Jun 09 14:50:52.276668 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.276654 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:50:52.279852 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.279331 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:50:52.279852 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.279379 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:50:52.279852 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.279394 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:50:52.280786 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.280771 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 14:50:52.280786 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.280785 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 14:50:52.280932 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.280789 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:50:52.280932 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.280804 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 09 14:50:52.281564 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.281549 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:50:52.281638 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.281579 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:50:52.281638 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.281595 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:50:52.281901 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.281890 2578 policy_none.go:49] "None policy: Start" Jun 09 14:50:52.281932 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.281907 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 14:50:52.281932 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.281917 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 14:50:52.282926 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.282913 2578 policy_none.go:47] "Start" Jun 09 14:50:52.334340 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.321924 2578 manager.go:337] "Starting Device Plugin manager" Jun 09 14:50:52.334340 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:52.321959 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 14:50:52.334340 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.321972 2578 server.go:87] "Starting device plugin registration server" Jun 09 14:50:52.334340 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.322253 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 14:50:52.334340 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.322267 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 14:50:52.334340 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.322511 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 14:50:52.334340 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.322583 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 14:50:52.334340 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.322590 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 14:50:52.334340 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:52.323215 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 14:50:52.334340 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:52.323262 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-90.ec2.internal\" not found" Jun 09 14:50:52.334340 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.333271 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 14:50:52.334340 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.333307 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 14:50:52.334340 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.333327 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 14:50:52.334340 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:52.333366 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 14:50:52.335650 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.335626 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:50:52.422988 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.422906 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:50:52.424128 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.424111 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:50:52.424236 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.424147 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:50:52.424236 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.424162 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:50:52.424236 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.424191 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-90.ec2.internal" Jun 09 14:50:52.433088 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.433068 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-90.ec2.internal" Jun 09 14:50:52.433172 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:52.433090 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-90.ec2.internal\": node \"ip-10-0-135-90.ec2.internal\" not found" Jun 09 14:50:52.434003 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.433985 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal"] Jun 09 14:50:52.434068 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.434056 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:50:52.435652 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.435638 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:50:52.435736 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.435666 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:50:52.435736 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.435679 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:50:52.436947 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.436932 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:50:52.437056 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.437041 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal" Jun 09 14:50:52.437101 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.437082 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:50:52.437627 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.437603 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:50:52.437723 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.437634 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:50:52.437723 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.437648 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:50:52.437723 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.437671 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:50:52.437723 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.437689 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:50:52.437723 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.437698 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:50:52.438774 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.438761 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal" Jun 09 14:50:52.438857 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.438783 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:50:52.439603 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.439583 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:50:52.439683 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.439619 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:50:52.439683 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.439631 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:50:52.456057 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:52.456035 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-90.ec2.internal\" not found" Jun 09 14:50:52.464109 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:52.464087 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-90.ec2.internal\" not found" node="ip-10-0-135-90.ec2.internal" Jun 09 14:50:52.468624 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:52.468608 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-90.ec2.internal\" not found" node="ip-10-0-135-90.ec2.internal" Jun 09 14:50:52.557074 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:52.557038 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-90.ec2.internal\" not found" Jun 09 14:50:52.560398 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.560375 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/740af3cea14540774083e52efd550fa7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal\" (UID: \"740af3cea14540774083e52efd550fa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal" Jun 09 14:50:52.560502 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.560406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3188748c32a7f1992a074b4a4686f613-config\") pod \"kube-apiserver-proxy-ip-10-0-135-90.ec2.internal\" (UID: \"3188748c32a7f1992a074b4a4686f613\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal" Jun 09 14:50:52.560502 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.560427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/740af3cea14540774083e52efd550fa7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal\" (UID: \"740af3cea14540774083e52efd550fa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal" Jun 09 14:50:52.657544 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:52.657509 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-90.ec2.internal\" not found" Jun 09 14:50:52.660788 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.660759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/740af3cea14540774083e52efd550fa7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal\" (UID: \"740af3cea14540774083e52efd550fa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal" Jun 09 14:50:52.660918 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.660792 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/740af3cea14540774083e52efd550fa7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal\" (UID: \"740af3cea14540774083e52efd550fa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal" Jun 09 14:50:52.660918 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.660810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3188748c32a7f1992a074b4a4686f613-config\") pod \"kube-apiserver-proxy-ip-10-0-135-90.ec2.internal\" (UID: \"3188748c32a7f1992a074b4a4686f613\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal" Jun 09 14:50:52.660918 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.660862 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3188748c32a7f1992a074b4a4686f613-config\") pod \"kube-apiserver-proxy-ip-10-0-135-90.ec2.internal\" (UID: \"3188748c32a7f1992a074b4a4686f613\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal" Jun 09 14:50:52.660918 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.660874 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/740af3cea14540774083e52efd550fa7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal\" (UID: \"740af3cea14540774083e52efd550fa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal" Jun 09 14:50:52.660918 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.660862 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/740af3cea14540774083e52efd550fa7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal\" (UID: \"740af3cea14540774083e52efd550fa7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal" Jun 09 14:50:52.758305 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:52.758226 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-90.ec2.internal\" not found" Jun 09 14:50:52.768633 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.768612 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal" Jun 09 14:50:52.773126 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:52.773107 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal" Jun 09 14:50:52.858808 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:52.858774 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-90.ec2.internal\" not found" Jun 09 14:50:52.959257 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:52.959227 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-90.ec2.internal\" not found" Jun 09 14:50:53.059713 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:53.059633 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-90.ec2.internal\" not found" Jun 09 14:50:53.075785 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:53.075760 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:50:53.160488 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:53.160445 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-90.ec2.internal\" not found" Jun 09 14:50:53.184406 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:53.183749 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 14:50:53.184406 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:53.183927 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 14:50:53.184406 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:53.183971 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 14:50:53.236878 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:53.236853 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:50:53.259439 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:53.259416 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 14:50:53.259439 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:53.259433 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal" Jun 09 14:50:53.266010 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:53.265981 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod740af3cea14540774083e52efd550fa7.slice/crio-65d9ebed1c460686b4a40effc4c080824a3b2f9d0ce542d514bd83b8178cf1d2 WatchSource:0}: Error finding container 65d9ebed1c460686b4a40effc4c080824a3b2f9d0ce542d514bd83b8178cf1d2: Status 404 returned error can't find the container with id 65d9ebed1c460686b4a40effc4c080824a3b2f9d0ce542d514bd83b8178cf1d2 Jun 09 14:50:53.266577 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:53.266551 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3188748c32a7f1992a074b4a4686f613.slice/crio-218ad2a5338bd088003c7fe2c1ae9df0ceb4dfc65532cbf110c6f5daefd288bb WatchSource:0}: Error finding container 218ad2a5338bd088003c7fe2c1ae9df0ceb4dfc65532cbf110c6f5daefd288bb: Status 404 returned error can't find the container with id 218ad2a5338bd088003c7fe2c1ae9df0ceb4dfc65532cbf110c6f5daefd288bb Jun 09 14:50:53.270797 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:53.270738 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 14:45:52 +0000 UTC" deadline="2027-11-27 12:06:28.498883333 +0000 UTC" Jun 09 14:50:53.270797 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:53.270767 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12861h15m35.228120369s" Jun 09 14:50:53.272591 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:53.272508 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 14:50:53.272824 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:53.272809 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 14:50:53.274397 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:53.274374 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal" Jun 09 14:50:53.278852 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:53.278833 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 14:50:53.290195 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:53.290172 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 14:50:53.311883 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:53.311823 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x4nw8" Jun 09 14:50:53.318114 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:53.318089 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x4nw8" Jun 09 14:50:53.336934 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:53.336891 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal" event={"ID":"740af3cea14540774083e52efd550fa7","Type":"ContainerStarted","Data":"65d9ebed1c460686b4a40effc4c080824a3b2f9d0ce542d514bd83b8178cf1d2"} Jun 09 14:50:53.337890 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:53.337864 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal" event={"ID":"3188748c32a7f1992a074b4a4686f613","Type":"ContainerStarted","Data":"218ad2a5338bd088003c7fe2c1ae9df0ceb4dfc65532cbf110c6f5daefd288bb"} Jun 09 14:50:53.460524 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:53.460491 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:50:54.230826 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.230786 2578 apiserver.go:52] "Watching apiserver" Jun 09 14:50:54.241900 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.241870 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 14:50:54.242284 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.242255 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-npp6l","kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal","openshift-cluster-node-tuning-operator/tuned-q422g","openshift-image-registry/node-ca-cvjp4","openshift-ovn-kubernetes/ovnkube-node-nc4z6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp","openshift-dns/node-resolver-xmr49","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal","openshift-multus/multus-additional-cni-plugins-vbdtd","openshift-multus/multus-jbbj6","openshift-multus/network-metrics-daemon-6pz99","openshift-network-diagnostics/network-check-target-72v7w","openshift-network-operator/iptables-alerter-d7tm2","kube-system/global-pull-secret-syncer-zh67p"] Jun 09 14:50:54.243760 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.243738 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xmr49" Jun 09 14:50:54.244759 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.244737 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d7tm2" Jun 09 14:50:54.245758 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.245737 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.246885 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.246866 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cvjp4" Jun 09 14:50:54.247589 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.247567 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 14:50:54.247687 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.247568 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 14:50:54.248601 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.248580 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.248686 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.248627 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-szfwx\"" Jun 09 14:50:54.248686 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.248657 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 14:50:54.248939 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.248879 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 14:50:54.249011 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.248975 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 14:50:54.249412 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.249173 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 14:50:54.249412 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.249182 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 14:50:54.249412 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.249200 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vfdrt\"" Jun 09 14:50:54.249412 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.249187 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 14:50:54.249412 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.249309 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nh7w2\"" Jun 09 14:50:54.249761 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.249494 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 14:50:54.249999 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.249980 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.250152 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.250133 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vwdps\"" Jun 09 14:50:54.250248 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.250161 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 14:50:54.251598 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.251579 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.252810 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.252794 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-npp6l" Jun 09 14:50:54.253048 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.253029 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 14:50:54.253200 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.253185 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 14:50:54.253272 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.253230 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 14:50:54.253439 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.253402 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-j64fv\"" Jun 09 14:50:54.253439 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.253412 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 14:50:54.253630 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.253526 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 14:50:54.254079 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.254063 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:50:54.254161 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.254137 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 14:50:54.254256 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:54.254131 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zh67p" podUID="1198225a-bbaf-478c-ab60-f712653822aa" Jun 09 14:50:54.255369 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.255351 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.256721 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.256702 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:50:54.256827 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:54.256807 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pz99" podUID="e78820c0-87e6-4a86-a8b3-efbe056c96b7" Jun 09 14:50:54.256997 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.256979 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 14:50:54.257292 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.257277 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 14:50:54.257956 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.257937 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 14:50:54.258063 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.258017 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 14:50:54.258063 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.258042 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:50:54.258195 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.258044 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9sbmh\"" Jun 09 14:50:54.258195 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:54.258119 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72v7w" podUID="dea690ee-0ba8-44a4-a025-863f659225af" Jun 09 14:50:54.258529 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.258510 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 14:50:54.258529 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.258521 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-chnrh\"" Jun 09 14:50:54.259399 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.259272 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 14:50:54.259534 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.259409 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 14:50:54.259534 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.259503 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m2j9q\"" Jun 09 14:50:54.259706 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.259689 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 14:50:54.259936 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.259783 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 14:50:54.260631 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.260563 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 14:50:54.260904 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.260888 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 14:50:54.261323 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.261306 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mhnsn\"" Jun 09 14:50:54.261414 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.261352 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 14:50:54.269670 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.269648 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-host-run-netns\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.269811 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.269677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km24g\" (UniqueName: \"kubernetes.io/projected/a0b8851c-1232-44c1-bd3d-7755e87421ee-kube-api-access-km24g\") pod \"node-resolver-xmr49\" (UID: \"a0b8851c-1232-44c1-bd3d-7755e87421ee\") " pod="openshift-dns/node-resolver-xmr49" Jun 09 14:50:54.269811 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.269700 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-sys\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.269811 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.269741 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-var-lib-kubelet\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.269811 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.269772 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-var-lib-openvswitch\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.269811 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.269797 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-log-socket\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.270094 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.269819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-run-ovn-kubernetes\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.270094 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.269847 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e268956a-f645-4087-904f-ca378919cb9d-sys-fs\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.270094 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.269868 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-hostroot\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.270094 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.269891 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-sysconfig\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.270094 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.269920 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-systemd-units\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.270094 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.269943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-run-netns\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.270094 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.269997 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-cni-netd\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.270094 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-multus-socket-dir-parent\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.270094 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270044 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-host-var-lib-kubelet\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.270094 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270069 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-etc-kubernetes\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.270525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270109 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-node-log\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.270525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270139 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-ovn-node-metrics-cert\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.270525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270163 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwh6b\" (UniqueName: \"kubernetes.io/projected/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-kube-api-access-qwh6b\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.270525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270237 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-host-run-k8s-cni-cncf-io\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.270525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270299 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bc15d523-28ae-492f-b614-f82680cd7610-multus-daemon-config\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.270525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-host-run-multus-certs\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.270525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270353 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0b8851c-1232-44c1-bd3d-7755e87421ee-tmp-dir\") pod \"node-resolver-xmr49\" (UID: \"a0b8851c-1232-44c1-bd3d-7755e87421ee\") " pod="openshift-dns/node-resolver-xmr49" Jun 09 14:50:54.270525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270378 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-cni-binary-copy\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.270525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270402 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-kubelet\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.270525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-run-systemd\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.270525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270454 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-cni-bin\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.270525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270516 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e268956a-f645-4087-904f-ca378919cb9d-device-dir\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.270898 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270544 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gfjl\" (UniqueName: \"kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl\") pod \"network-check-target-72v7w\" (UID: \"dea690ee-0ba8-44a4-a025-863f659225af\") " pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:50:54.270898 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270568 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a0b8851c-1232-44c1-bd3d-7755e87421ee-hosts-file\") pod \"node-resolver-xmr49\" (UID: \"a0b8851c-1232-44c1-bd3d-7755e87421ee\") " pod="openshift-dns/node-resolver-xmr49" Jun 09 14:50:54.270898 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270607 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/95378364-27ce-4eb8-b854-5a2e69df7858-agent-certs\") pod \"konnectivity-agent-npp6l\" (UID: \"95378364-27ce-4eb8-b854-5a2e69df7858\") " pod="kube-system/konnectivity-agent-npp6l" Jun 09 14:50:54.270898 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-host-var-lib-cni-multus\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.270898 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-sysctl-conf\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.270898 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270700 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-systemd\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.270898 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270720 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-host\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.270898 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270743 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.270898 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270766 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-ovnkube-config\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.270898 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270790 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-env-overrides\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.270898 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270827 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e268956a-f645-4087-904f-ca378919cb9d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.270898 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270856 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-modprobe-d\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.270898 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270883 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.270898 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270900 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv86j\" (UniqueName: \"kubernetes.io/projected/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-kube-api-access-vv86j\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.271317 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270933 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-system-cni-dir\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.271317 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270968 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-multus-conf-dir\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.271317 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.270995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-lib-modules\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.271317 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271016 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55tx4\" (UniqueName: \"kubernetes.io/projected/be13e6d2-7f68-454e-a813-629c7bf920ae-kube-api-access-55tx4\") pod \"iptables-alerter-d7tm2\" (UID: \"be13e6d2-7f68-454e-a813-629c7bf920ae\") " pod="openshift-network-operator/iptables-alerter-d7tm2" Jun 09 14:50:54.271317 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e268956a-f645-4087-904f-ca378919cb9d-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.271317 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271056 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-multus-cni-dir\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.271317 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.271317 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271121 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1198225a-bbaf-478c-ab60-f712653822aa-dbus\") pod \"global-pull-secret-syncer-zh67p\" (UID: \"1198225a-bbaf-478c-ab60-f712653822aa\") " pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:50:54.271317 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271176 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs\") pod \"network-metrics-daemon-6pz99\" (UID: \"e78820c0-87e6-4a86-a8b3-efbe056c96b7\") " pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:50:54.271317 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271201 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-cnibin\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.271317 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271223 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-run-openvswitch\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.271317 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271240 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-ovnkube-script-lib\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.271317 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271260 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e268956a-f645-4087-904f-ca378919cb9d-socket-dir\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.271317 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271281 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk4gq\" (UniqueName: \"kubernetes.io/projected/e268956a-f645-4087-904f-ca378919cb9d-kube-api-access-pk4gq\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.271317 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271294 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc15d523-28ae-492f-b614-f82680cd7610-cni-binary-copy\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.271317 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271312 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-host-var-lib-cni-bin\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.271929 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271336 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8l4s\" (UniqueName: \"kubernetes.io/projected/e78820c0-87e6-4a86-a8b3-efbe056c96b7-kube-api-access-x8l4s\") pod \"network-metrics-daemon-6pz99\" (UID: \"e78820c0-87e6-4a86-a8b3-efbe056c96b7\") " pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:50:54.271929 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271350 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj92s\" (UniqueName: \"kubernetes.io/projected/fffccc4b-c1a2-44c9-b2e2-58939246915d-kube-api-access-kj92s\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.271929 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271364 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-kubernetes\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.271929 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271377 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-os-release\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.271929 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271391 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be13e6d2-7f68-454e-a813-629c7bf920ae-host-slash\") pod \"iptables-alerter-d7tm2\" (UID: \"be13e6d2-7f68-454e-a813-629c7bf920ae\") " pod="openshift-network-operator/iptables-alerter-d7tm2" Jun 09 14:50:54.271929 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271405 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-run-ovn\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.271929 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271418 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.271929 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271436 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-run\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.271929 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271454 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-tuned\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.271929 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271467 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fffccc4b-c1a2-44c9-b2e2-58939246915d-tmp\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.271929 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271505 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret\") pod \"global-pull-secret-syncer-zh67p\" (UID: \"1198225a-bbaf-478c-ab60-f712653822aa\") " pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:50:54.271929 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271527 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e268956a-f645-4087-904f-ca378919cb9d-registration-dir\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.271929 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271543 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40cc8edc-ca98-45ed-ac67-8ccdd0698b5e-host\") pod \"node-ca-cvjp4\" (UID: \"40cc8edc-ca98-45ed-ac67-8ccdd0698b5e\") " pod="openshift-image-registry/node-ca-cvjp4" Jun 09 14:50:54.271929 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271565 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1198225a-bbaf-478c-ab60-f712653822aa-kubelet-config\") pod \"global-pull-secret-syncer-zh67p\" (UID: \"1198225a-bbaf-478c-ab60-f712653822aa\") " pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:50:54.271929 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271584 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be13e6d2-7f68-454e-a813-629c7bf920ae-iptables-alerter-script\") pod \"iptables-alerter-d7tm2\" (UID: \"be13e6d2-7f68-454e-a813-629c7bf920ae\") " pod="openshift-network-operator/iptables-alerter-d7tm2" Jun 09 14:50:54.271929 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271597 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-slash\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.272645 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271614 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-etc-openvswitch\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.272645 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-os-release\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.272645 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-system-cni-dir\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.272645 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271679 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/95378364-27ce-4eb8-b854-5a2e69df7858-konnectivity-ca\") pod \"konnectivity-agent-npp6l\" (UID: \"95378364-27ce-4eb8-b854-5a2e69df7858\") " pod="kube-system/konnectivity-agent-npp6l" Jun 09 14:50:54.272645 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271697 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-cnibin\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.272645 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271715 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtlrm\" (UniqueName: \"kubernetes.io/projected/bc15d523-28ae-492f-b614-f82680cd7610-kube-api-access-qtlrm\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.272645 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271762 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-sysctl-d\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.272645 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271831 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/40cc8edc-ca98-45ed-ac67-8ccdd0698b5e-serviceca\") pod \"node-ca-cvjp4\" (UID: \"40cc8edc-ca98-45ed-ac67-8ccdd0698b5e\") " pod="openshift-image-registry/node-ca-cvjp4" Jun 09 14:50:54.272645 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.271856 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdtfj\" (UniqueName: \"kubernetes.io/projected/40cc8edc-ca98-45ed-ac67-8ccdd0698b5e-kube-api-access-sdtfj\") pod \"node-ca-cvjp4\" (UID: \"40cc8edc-ca98-45ed-ac67-8ccdd0698b5e\") " pod="openshift-image-registry/node-ca-cvjp4" Jun 09 14:50:54.321045 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.320990 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 14:45:53 +0000 UTC" deadline="2028-02-19 07:53:54.825240406 +0000 UTC" Jun 09 14:50:54.321045 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.321042 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14873h3m0.504203006s" Jun 09 14:50:54.372213 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372182 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-system-cni-dir\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.372213 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372216 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/95378364-27ce-4eb8-b854-5a2e69df7858-konnectivity-ca\") pod \"konnectivity-agent-npp6l\" (UID: \"95378364-27ce-4eb8-b854-5a2e69df7858\") " pod="kube-system/konnectivity-agent-npp6l" Jun 09 14:50:54.372404 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372235 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-cnibin\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.372404 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372295 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-cnibin\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.372404 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372331 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-system-cni-dir\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.372404 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372352 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtlrm\" (UniqueName: \"kubernetes.io/projected/bc15d523-28ae-492f-b614-f82680cd7610-kube-api-access-qtlrm\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.372404 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372369 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-sysctl-d\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.372404 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/40cc8edc-ca98-45ed-ac67-8ccdd0698b5e-serviceca\") pod \"node-ca-cvjp4\" (UID: \"40cc8edc-ca98-45ed-ac67-8ccdd0698b5e\") " pod="openshift-image-registry/node-ca-cvjp4" Jun 09 14:50:54.372404 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372400 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdtfj\" (UniqueName: \"kubernetes.io/projected/40cc8edc-ca98-45ed-ac67-8ccdd0698b5e-kube-api-access-sdtfj\") pod \"node-ca-cvjp4\" (UID: \"40cc8edc-ca98-45ed-ac67-8ccdd0698b5e\") " pod="openshift-image-registry/node-ca-cvjp4" Jun 09 14:50:54.372732 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372422 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-host-run-netns\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.372732 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372447 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km24g\" (UniqueName: \"kubernetes.io/projected/a0b8851c-1232-44c1-bd3d-7755e87421ee-kube-api-access-km24g\") pod \"node-resolver-xmr49\" (UID: \"a0b8851c-1232-44c1-bd3d-7755e87421ee\") " pod="openshift-dns/node-resolver-xmr49" Jun 09 14:50:54.372732 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372491 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-sys\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.372732 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372524 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-var-lib-kubelet\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.372732 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-var-lib-openvswitch\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.372732 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-log-socket\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.372732 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372568 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-sysctl-d\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.372732 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-run-ovn-kubernetes\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.372732 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372645 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-sys\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.372732 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372646 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-run-ovn-kubernetes\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.372732 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372685 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-host-run-netns\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.372732 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372694 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-var-lib-kubelet\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.373209 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372739 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-log-socket\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.373209 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372737 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-var-lib-openvswitch\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.373209 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372760 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e268956a-f645-4087-904f-ca378919cb9d-sys-fs\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.373209 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372789 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-hostroot\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.373209 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372821 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/95378364-27ce-4eb8-b854-5a2e69df7858-konnectivity-ca\") pod \"konnectivity-agent-npp6l\" (UID: \"95378364-27ce-4eb8-b854-5a2e69df7858\") " pod="kube-system/konnectivity-agent-npp6l" Jun 09 14:50:54.373209 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372828 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-sysconfig\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.373209 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372853 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-systemd-units\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.373209 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372856 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e268956a-f645-4087-904f-ca378919cb9d-sys-fs\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.373209 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372868 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-hostroot\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.373209 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-run-netns\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.373209 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372899 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-sysconfig\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.373209 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372908 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/40cc8edc-ca98-45ed-ac67-8ccdd0698b5e-serviceca\") pod \"node-ca-cvjp4\" (UID: \"40cc8edc-ca98-45ed-ac67-8ccdd0698b5e\") " pod="openshift-image-registry/node-ca-cvjp4" Jun 09 14:50:54.373209 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372913 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-systemd-units\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.373209 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372926 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-cni-netd\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.373209 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372911 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-run-netns\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.373209 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-multus-socket-dir-parent\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.373209 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.372995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-host-var-lib-kubelet\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.373209 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373001 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-cni-netd\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.374049 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373025 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-etc-kubernetes\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.374049 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373044 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-host-var-lib-kubelet\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.374049 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373051 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-multus-socket-dir-parent\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.374049 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-node-log\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.374049 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373101 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-etc-kubernetes\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.374049 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373114 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-ovn-node-metrics-cert\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.374049 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373125 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-node-log\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.374049 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwh6b\" (UniqueName: \"kubernetes.io/projected/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-kube-api-access-qwh6b\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.374049 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373165 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-host-run-k8s-cni-cncf-io\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.374049 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373231 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bc15d523-28ae-492f-b614-f82680cd7610-multus-daemon-config\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.374049 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-host-run-multus-certs\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.374049 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373256 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-host-run-k8s-cni-cncf-io\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.374049 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373270 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0b8851c-1232-44c1-bd3d-7755e87421ee-tmp-dir\") pod \"node-resolver-xmr49\" (UID: \"a0b8851c-1232-44c1-bd3d-7755e87421ee\") " pod="openshift-dns/node-resolver-xmr49" Jun 09 14:50:54.374049 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373291 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-cni-binary-copy\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.374049 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-kubelet\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.374049 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373335 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-host-run-multus-certs\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.374049 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373339 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-run-systemd\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.374049 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-cni-bin\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.374911 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373385 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e268956a-f645-4087-904f-ca378919cb9d-device-dir\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.374911 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gfjl\" (UniqueName: \"kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl\") pod \"network-check-target-72v7w\" (UID: \"dea690ee-0ba8-44a4-a025-863f659225af\") " pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:50:54.374911 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373433 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a0b8851c-1232-44c1-bd3d-7755e87421ee-hosts-file\") pod \"node-resolver-xmr49\" (UID: \"a0b8851c-1232-44c1-bd3d-7755e87421ee\") " pod="openshift-dns/node-resolver-xmr49" Jun 09 14:50:54.374911 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373453 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/95378364-27ce-4eb8-b854-5a2e69df7858-agent-certs\") pod \"konnectivity-agent-npp6l\" (UID: \"95378364-27ce-4eb8-b854-5a2e69df7858\") " pod="kube-system/konnectivity-agent-npp6l" Jun 09 14:50:54.374911 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373493 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-host-var-lib-cni-multus\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.374911 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373514 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-sysctl-conf\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.374911 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-systemd\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.374911 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373522 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 14:50:54.374911 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-host\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.374911 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.374911 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373602 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-kubelet\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.374911 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373613 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-ovnkube-config\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.374911 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-env-overrides\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.374911 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373649 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-run-systemd\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.374911 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373662 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e268956a-f645-4087-904f-ca378919cb9d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.374911 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-modprobe-d\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.374911 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373709 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.374911 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373711 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0b8851c-1232-44c1-bd3d-7755e87421ee-tmp-dir\") pod \"node-resolver-xmr49\" (UID: \"a0b8851c-1232-44c1-bd3d-7755e87421ee\") " pod="openshift-dns/node-resolver-xmr49" Jun 09 14:50:54.376006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373756 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-sysctl-conf\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.376006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv86j\" (UniqueName: \"kubernetes.io/projected/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-kube-api-access-vv86j\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.376006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373810 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e268956a-f645-4087-904f-ca378919cb9d-device-dir\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.376006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373823 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-system-cni-dir\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.376006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373843 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a0b8851c-1232-44c1-bd3d-7755e87421ee-hosts-file\") pod \"node-resolver-xmr49\" (UID: \"a0b8851c-1232-44c1-bd3d-7755e87421ee\") " pod="openshift-dns/node-resolver-xmr49" Jun 09 14:50:54.376006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-multus-conf-dir\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.376006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373871 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bc15d523-28ae-492f-b614-f82680cd7610-multus-daemon-config\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.376006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373874 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-lib-modules\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.376006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373915 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-cni-binary-copy\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.376006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373928 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55tx4\" (UniqueName: \"kubernetes.io/projected/be13e6d2-7f68-454e-a813-629c7bf920ae-kube-api-access-55tx4\") pod \"iptables-alerter-d7tm2\" (UID: \"be13e6d2-7f68-454e-a813-629c7bf920ae\") " pod="openshift-network-operator/iptables-alerter-d7tm2" Jun 09 14:50:54.376006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373957 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e268956a-f645-4087-904f-ca378919cb9d-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.376006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373970 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-lib-modules\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.376006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373974 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-host-var-lib-cni-multus\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.376006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373989 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-host\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.376006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.373558 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-cni-bin\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.376006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374012 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-multus-conf-dir\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.376006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374002 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-multus-cni-dir\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.376777 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374054 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.376777 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374062 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-system-cni-dir\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.376777 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374080 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1198225a-bbaf-478c-ab60-f712653822aa-dbus\") pod \"global-pull-secret-syncer-zh67p\" (UID: \"1198225a-bbaf-478c-ab60-f712653822aa\") " pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:50:54.376777 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374090 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e268956a-f645-4087-904f-ca378919cb9d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.376777 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374105 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs\") pod \"network-metrics-daemon-6pz99\" (UID: \"e78820c0-87e6-4a86-a8b3-efbe056c96b7\") " pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:50:54.376777 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374130 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-cnibin\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.376777 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374146 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e268956a-f645-4087-904f-ca378919cb9d-etc-selinux\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.376777 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374155 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-run-openvswitch\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.376777 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374183 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-ovnkube-script-lib\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.376777 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e268956a-f645-4087-904f-ca378919cb9d-socket-dir\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.376777 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374233 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk4gq\" (UniqueName: \"kubernetes.io/projected/e268956a-f645-4087-904f-ca378919cb9d-kube-api-access-pk4gq\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.376777 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374267 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc15d523-28ae-492f-b614-f82680cd7610-cni-binary-copy\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.376777 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374288 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-modprobe-d\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.376777 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374291 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-host-var-lib-cni-bin\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.376777 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374331 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-host-var-lib-cni-bin\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.376777 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374335 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8l4s\" (UniqueName: \"kubernetes.io/projected/e78820c0-87e6-4a86-a8b3-efbe056c96b7-kube-api-access-x8l4s\") pod \"network-metrics-daemon-6pz99\" (UID: \"e78820c0-87e6-4a86-a8b3-efbe056c96b7\") " pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:50:54.376777 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj92s\" (UniqueName: \"kubernetes.io/projected/fffccc4b-c1a2-44c9-b2e2-58939246915d-kube-api-access-kj92s\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.377525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374387 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-kubernetes\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.377525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374394 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-multus-cni-dir\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.377525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374026 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-systemd\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.377525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374411 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-os-release\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.377525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374436 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be13e6d2-7f68-454e-a813-629c7bf920ae-host-slash\") pod \"iptables-alerter-d7tm2\" (UID: \"be13e6d2-7f68-454e-a813-629c7bf920ae\") " pod="openshift-network-operator/iptables-alerter-d7tm2" Jun 09 14:50:54.377525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374445 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.377525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-run-ovn\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.377525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374508 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.377525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374541 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-run\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.377525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-tuned\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.377525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374586 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fffccc4b-c1a2-44c9-b2e2-58939246915d-tmp\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.377525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374610 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret\") pod \"global-pull-secret-syncer-zh67p\" (UID: \"1198225a-bbaf-478c-ab60-f712653822aa\") " pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:50:54.377525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374612 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-env-overrides\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.377525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374617 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.377525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374634 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e268956a-f645-4087-904f-ca378919cb9d-registration-dir\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.377525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374649 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be13e6d2-7f68-454e-a813-629c7bf920ae-host-slash\") pod \"iptables-alerter-d7tm2\" (UID: \"be13e6d2-7f68-454e-a813-629c7bf920ae\") " pod="openshift-network-operator/iptables-alerter-d7tm2" Jun 09 14:50:54.377525 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374659 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40cc8edc-ca98-45ed-ac67-8ccdd0698b5e-host\") pod \"node-ca-cvjp4\" (UID: \"40cc8edc-ca98-45ed-ac67-8ccdd0698b5e\") " pod="openshift-image-registry/node-ca-cvjp4" Jun 09 14:50:54.378314 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374671 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-run-ovn\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.378314 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374685 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-ovnkube-config\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.378314 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374703 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40cc8edc-ca98-45ed-ac67-8ccdd0698b5e-host\") pod \"node-ca-cvjp4\" (UID: \"40cc8edc-ca98-45ed-ac67-8ccdd0698b5e\") " pod="openshift-image-registry/node-ca-cvjp4" Jun 09 14:50:54.378314 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374705 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.378314 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374731 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1198225a-bbaf-478c-ab60-f712653822aa-kubelet-config\") pod \"global-pull-secret-syncer-zh67p\" (UID: \"1198225a-bbaf-478c-ab60-f712653822aa\") " pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:50:54.378314 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be13e6d2-7f68-454e-a813-629c7bf920ae-iptables-alerter-script\") pod \"iptables-alerter-d7tm2\" (UID: \"be13e6d2-7f68-454e-a813-629c7bf920ae\") " pod="openshift-network-operator/iptables-alerter-d7tm2" Jun 09 14:50:54.378314 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374781 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-kubernetes\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.378314 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374783 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-slash\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.378314 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374816 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1198225a-bbaf-478c-ab60-f712653822aa-dbus\") pod \"global-pull-secret-syncer-zh67p\" (UID: \"1198225a-bbaf-478c-ab60-f712653822aa\") " pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:50:54.378314 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374874 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-os-release\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.378314 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374820 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-etc-openvswitch\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.378314 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374895 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.378314 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-os-release\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.378314 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374933 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-run-openvswitch\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.378314 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374983 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fffccc4b-c1a2-44c9-b2e2-58939246915d-run\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.378314 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374926 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-etc-openvswitch\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.378314 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.375092 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e268956a-f645-4087-904f-ca378919cb9d-socket-dir\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.378314 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:54.375135 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:50:54.379083 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:54.375225 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs podName:e78820c0-87e6-4a86-a8b3-efbe056c96b7 nodeName:}" failed. No retries permitted until 2026-06-09 14:50:54.875187571 +0000 UTC m=+3.019768579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs") pod "network-metrics-daemon-6pz99" (UID: "e78820c0-87e6-4a86-a8b3-efbe056c96b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:50:54.379083 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.374819 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-host-slash\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.379083 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.375415 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-ovnkube-script-lib\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.379083 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:54.375506 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:50:54.379083 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:54.375560 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret podName:1198225a-bbaf-478c-ab60-f712653822aa nodeName:}" failed. No retries permitted until 2026-06-09 14:50:54.875543561 +0000 UTC m=+3.020124526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret") pod "global-pull-secret-syncer-zh67p" (UID: "1198225a-bbaf-478c-ab60-f712653822aa") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:50:54.379083 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.375569 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc15d523-28ae-492f-b614-f82680cd7610-os-release\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.379083 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.375613 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-cnibin\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.379083 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.375617 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e268956a-f645-4087-904f-ca378919cb9d-registration-dir\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.379083 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.375928 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc15d523-28ae-492f-b614-f82680cd7610-cni-binary-copy\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.379083 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.376029 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1198225a-bbaf-478c-ab60-f712653822aa-kubelet-config\") pod \"global-pull-secret-syncer-zh67p\" (UID: \"1198225a-bbaf-478c-ab60-f712653822aa\") " pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:50:54.379083 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.376040 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be13e6d2-7f68-454e-a813-629c7bf920ae-iptables-alerter-script\") pod \"iptables-alerter-d7tm2\" (UID: \"be13e6d2-7f68-454e-a813-629c7bf920ae\") " pod="openshift-network-operator/iptables-alerter-d7tm2" Jun 09 14:50:54.379083 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.377969 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fffccc4b-c1a2-44c9-b2e2-58939246915d-etc-tuned\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.379083 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.378180 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-ovn-node-metrics-cert\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.379083 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.378377 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/95378364-27ce-4eb8-b854-5a2e69df7858-agent-certs\") pod \"konnectivity-agent-npp6l\" (UID: \"95378364-27ce-4eb8-b854-5a2e69df7858\") " pod="kube-system/konnectivity-agent-npp6l" Jun 09 14:50:54.379654 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.379435 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fffccc4b-c1a2-44c9-b2e2-58939246915d-tmp\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.390484 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.390439 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtlrm\" (UniqueName: \"kubernetes.io/projected/bc15d523-28ae-492f-b614-f82680cd7610-kube-api-access-qtlrm\") pod \"multus-jbbj6\" (UID: \"bc15d523-28ae-492f-b614-f82680cd7610\") " pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.418182 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.418148 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk4gq\" (UniqueName: \"kubernetes.io/projected/e268956a-f645-4087-904f-ca378919cb9d-kube-api-access-pk4gq\") pod \"aws-ebs-csi-driver-node-h8knp\" (UID: \"e268956a-f645-4087-904f-ca378919cb9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.420680 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.420650 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55tx4\" (UniqueName: \"kubernetes.io/projected/be13e6d2-7f68-454e-a813-629c7bf920ae-kube-api-access-55tx4\") pod \"iptables-alerter-d7tm2\" (UID: \"be13e6d2-7f68-454e-a813-629c7bf920ae\") " pod="openshift-network-operator/iptables-alerter-d7tm2" Jun 09 14:50:54.423160 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:54.423015 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:50:54.423160 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:54.423045 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:50:54.423160 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:54.423060 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5gfjl for pod openshift-network-diagnostics/network-check-target-72v7w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:50:54.423160 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:54.423121 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl podName:dea690ee-0ba8-44a4-a025-863f659225af nodeName:}" failed. No retries permitted until 2026-06-09 14:50:54.923101686 +0000 UTC m=+3.067682669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5gfjl" (UniqueName: "kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl") pod "network-check-target-72v7w" (UID: "dea690ee-0ba8-44a4-a025-863f659225af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:50:54.425564 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.425541 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwh6b\" (UniqueName: \"kubernetes.io/projected/6e268462-1c4d-45ec-ae83-ac7fb55f6e6b-kube-api-access-qwh6b\") pod \"ovnkube-node-nc4z6\" (UID: \"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.426329 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.426119 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdtfj\" (UniqueName: \"kubernetes.io/projected/40cc8edc-ca98-45ed-ac67-8ccdd0698b5e-kube-api-access-sdtfj\") pod \"node-ca-cvjp4\" (UID: \"40cc8edc-ca98-45ed-ac67-8ccdd0698b5e\") " pod="openshift-image-registry/node-ca-cvjp4" Jun 09 14:50:54.426748 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.426726 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8l4s\" (UniqueName: \"kubernetes.io/projected/e78820c0-87e6-4a86-a8b3-efbe056c96b7-kube-api-access-x8l4s\") pod \"network-metrics-daemon-6pz99\" (UID: \"e78820c0-87e6-4a86-a8b3-efbe056c96b7\") " pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:50:54.429200 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.429176 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-km24g\" (UniqueName: \"kubernetes.io/projected/a0b8851c-1232-44c1-bd3d-7755e87421ee-kube-api-access-km24g\") pod \"node-resolver-xmr49\" (UID: \"a0b8851c-1232-44c1-bd3d-7755e87421ee\") " pod="openshift-dns/node-resolver-xmr49" Jun 09 14:50:54.431017 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.430992 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv86j\" (UniqueName: \"kubernetes.io/projected/ffe38d93-a450-48ed-812a-7a2f8ce02e3d-kube-api-access-vv86j\") pod \"multus-additional-cni-plugins-vbdtd\" (UID: \"ffe38d93-a450-48ed-812a-7a2f8ce02e3d\") " pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.431881 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.431855 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj92s\" (UniqueName: \"kubernetes.io/projected/fffccc4b-c1a2-44c9-b2e2-58939246915d-kube-api-access-kj92s\") pod \"tuned-q422g\" (UID: \"fffccc4b-c1a2-44c9-b2e2-58939246915d\") " pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.555566 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.555467 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xmr49" Jun 09 14:50:54.564339 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.564314 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d7tm2" Jun 09 14:50:54.573947 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.573927 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q422g" Jun 09 14:50:54.578645 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.578626 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cvjp4" Jun 09 14:50:54.585252 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.585230 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:50:54.591908 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.591866 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" Jun 09 14:50:54.597921 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.597904 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vbdtd" Jun 09 14:50:54.604374 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.604355 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-npp6l" Jun 09 14:50:54.610034 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.610010 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jbbj6" Jun 09 14:50:54.729633 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.729602 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:50:54.878679 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.878597 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret\") pod \"global-pull-secret-syncer-zh67p\" (UID: \"1198225a-bbaf-478c-ab60-f712653822aa\") " pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:50:54.878822 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.878689 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs\") pod \"network-metrics-daemon-6pz99\" (UID: \"e78820c0-87e6-4a86-a8b3-efbe056c96b7\") " pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:50:54.878822 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:54.878735 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:50:54.878822 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:54.878808 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret podName:1198225a-bbaf-478c-ab60-f712653822aa nodeName:}" failed. No retries permitted until 2026-06-09 14:50:55.8787899 +0000 UTC m=+4.023370879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret") pod "global-pull-secret-syncer-zh67p" (UID: "1198225a-bbaf-478c-ab60-f712653822aa") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:50:54.878949 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:54.878820 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:50:54.878949 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:54.878869 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs podName:e78820c0-87e6-4a86-a8b3-efbe056c96b7 nodeName:}" failed. No retries permitted until 2026-06-09 14:50:55.878856394 +0000 UTC m=+4.023437357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs") pod "network-metrics-daemon-6pz99" (UID: "e78820c0-87e6-4a86-a8b3-efbe056c96b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:50:54.979725 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:54.979683 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gfjl\" (UniqueName: \"kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl\") pod \"network-check-target-72v7w\" (UID: \"dea690ee-0ba8-44a4-a025-863f659225af\") " pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:50:54.979890 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:54.979845 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:50:54.979890 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:54.979866 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:50:54.979890 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:54.979884 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5gfjl for pod openshift-network-diagnostics/network-check-target-72v7w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:50:54.980009 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:54.979938 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl podName:dea690ee-0ba8-44a4-a025-863f659225af nodeName:}" failed. No retries permitted until 2026-06-09 14:50:55.979924963 +0000 UTC m=+4.124505926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5gfjl" (UniqueName: "kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl") pod "network-check-target-72v7w" (UID: "dea690ee-0ba8-44a4-a025-863f659225af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:50:55.025780 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:55.025751 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode268956a_f645_4087_904f_ca378919cb9d.slice/crio-4705b348d6c20dea16ad732d44b69b86d840b0533e7110773ea5686a80f324dc WatchSource:0}: Error finding container 4705b348d6c20dea16ad732d44b69b86d840b0533e7110773ea5686a80f324dc: Status 404 returned error can't find the container with id 4705b348d6c20dea16ad732d44b69b86d840b0533e7110773ea5686a80f324dc Jun 09 14:50:55.028906 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:55.028858 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe13e6d2_7f68_454e_a813_629c7bf920ae.slice/crio-64d2786eca6a73bedf7dfb45a1183f3d650c369fc2de6dae5d1c950c6d11ecae WatchSource:0}: Error finding container 64d2786eca6a73bedf7dfb45a1183f3d650c369fc2de6dae5d1c950c6d11ecae: Status 404 returned error can't find the container with id 64d2786eca6a73bedf7dfb45a1183f3d650c369fc2de6dae5d1c950c6d11ecae Jun 09 14:50:55.030519 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:55.030460 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40cc8edc_ca98_45ed_ac67_8ccdd0698b5e.slice/crio-df2c9e561cfe3cf25481c4a285e970408fc656a90c33a686bd69bd5da3527cce WatchSource:0}: Error finding container df2c9e561cfe3cf25481c4a285e970408fc656a90c33a686bd69bd5da3527cce: Status 404 returned error can't find the container with id df2c9e561cfe3cf25481c4a285e970408fc656a90c33a686bd69bd5da3527cce Jun 09 14:50:55.033681 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:55.032383 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95378364_27ce_4eb8_b854_5a2e69df7858.slice/crio-30da37739ecb477cb5994044917a13ea0d017528292f8b84d04b0ad6ca3226f4 WatchSource:0}: Error finding container 30da37739ecb477cb5994044917a13ea0d017528292f8b84d04b0ad6ca3226f4: Status 404 returned error can't find the container with id 30da37739ecb477cb5994044917a13ea0d017528292f8b84d04b0ad6ca3226f4 Jun 09 14:50:55.033681 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:55.033214 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe38d93_a450_48ed_812a_7a2f8ce02e3d.slice/crio-b43a40ef4861ce50f1c383d119ce1f586db875c5e417134777b28723c19fccbf WatchSource:0}: Error finding container b43a40ef4861ce50f1c383d119ce1f586db875c5e417134777b28723c19fccbf: Status 404 returned error can't find the container with id b43a40ef4861ce50f1c383d119ce1f586db875c5e417134777b28723c19fccbf Jun 09 14:50:55.035070 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:55.035044 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e268462_1c4d_45ec_ae83_ac7fb55f6e6b.slice/crio-5f6f7d0149d9362ce10e99b6c458a577247ba46256a990a9381518a95a47b10a WatchSource:0}: Error finding container 5f6f7d0149d9362ce10e99b6c458a577247ba46256a990a9381518a95a47b10a: Status 404 returned error can't find the container with id 5f6f7d0149d9362ce10e99b6c458a577247ba46256a990a9381518a95a47b10a Jun 09 14:50:55.036712 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:55.036690 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0b8851c_1232_44c1_bd3d_7755e87421ee.slice/crio-b9388fd8be621521e3f111bb99c3e3f742e11bcf0393c631201882d26d982d32 WatchSource:0}: Error finding container b9388fd8be621521e3f111bb99c3e3f742e11bcf0393c631201882d26d982d32: Status 404 returned error can't find the container with id b9388fd8be621521e3f111bb99c3e3f742e11bcf0393c631201882d26d982d32 Jun 09 14:50:55.037867 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:55.037844 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc15d523_28ae_492f_b614_f82680cd7610.slice/crio-0aac6bc5094f1dfb5fbbc71bc37dd72bd7b55273cce875af622a0a1d50edf2f0 WatchSource:0}: Error finding container 0aac6bc5094f1dfb5fbbc71bc37dd72bd7b55273cce875af622a0a1d50edf2f0: Status 404 returned error can't find the container with id 0aac6bc5094f1dfb5fbbc71bc37dd72bd7b55273cce875af622a0a1d50edf2f0 Jun 09 14:50:55.038915 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:50:55.038887 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfffccc4b_c1a2_44c9_b2e2_58939246915d.slice/crio-55fd2620f58e2e2444ce8b80ec32addf56e35fb8f5200bcb53a0c2c6ce20952a WatchSource:0}: Error finding container 55fd2620f58e2e2444ce8b80ec32addf56e35fb8f5200bcb53a0c2c6ce20952a: Status 404 returned error can't find the container with id 55fd2620f58e2e2444ce8b80ec32addf56e35fb8f5200bcb53a0c2c6ce20952a Jun 09 14:50:55.322030 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:55.321801 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 14:45:53 +0000 UTC" deadline="2027-12-21 12:14:46.53674836 +0000 UTC" Jun 09 14:50:55.322030 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:55.322028 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13437h23m51.214725331s" Jun 09 14:50:55.334259 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:55.334232 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:50:55.334369 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:55.334346 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zh67p" podUID="1198225a-bbaf-478c-ab60-f712653822aa" Jun 09 14:50:55.344316 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:55.344281 2578 generic.go:356] "Generic (PLEG): container finished" podID="740af3cea14540774083e52efd550fa7" containerID="07c841cad2f9db9cac01d6a6f7eea332c298d2e7fd4c08ff1c6aff07a2db847c" exitCode=0 Jun 09 14:50:55.344495 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:55.344373 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal" event={"ID":"740af3cea14540774083e52efd550fa7","Type":"ContainerDied","Data":"07c841cad2f9db9cac01d6a6f7eea332c298d2e7fd4c08ff1c6aff07a2db847c"} Jun 09 14:50:55.348010 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:55.347218 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jbbj6" event={"ID":"bc15d523-28ae-492f-b614-f82680cd7610","Type":"ContainerStarted","Data":"0aac6bc5094f1dfb5fbbc71bc37dd72bd7b55273cce875af622a0a1d50edf2f0"} Jun 09 14:50:55.349243 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:55.349211 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" event={"ID":"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b","Type":"ContainerStarted","Data":"5f6f7d0149d9362ce10e99b6c458a577247ba46256a990a9381518a95a47b10a"} Jun 09 14:50:55.351271 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:55.351216 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbdtd" event={"ID":"ffe38d93-a450-48ed-812a-7a2f8ce02e3d","Type":"ContainerStarted","Data":"b43a40ef4861ce50f1c383d119ce1f586db875c5e417134777b28723c19fccbf"} Jun 09 14:50:55.353437 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:55.353409 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-npp6l" event={"ID":"95378364-27ce-4eb8-b854-5a2e69df7858","Type":"ContainerStarted","Data":"30da37739ecb477cb5994044917a13ea0d017528292f8b84d04b0ad6ca3226f4"} Jun 09 14:50:55.355166 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:55.354876 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d7tm2" event={"ID":"be13e6d2-7f68-454e-a813-629c7bf920ae","Type":"ContainerStarted","Data":"64d2786eca6a73bedf7dfb45a1183f3d650c369fc2de6dae5d1c950c6d11ecae"} Jun 09 14:50:55.355984 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:55.355964 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" event={"ID":"e268956a-f645-4087-904f-ca378919cb9d","Type":"ContainerStarted","Data":"4705b348d6c20dea16ad732d44b69b86d840b0533e7110773ea5686a80f324dc"} Jun 09 14:50:55.357914 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:55.357885 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal" event={"ID":"3188748c32a7f1992a074b4a4686f613","Type":"ContainerStarted","Data":"d3565f8a589fb4c9b055156e6f0ea6b863dfb99fd2ad5976830b5a0a60ec1400"} Jun 09 14:50:55.365556 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:55.365495 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q422g" event={"ID":"fffccc4b-c1a2-44c9-b2e2-58939246915d","Type":"ContainerStarted","Data":"55fd2620f58e2e2444ce8b80ec32addf56e35fb8f5200bcb53a0c2c6ce20952a"} Jun 09 14:50:55.367022 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:55.366998 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xmr49" event={"ID":"a0b8851c-1232-44c1-bd3d-7755e87421ee","Type":"ContainerStarted","Data":"b9388fd8be621521e3f111bb99c3e3f742e11bcf0393c631201882d26d982d32"} Jun 09 14:50:55.368660 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:55.368636 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cvjp4" event={"ID":"40cc8edc-ca98-45ed-ac67-8ccdd0698b5e","Type":"ContainerStarted","Data":"df2c9e561cfe3cf25481c4a285e970408fc656a90c33a686bd69bd5da3527cce"} Jun 09 14:50:55.663661 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:55.663557 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:50:55.888901 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:55.888040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs\") pod \"network-metrics-daemon-6pz99\" (UID: \"e78820c0-87e6-4a86-a8b3-efbe056c96b7\") " pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:50:55.888901 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:55.888098 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret\") pod \"global-pull-secret-syncer-zh67p\" (UID: \"1198225a-bbaf-478c-ab60-f712653822aa\") " pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:50:55.888901 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:55.888276 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:50:55.888901 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:55.888347 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret podName:1198225a-bbaf-478c-ab60-f712653822aa nodeName:}" failed. No retries permitted until 2026-06-09 14:50:57.88832666 +0000 UTC m=+6.032907630 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret") pod "global-pull-secret-syncer-zh67p" (UID: "1198225a-bbaf-478c-ab60-f712653822aa") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:50:55.888901 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:55.888764 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:50:55.888901 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:55.888814 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs podName:e78820c0-87e6-4a86-a8b3-efbe056c96b7 nodeName:}" failed. No retries permitted until 2026-06-09 14:50:57.888799298 +0000 UTC m=+6.033380267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs") pod "network-metrics-daemon-6pz99" (UID: "e78820c0-87e6-4a86-a8b3-efbe056c96b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:50:55.989278 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:55.989239 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gfjl\" (UniqueName: \"kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl\") pod \"network-check-target-72v7w\" (UID: \"dea690ee-0ba8-44a4-a025-863f659225af\") " pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:50:55.989540 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:55.989497 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:50:55.989540 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:55.989525 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:50:55.989540 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:55.989539 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5gfjl for pod openshift-network-diagnostics/network-check-target-72v7w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:50:55.989738 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:55.989620 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl podName:dea690ee-0ba8-44a4-a025-863f659225af nodeName:}" failed. No retries permitted until 2026-06-09 14:50:57.989601527 +0000 UTC m=+6.134182492 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5gfjl" (UniqueName: "kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl") pod "network-check-target-72v7w" (UID: "dea690ee-0ba8-44a4-a025-863f659225af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:50:56.336095 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:56.336017 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:50:56.336534 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:56.336165 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72v7w" podUID="dea690ee-0ba8-44a4-a025-863f659225af" Jun 09 14:50:56.337154 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:56.336604 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:50:56.337154 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:56.336720 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pz99" podUID="e78820c0-87e6-4a86-a8b3-efbe056c96b7" Jun 09 14:50:56.397591 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:56.397543 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal" event={"ID":"740af3cea14540774083e52efd550fa7","Type":"ContainerStarted","Data":"6e09be0bc75b58d2894a28626c9de299774d56d61bfbc3272c79e524d9100a0c"} Jun 09 14:50:56.415511 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:56.415318 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-90.ec2.internal" podStartSLOduration=3.415297121 podStartE2EDuration="3.415297121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:50:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:50:55.401410454 +0000 UTC m=+3.545991439" watchObservedRunningTime="2026-06-09 14:50:56.415297121 +0000 UTC m=+4.559878107" Jun 09 14:50:57.334177 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:57.334146 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:50:57.334374 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:57.334293 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zh67p" podUID="1198225a-bbaf-478c-ab60-f712653822aa" Jun 09 14:50:57.904831 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:57.904790 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret\") pod \"global-pull-secret-syncer-zh67p\" (UID: \"1198225a-bbaf-478c-ab60-f712653822aa\") " pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:50:57.905274 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:57.904945 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs\") pod \"network-metrics-daemon-6pz99\" (UID: \"e78820c0-87e6-4a86-a8b3-efbe056c96b7\") " pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:50:57.905274 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:57.905077 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:50:57.905274 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:57.905162 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs podName:e78820c0-87e6-4a86-a8b3-efbe056c96b7 nodeName:}" failed. No retries permitted until 2026-06-09 14:51:01.905140828 +0000 UTC m=+10.049721827 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs") pod "network-metrics-daemon-6pz99" (UID: "e78820c0-87e6-4a86-a8b3-efbe056c96b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:50:57.905672 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:57.905652 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:50:57.905736 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:57.905719 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret podName:1198225a-bbaf-478c-ab60-f712653822aa nodeName:}" failed. No retries permitted until 2026-06-09 14:51:01.905699526 +0000 UTC m=+10.050280490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret") pod "global-pull-secret-syncer-zh67p" (UID: "1198225a-bbaf-478c-ab60-f712653822aa") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:50:58.006334 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:58.006299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gfjl\" (UniqueName: \"kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl\") pod \"network-check-target-72v7w\" (UID: \"dea690ee-0ba8-44a4-a025-863f659225af\") " pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:50:58.006549 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:58.006522 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:50:58.006549 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:58.006544 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:50:58.006667 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:58.006556 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5gfjl for pod openshift-network-diagnostics/network-check-target-72v7w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:50:58.006667 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:58.006616 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl podName:dea690ee-0ba8-44a4-a025-863f659225af nodeName:}" failed. No retries permitted until 2026-06-09 14:51:02.006595527 +0000 UTC m=+10.151176493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5gfjl" (UniqueName: "kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl") pod "network-check-target-72v7w" (UID: "dea690ee-0ba8-44a4-a025-863f659225af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:50:58.333929 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:58.333860 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:50:58.334070 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:58.333992 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pz99" podUID="e78820c0-87e6-4a86-a8b3-efbe056c96b7" Jun 09 14:50:58.334748 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:58.334729 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:50:58.334875 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:58.334857 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72v7w" podUID="dea690ee-0ba8-44a4-a025-863f659225af" Jun 09 14:50:59.334350 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:50:59.334311 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:50:59.334825 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:50:59.334443 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zh67p" podUID="1198225a-bbaf-478c-ab60-f712653822aa" Jun 09 14:51:00.334656 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:00.334624 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:51:00.335097 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:00.334779 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pz99" podUID="e78820c0-87e6-4a86-a8b3-efbe056c96b7" Jun 09 14:51:00.335097 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:00.334820 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:00.335097 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:00.334895 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72v7w" podUID="dea690ee-0ba8-44a4-a025-863f659225af" Jun 09 14:51:01.334182 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:01.334143 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:01.334370 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:01.334283 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zh67p" podUID="1198225a-bbaf-478c-ab60-f712653822aa" Jun 09 14:51:01.940804 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:01.940764 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs\") pod \"network-metrics-daemon-6pz99\" (UID: \"e78820c0-87e6-4a86-a8b3-efbe056c96b7\") " pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:51:01.941283 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:01.940825 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret\") pod \"global-pull-secret-syncer-zh67p\" (UID: \"1198225a-bbaf-478c-ab60-f712653822aa\") " pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:01.941283 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:01.940951 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:51:01.941283 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:01.941012 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret podName:1198225a-bbaf-478c-ab60-f712653822aa nodeName:}" failed. No retries permitted until 2026-06-09 14:51:09.94099518 +0000 UTC m=+18.085576143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret") pod "global-pull-secret-syncer-zh67p" (UID: "1198225a-bbaf-478c-ab60-f712653822aa") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:51:01.941435 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:01.941372 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:51:01.941435 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:01.941426 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs podName:e78820c0-87e6-4a86-a8b3-efbe056c96b7 nodeName:}" failed. No retries permitted until 2026-06-09 14:51:09.941414107 +0000 UTC m=+18.085995069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs") pod "network-metrics-daemon-6pz99" (UID: "e78820c0-87e6-4a86-a8b3-efbe056c96b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:51:02.041802 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:02.041760 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gfjl\" (UniqueName: \"kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl\") pod \"network-check-target-72v7w\" (UID: \"dea690ee-0ba8-44a4-a025-863f659225af\") " pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:02.041993 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:02.041971 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:51:02.041993 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:02.041990 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:51:02.042104 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:02.042003 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5gfjl for pod openshift-network-diagnostics/network-check-target-72v7w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:51:02.042104 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:02.042056 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl podName:dea690ee-0ba8-44a4-a025-863f659225af nodeName:}" failed. No retries permitted until 2026-06-09 14:51:10.042043222 +0000 UTC m=+18.186624186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5gfjl" (UniqueName: "kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl") pod "network-check-target-72v7w" (UID: "dea690ee-0ba8-44a4-a025-863f659225af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:51:02.335770 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:02.335684 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:51:02.335930 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:02.335800 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pz99" podUID="e78820c0-87e6-4a86-a8b3-efbe056c96b7" Jun 09 14:51:02.336176 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:02.336146 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:02.336282 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:02.336241 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72v7w" podUID="dea690ee-0ba8-44a4-a025-863f659225af" Jun 09 14:51:03.337665 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:03.334757 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:03.337665 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:03.334914 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zh67p" podUID="1198225a-bbaf-478c-ab60-f712653822aa" Jun 09 14:51:04.334704 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:04.334669 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:51:04.334922 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:04.334888 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pz99" podUID="e78820c0-87e6-4a86-a8b3-efbe056c96b7" Jun 09 14:51:04.335382 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:04.335359 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:04.335512 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:04.335489 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72v7w" podUID="dea690ee-0ba8-44a4-a025-863f659225af" Jun 09 14:51:05.334426 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:05.334388 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:05.334881 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:05.334550 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zh67p" podUID="1198225a-bbaf-478c-ab60-f712653822aa" Jun 09 14:51:06.334007 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:06.333970 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:06.334007 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:06.333991 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:51:06.334246 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:06.334112 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72v7w" podUID="dea690ee-0ba8-44a4-a025-863f659225af" Jun 09 14:51:06.334307 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:06.334241 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pz99" podUID="e78820c0-87e6-4a86-a8b3-efbe056c96b7" Jun 09 14:51:07.333536 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:07.333508 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:07.333946 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:07.333635 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zh67p" podUID="1198225a-bbaf-478c-ab60-f712653822aa" Jun 09 14:51:08.333871 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:08.333834 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:51:08.334328 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:08.333975 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pz99" podUID="e78820c0-87e6-4a86-a8b3-efbe056c96b7" Jun 09 14:51:08.334328 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:08.334028 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:08.334328 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:08.334131 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72v7w" podUID="dea690ee-0ba8-44a4-a025-863f659225af" Jun 09 14:51:09.334548 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:09.334505 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:09.334990 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:09.334636 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zh67p" podUID="1198225a-bbaf-478c-ab60-f712653822aa" Jun 09 14:51:10.001839 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:10.001800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs\") pod \"network-metrics-daemon-6pz99\" (UID: \"e78820c0-87e6-4a86-a8b3-efbe056c96b7\") " pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:51:10.001839 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:10.001845 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret\") pod \"global-pull-secret-syncer-zh67p\" (UID: \"1198225a-bbaf-478c-ab60-f712653822aa\") " pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:10.002077 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:10.001957 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:51:10.002077 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:10.001957 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:51:10.002077 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:10.002022 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret podName:1198225a-bbaf-478c-ab60-f712653822aa nodeName:}" failed. No retries permitted until 2026-06-09 14:51:26.002006137 +0000 UTC m=+34.146587100 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret") pod "global-pull-secret-syncer-zh67p" (UID: "1198225a-bbaf-478c-ab60-f712653822aa") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:51:10.002077 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:10.002043 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs podName:e78820c0-87e6-4a86-a8b3-efbe056c96b7 nodeName:}" failed. No retries permitted until 2026-06-09 14:51:26.002032828 +0000 UTC m=+34.146613794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs") pod "network-metrics-daemon-6pz99" (UID: "e78820c0-87e6-4a86-a8b3-efbe056c96b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:51:10.102212 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:10.102164 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gfjl\" (UniqueName: \"kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl\") pod \"network-check-target-72v7w\" (UID: \"dea690ee-0ba8-44a4-a025-863f659225af\") " pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:10.102382 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:10.102359 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:51:10.102433 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:10.102389 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:51:10.102433 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:10.102403 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5gfjl for pod openshift-network-diagnostics/network-check-target-72v7w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:51:10.102558 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:10.102465 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl podName:dea690ee-0ba8-44a4-a025-863f659225af nodeName:}" failed. No retries permitted until 2026-06-09 14:51:26.102446669 +0000 UTC m=+34.247027648 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5gfjl" (UniqueName: "kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl") pod "network-check-target-72v7w" (UID: "dea690ee-0ba8-44a4-a025-863f659225af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:51:10.337466 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:10.337435 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:10.337466 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:10.337462 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:51:10.337974 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:10.337571 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72v7w" podUID="dea690ee-0ba8-44a4-a025-863f659225af" Jun 09 14:51:10.338037 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:10.337990 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pz99" podUID="e78820c0-87e6-4a86-a8b3-efbe056c96b7" Jun 09 14:51:11.334108 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:11.334074 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:11.334359 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:11.334186 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zh67p" podUID="1198225a-bbaf-478c-ab60-f712653822aa" Jun 09 14:51:12.337211 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:12.337184 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:12.337652 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:12.337272 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72v7w" podUID="dea690ee-0ba8-44a4-a025-863f659225af" Jun 09 14:51:12.337652 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:12.337574 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:51:12.337780 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:12.337676 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pz99" podUID="e78820c0-87e6-4a86-a8b3-efbe056c96b7" Jun 09 14:51:13.334000 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:13.333963 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:13.334180 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:13.334084 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zh67p" podUID="1198225a-bbaf-478c-ab60-f712653822aa" Jun 09 14:51:14.333819 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:14.333639 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:14.334660 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:14.333639 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:51:14.334660 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:14.333892 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72v7w" podUID="dea690ee-0ba8-44a4-a025-863f659225af" Jun 09 14:51:14.334660 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:14.334017 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pz99" podUID="e78820c0-87e6-4a86-a8b3-efbe056c96b7" Jun 09 14:51:14.445220 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:14.445183 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jbbj6" event={"ID":"bc15d523-28ae-492f-b614-f82680cd7610","Type":"ContainerStarted","Data":"eb52be245364586c6c37b4c635d75526775082cc377f6b31e0ff0d48d1a9df31"} Jun 09 14:51:14.447665 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:14.447640 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nc4z6_6e268462-1c4d-45ec-ae83-ac7fb55f6e6b/ovn-acl-logging/0.log" Jun 09 14:51:14.448085 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:14.448060 2578 generic.go:356] "Generic (PLEG): container finished" podID="6e268462-1c4d-45ec-ae83-ac7fb55f6e6b" containerID="c8b4c1afed72c817922ec380fe2607be5a3a016ed2f96c70b08ad1634fa5e07d" exitCode=1 Jun 09 14:51:14.448212 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:14.448134 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" event={"ID":"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b","Type":"ContainerDied","Data":"c8b4c1afed72c817922ec380fe2607be5a3a016ed2f96c70b08ad1634fa5e07d"} Jun 09 14:51:14.448212 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:14.448199 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" event={"ID":"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b","Type":"ContainerStarted","Data":"aa3cdca6c61f84538dc96781a25792377095b1d2c93fbc9dfbc7e1326d72680c"} Jun 09 14:51:14.449908 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:14.449884 2578 generic.go:356] "Generic (PLEG): container finished" podID="ffe38d93-a450-48ed-812a-7a2f8ce02e3d" containerID="aab3395be381a11f1a5639901b5b2f06f75dd5550ff9986585c062882902d6bb" exitCode=0 Jun 09 14:51:14.450011 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:14.449960 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbdtd" event={"ID":"ffe38d93-a450-48ed-812a-7a2f8ce02e3d","Type":"ContainerDied","Data":"aab3395be381a11f1a5639901b5b2f06f75dd5550ff9986585c062882902d6bb"} Jun 09 14:51:14.451772 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:14.451747 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-npp6l" event={"ID":"95378364-27ce-4eb8-b854-5a2e69df7858","Type":"ContainerStarted","Data":"c0bd8eaadfcff49dc0456d8bb4b488763894cd6c37f164940c980314d121c2d6"} Jun 09 14:51:14.453466 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:14.453447 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" event={"ID":"e268956a-f645-4087-904f-ca378919cb9d","Type":"ContainerStarted","Data":"44fa4f6858a4156ef15bd3e105f2b3a110e2c4d8d23103872a0e4cffe47662fd"} Jun 09 14:51:14.455155 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:14.455126 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q422g" event={"ID":"fffccc4b-c1a2-44c9-b2e2-58939246915d","Type":"ContainerStarted","Data":"559a9de146a8268ec9a42cf8840536738977c719e9559f27da428397f714e96b"} Jun 09 14:51:14.459042 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:14.459016 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xmr49" event={"ID":"a0b8851c-1232-44c1-bd3d-7755e87421ee","Type":"ContainerStarted","Data":"c69894ddf1297bde93e874faaba883951c2cd9f5e4c55d2af4938a89c58b8d66"} Jun 09 14:51:14.460437 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:14.460418 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cvjp4" event={"ID":"40cc8edc-ca98-45ed-ac67-8ccdd0698b5e","Type":"ContainerStarted","Data":"628db50cc5ac0f89dab73f8d49add98c35a4e7af6fc923e2c89c2785e75c3189"} Jun 09 14:51:14.464196 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:14.464152 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-90.ec2.internal" podStartSLOduration=21.464140015 podStartE2EDuration="21.464140015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:50:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:50:56.415658645 +0000 UTC m=+4.560239632" watchObservedRunningTime="2026-06-09 14:51:14.464140015 +0000 UTC m=+22.608721000" Jun 09 14:51:14.464339 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:14.464317 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jbbj6" podStartSLOduration=3.509735583 podStartE2EDuration="22.464311156s" totalImagesPullingTime="18.954575573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:51:14.463810856 +0000 UTC m=+22.608391840" watchObservedRunningTime="2026-06-09 14:51:14.464311156 +0000 UTC m=+22.608892140" Jun 09 14:51:14.480036 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:14.479983 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-npp6l" podStartSLOduration=8.31579513 podStartE2EDuration="22.479969273s" totalImagesPullingTime="14.164174143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:51:14.47967379 +0000 UTC m=+22.624254775" watchObservedRunningTime="2026-06-09 14:51:14.479969273 +0000 UTC m=+22.624550258" Jun 09 14:51:14.496894 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:14.496846 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-q422g" podStartSLOduration=3.562585181 podStartE2EDuration="22.496829763s" totalImagesPullingTime="18.934244582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:51:14.496236892 +0000 UTC m=+22.640817876" watchObservedRunningTime="2026-06-09 14:51:14.496829763 +0000 UTC m=+22.641410787" Jun 09 14:51:14.531746 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:14.531700 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xmr49" podStartSLOduration=3.612318341 podStartE2EDuration="22.531680803s" totalImagesPullingTime="18.919362462s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:51:14.531567698 +0000 UTC m=+22.676148685" watchObservedRunningTime="2026-06-09 14:51:14.531680803 +0000 UTC m=+22.676261787" Jun 09 14:51:14.550310 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:14.550167 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cvjp4" podStartSLOduration=3.607497717 podStartE2EDuration="22.550150424s" totalImagesPullingTime="18.942652707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:51:14.549843767 +0000 UTC m=+22.694424753" watchObservedRunningTime="2026-06-09 14:51:14.550150424 +0000 UTC m=+22.694731408" Jun 09 14:51:15.334094 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:15.334058 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:15.334615 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:15.334189 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zh67p" podUID="1198225a-bbaf-478c-ab60-f712653822aa" Jun 09 14:51:15.466252 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:15.466229 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nc4z6_6e268462-1c4d-45ec-ae83-ac7fb55f6e6b/ovn-acl-logging/0.log" Jun 09 14:51:15.466719 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:15.466678 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" event={"ID":"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b","Type":"ContainerStarted","Data":"623d678d712d834cf686a9fe25756274d9d0494abd7780252cf6e62a5cf527ac"} Jun 09 14:51:15.466846 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:15.466768 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" event={"ID":"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b","Type":"ContainerStarted","Data":"a633be6cfe4e1c6fb1f9462ae039180cd652f443b42aa8a2f9ad367b7a7b9b37"} Jun 09 14:51:15.466846 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:15.466817 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" event={"ID":"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b","Type":"ContainerStarted","Data":"c03da8858f6f4dae436569f6016f05e00fa7775ef73fa4a11785d64d61f469db"} Jun 09 14:51:15.466963 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:15.466897 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" event={"ID":"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b","Type":"ContainerStarted","Data":"be9c46d12c18e2c8da2cc49272eeae0ce87fa961b8f51384e8505b92bbfbeec8"} Jun 09 14:51:15.624182 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:15.624150 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 14:51:15.810127 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:15.810092 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-npp6l" Jun 09 14:51:15.810693 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:15.810668 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-npp6l" Jun 09 14:51:16.333937 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:16.333903 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:51:16.334121 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:16.333904 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:16.334121 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:16.334054 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pz99" podUID="e78820c0-87e6-4a86-a8b3-efbe056c96b7" Jun 09 14:51:16.334563 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:16.334128 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72v7w" podUID="dea690ee-0ba8-44a4-a025-863f659225af" Jun 09 14:51:16.339575 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:16.339463 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T14:51:15.624174779Z","UUID":"5d220efa-be4d-4a5f-ac80-75d98108c08d","Handler":null,"Name":"","Endpoint":""} Jun 09 14:51:16.341592 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:16.341565 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 14:51:16.341704 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:16.341601 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 14:51:16.472708 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:16.472654 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d7tm2" event={"ID":"be13e6d2-7f68-454e-a813-629c7bf920ae","Type":"ContainerStarted","Data":"85d5cdd712db3a79511b6fa1f614c8328d1ef79104137fed326368ebee36ace8"} Jun 09 14:51:16.475595 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:16.475561 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" event={"ID":"e268956a-f645-4087-904f-ca378919cb9d","Type":"ContainerStarted","Data":"e1c0478732b8d83d6998dad57baced644da638e43ec9c96e2cee561ed2af2f16"} Jun 09 14:51:16.475974 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:16.475951 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-npp6l" Jun 09 14:51:16.476328 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:16.476309 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-npp6l" Jun 09 14:51:16.489431 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:16.489377 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d7tm2" podStartSLOduration=5.545337833 podStartE2EDuration="24.489357447s" totalImagesPullingTime="18.944019614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:51:16.488931505 +0000 UTC m=+24.633512489" watchObservedRunningTime="2026-06-09 14:51:16.489357447 +0000 UTC m=+24.633938433" Jun 09 14:51:17.333926 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:17.333701 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:17.334118 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:17.334026 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zh67p" podUID="1198225a-bbaf-478c-ab60-f712653822aa" Jun 09 14:51:17.480853 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:17.480807 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" event={"ID":"e268956a-f645-4087-904f-ca378919cb9d","Type":"ContainerStarted","Data":"ade4ba89fb42ef2ac24c78cdc8283cc78c0895cc28cd9b7db2baa1b42ae817a5"} Jun 09 14:51:17.484076 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:17.484016 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nc4z6_6e268462-1c4d-45ec-ae83-ac7fb55f6e6b/ovn-acl-logging/0.log" Jun 09 14:51:17.484413 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:17.484386 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" event={"ID":"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b","Type":"ContainerStarted","Data":"93dae81f9c829bdaf9c8bf2237872f98d837140459a4923c06101be3d205629f"} Jun 09 14:51:17.499337 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:17.499282 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h8knp" podStartSLOduration=4.230305845 podStartE2EDuration="25.499264016s" totalImagesPullingTime="21.268958171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:50:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:51:17.499123844 +0000 UTC m=+25.643704842" watchObservedRunningTime="2026-06-09 14:51:17.499264016 +0000 UTC m=+25.643845002" Jun 09 14:51:18.334619 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:18.334583 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:18.334834 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:18.334583 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:51:18.334834 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:18.334729 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72v7w" podUID="dea690ee-0ba8-44a4-a025-863f659225af" Jun 09 14:51:18.334927 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:18.334828 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pz99" podUID="e78820c0-87e6-4a86-a8b3-efbe056c96b7" Jun 09 14:51:19.333670 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:19.333463 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:19.334308 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:19.333747 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zh67p" podUID="1198225a-bbaf-478c-ab60-f712653822aa" Jun 09 14:51:19.492350 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:19.492323 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nc4z6_6e268462-1c4d-45ec-ae83-ac7fb55f6e6b/ovn-acl-logging/0.log" Jun 09 14:51:19.492753 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:19.492731 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" event={"ID":"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b","Type":"ContainerStarted","Data":"0fcc9201eeba7b7c9af85ae6118d83f09fa984b90ad7632640254487ec1ccac1"} Jun 09 14:51:19.492993 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:19.492976 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:51:19.493249 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:19.493227 2578 scope.go:117] "RemoveContainer" containerID="c8b4c1afed72c817922ec380fe2607be5a3a016ed2f96c70b08ad1634fa5e07d" Jun 09 14:51:19.494833 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:19.494811 2578 generic.go:356] "Generic (PLEG): container finished" podID="ffe38d93-a450-48ed-812a-7a2f8ce02e3d" containerID="e42c5ef3172d2bcc44e971ade502a5db32b04743573ebe499a72251af247dae8" exitCode=0 Jun 09 14:51:19.494919 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:19.494861 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbdtd" event={"ID":"ffe38d93-a450-48ed-812a-7a2f8ce02e3d","Type":"ContainerDied","Data":"e42c5ef3172d2bcc44e971ade502a5db32b04743573ebe499a72251af247dae8"} Jun 09 14:51:19.511624 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:19.511602 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:51:20.334526 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:20.334495 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:51:20.334858 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:20.334638 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pz99" podUID="e78820c0-87e6-4a86-a8b3-efbe056c96b7" Jun 09 14:51:20.334858 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:20.334691 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:20.334858 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:20.334808 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72v7w" podUID="dea690ee-0ba8-44a4-a025-863f659225af" Jun 09 14:51:20.501861 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:20.501786 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nc4z6_6e268462-1c4d-45ec-ae83-ac7fb55f6e6b/ovn-acl-logging/0.log" Jun 09 14:51:20.502230 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:20.502196 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" event={"ID":"6e268462-1c4d-45ec-ae83-ac7fb55f6e6b","Type":"ContainerStarted","Data":"4e92f75d1280f118264c3a43930e173a4b9d4947ad5c4b6a5c47c713350d6f20"} Jun 09 14:51:20.502408 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:20.502388 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:51:20.502559 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:20.502458 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:51:20.504903 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:20.504877 2578 generic.go:356] "Generic (PLEG): container finished" podID="ffe38d93-a450-48ed-812a-7a2f8ce02e3d" containerID="71e51ad4016944686101c2b3573ec21b59ee8a63834b4dccb2e4ab766916de61" exitCode=0 Jun 09 14:51:20.505018 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:20.504931 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbdtd" event={"ID":"ffe38d93-a450-48ed-812a-7a2f8ce02e3d","Type":"ContainerDied","Data":"71e51ad4016944686101c2b3573ec21b59ee8a63834b4dccb2e4ab766916de61"} Jun 09 14:51:20.519446 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:20.519418 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:51:20.532316 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:20.532255 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" podStartSLOduration=9.533799133 podStartE2EDuration="28.532235329s" totalImagesPullingTime="18.998436196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:51:20.530419637 +0000 UTC m=+28.675000623" watchObservedRunningTime="2026-06-09 14:51:20.532235329 +0000 UTC m=+28.676816379" Jun 09 14:51:20.959684 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:20.959640 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-72v7w"] Jun 09 14:51:20.959833 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:20.959770 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:20.959931 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:20.959902 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72v7w" podUID="dea690ee-0ba8-44a4-a025-863f659225af" Jun 09 14:51:20.960522 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:20.960499 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zh67p"] Jun 09 14:51:20.960615 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:20.960595 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:20.960691 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:20.960673 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zh67p" podUID="1198225a-bbaf-478c-ab60-f712653822aa" Jun 09 14:51:20.965048 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:20.964645 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6pz99"] Jun 09 14:51:20.965048 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:20.964836 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:51:20.965048 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:20.965002 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pz99" podUID="e78820c0-87e6-4a86-a8b3-efbe056c96b7" Jun 09 14:51:21.509703 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:21.509525 2578 generic.go:356] "Generic (PLEG): container finished" podID="ffe38d93-a450-48ed-812a-7a2f8ce02e3d" containerID="ed96af5667817cccc513528c79aca38af177f817bfad69360b107d0c8e1759f7" exitCode=0 Jun 09 14:51:21.510063 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:21.509579 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbdtd" event={"ID":"ffe38d93-a450-48ed-812a-7a2f8ce02e3d","Type":"ContainerDied","Data":"ed96af5667817cccc513528c79aca38af177f817bfad69360b107d0c8e1759f7"} Jun 09 14:51:22.334680 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:22.334645 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:22.334870 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:22.334768 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:51:22.334870 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:22.334826 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:22.335029 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:22.334865 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zh67p" podUID="1198225a-bbaf-478c-ab60-f712653822aa" Jun 09 14:51:22.335029 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:22.334901 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72v7w" podUID="dea690ee-0ba8-44a4-a025-863f659225af" Jun 09 14:51:22.335029 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:22.334985 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pz99" podUID="e78820c0-87e6-4a86-a8b3-efbe056c96b7" Jun 09 14:51:24.334696 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:24.334661 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:24.335311 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:24.334672 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:24.335311 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:24.334801 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72v7w" podUID="dea690ee-0ba8-44a4-a025-863f659225af" Jun 09 14:51:24.335311 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:24.334835 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:51:24.335311 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:24.334912 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zh67p" podUID="1198225a-bbaf-478c-ab60-f712653822aa" Jun 09 14:51:24.335311 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:24.334998 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pz99" podUID="e78820c0-87e6-4a86-a8b3-efbe056c96b7" Jun 09 14:51:26.032079 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:26.031994 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs\") pod \"network-metrics-daemon-6pz99\" (UID: \"e78820c0-87e6-4a86-a8b3-efbe056c96b7\") " pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:51:26.032079 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:26.032040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret\") pod \"global-pull-secret-syncer-zh67p\" (UID: \"1198225a-bbaf-478c-ab60-f712653822aa\") " pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:26.032682 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:26.032152 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:51:26.032682 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:26.032153 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:51:26.032682 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:26.032219 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret podName:1198225a-bbaf-478c-ab60-f712653822aa nodeName:}" failed. No retries permitted until 2026-06-09 14:51:58.032199177 +0000 UTC m=+66.176780140 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret") pod "global-pull-secret-syncer-zh67p" (UID: "1198225a-bbaf-478c-ab60-f712653822aa") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:51:26.032682 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:26.032238 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs podName:e78820c0-87e6-4a86-a8b3-efbe056c96b7 nodeName:}" failed. No retries permitted until 2026-06-09 14:51:58.032228409 +0000 UTC m=+66.176809371 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs") pod "network-metrics-daemon-6pz99" (UID: "e78820c0-87e6-4a86-a8b3-efbe056c96b7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:51:26.132646 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:26.132615 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gfjl\" (UniqueName: \"kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl\") pod \"network-check-target-72v7w\" (UID: \"dea690ee-0ba8-44a4-a025-863f659225af\") " pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:26.132825 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:26.132738 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:51:26.132825 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:26.132752 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:51:26.132825 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:26.132762 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5gfjl for pod openshift-network-diagnostics/network-check-target-72v7w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:51:26.132825 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:26.132806 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl podName:dea690ee-0ba8-44a4-a025-863f659225af nodeName:}" failed. No retries permitted until 2026-06-09 14:51:58.13279366 +0000 UTC m=+66.277374622 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5gfjl" (UniqueName: "kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl") pod "network-check-target-72v7w" (UID: "dea690ee-0ba8-44a4-a025-863f659225af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:51:26.333958 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:26.333926 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:51:26.334177 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:26.333933 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:26.334177 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:26.334063 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6pz99" podUID="e78820c0-87e6-4a86-a8b3-efbe056c96b7" Jun 09 14:51:26.334177 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:26.334106 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-72v7w" podUID="dea690ee-0ba8-44a4-a025-863f659225af" Jun 09 14:51:26.334177 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:26.333938 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:26.334398 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:26.334182 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zh67p" podUID="1198225a-bbaf-478c-ab60-f712653822aa" Jun 09 14:51:26.525568 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:26.525531 2578 generic.go:356] "Generic (PLEG): container finished" podID="ffe38d93-a450-48ed-812a-7a2f8ce02e3d" containerID="737e2bde72279443b99a98e90f6870f5a850867be8fea127f1e97c95b47b58d4" exitCode=0 Jun 09 14:51:26.525758 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:26.525578 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbdtd" event={"ID":"ffe38d93-a450-48ed-812a-7a2f8ce02e3d","Type":"ContainerDied","Data":"737e2bde72279443b99a98e90f6870f5a850867be8fea127f1e97c95b47b58d4"} Jun 09 14:51:27.137012 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.136984 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-90.ec2.internal" event="NodeReady" Jun 09 14:51:27.137516 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.137121 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 14:51:27.200144 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.200113 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l98bt"] Jun 09 14:51:27.226083 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.226054 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gcxj7"] Jun 09 14:51:27.226249 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.226188 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l98bt" Jun 09 14:51:27.228784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.228757 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 14:51:27.228944 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.228786 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sk827\"" Jun 09 14:51:27.228944 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.228757 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 14:51:27.247878 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.247845 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l98bt"] Jun 09 14:51:27.247878 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.247885 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gcxj7"] Jun 09 14:51:27.248092 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.247977 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gcxj7" Jun 09 14:51:27.253454 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.253343 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8llb4\"" Jun 09 14:51:27.253765 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.253747 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 14:51:27.253928 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.253893 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 14:51:27.254073 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.254058 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 14:51:27.340354 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.340325 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:51:27.340564 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.340375 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45f49\" (UniqueName: \"kubernetes.io/projected/0cfb1a71-c3ea-499d-8b91-db6188e1b952-kube-api-access-45f49\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:51:27.340564 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.340401 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c89nb\" (UniqueName: \"kubernetes.io/projected/99263755-4406-4d24-a336-6ece74ce3e0f-kube-api-access-c89nb\") pod \"ingress-canary-gcxj7\" (UID: \"99263755-4406-4d24-a336-6ece74ce3e0f\") " pod="openshift-ingress-canary/ingress-canary-gcxj7" Jun 09 14:51:27.340564 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.340453 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cfb1a71-c3ea-499d-8b91-db6188e1b952-tmp-dir\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:51:27.340564 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.340510 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0cfb1a71-c3ea-499d-8b91-db6188e1b952-config-volume\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:51:27.340564 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.340556 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99263755-4406-4d24-a336-6ece74ce3e0f-cert\") pod \"ingress-canary-gcxj7\" (UID: \"99263755-4406-4d24-a336-6ece74ce3e0f\") " pod="openshift-ingress-canary/ingress-canary-gcxj7" Jun 09 14:51:27.440972 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.440875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cfb1a71-c3ea-499d-8b91-db6188e1b952-tmp-dir\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:51:27.440972 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.440929 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0cfb1a71-c3ea-499d-8b91-db6188e1b952-config-volume\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:51:27.440972 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.440952 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99263755-4406-4d24-a336-6ece74ce3e0f-cert\") pod \"ingress-canary-gcxj7\" (UID: \"99263755-4406-4d24-a336-6ece74ce3e0f\") " pod="openshift-ingress-canary/ingress-canary-gcxj7" Jun 09 14:51:27.441258 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.440993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:51:27.441258 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.441026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45f49\" (UniqueName: \"kubernetes.io/projected/0cfb1a71-c3ea-499d-8b91-db6188e1b952-kube-api-access-45f49\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:51:27.441258 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.441046 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c89nb\" (UniqueName: \"kubernetes.io/projected/99263755-4406-4d24-a336-6ece74ce3e0f-kube-api-access-c89nb\") pod \"ingress-canary-gcxj7\" (UID: \"99263755-4406-4d24-a336-6ece74ce3e0f\") " pod="openshift-ingress-canary/ingress-canary-gcxj7" Jun 09 14:51:27.441258 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:27.441150 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:51:27.441258 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:27.441216 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls podName:0cfb1a71-c3ea-499d-8b91-db6188e1b952 nodeName:}" failed. No retries permitted until 2026-06-09 14:51:27.941196001 +0000 UTC m=+36.085776966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls") pod "dns-default-l98bt" (UID: "0cfb1a71-c3ea-499d-8b91-db6188e1b952") : secret "dns-default-metrics-tls" not found Jun 09 14:51:27.441531 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.441281 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cfb1a71-c3ea-499d-8b91-db6188e1b952-tmp-dir\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:51:27.441584 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.441550 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0cfb1a71-c3ea-499d-8b91-db6188e1b952-config-volume\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:51:27.445464 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.445330 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99263755-4406-4d24-a336-6ece74ce3e0f-cert\") pod \"ingress-canary-gcxj7\" (UID: \"99263755-4406-4d24-a336-6ece74ce3e0f\") " pod="openshift-ingress-canary/ingress-canary-gcxj7" Jun 09 14:51:27.451097 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.451070 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45f49\" (UniqueName: \"kubernetes.io/projected/0cfb1a71-c3ea-499d-8b91-db6188e1b952-kube-api-access-45f49\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:51:27.451305 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.451287 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c89nb\" (UniqueName: \"kubernetes.io/projected/99263755-4406-4d24-a336-6ece74ce3e0f-kube-api-access-c89nb\") pod \"ingress-canary-gcxj7\" (UID: \"99263755-4406-4d24-a336-6ece74ce3e0f\") " pod="openshift-ingress-canary/ingress-canary-gcxj7" Jun 09 14:51:27.530625 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.530581 2578 generic.go:356] "Generic (PLEG): container finished" podID="ffe38d93-a450-48ed-812a-7a2f8ce02e3d" containerID="a0e54f310d527f6e9bf2e1f5bd553effcc1980fbb3bc87da960349a2c9611e66" exitCode=0 Jun 09 14:51:27.530625 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.530624 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbdtd" event={"ID":"ffe38d93-a450-48ed-812a-7a2f8ce02e3d","Type":"ContainerDied","Data":"a0e54f310d527f6e9bf2e1f5bd553effcc1980fbb3bc87da960349a2c9611e66"} Jun 09 14:51:27.556177 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.556151 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gcxj7" Jun 09 14:51:27.752368 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.752330 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gcxj7"] Jun 09 14:51:27.756350 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:51:27.756308 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99263755_4406_4d24_a336_6ece74ce3e0f.slice/crio-9956edfb433ad7115c0d9527efa1dd5fbdb24d865b9e6ed09f0c1060d07ebbbb WatchSource:0}: Error finding container 9956edfb433ad7115c0d9527efa1dd5fbdb24d865b9e6ed09f0c1060d07ebbbb: Status 404 returned error can't find the container with id 9956edfb433ad7115c0d9527efa1dd5fbdb24d865b9e6ed09f0c1060d07ebbbb Jun 09 14:51:27.944186 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:27.944157 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:51:27.944358 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:27.944283 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:51:27.944358 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:27.944335 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls podName:0cfb1a71-c3ea-499d-8b91-db6188e1b952 nodeName:}" failed. No retries permitted until 2026-06-09 14:51:28.944321665 +0000 UTC m=+37.088902628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls") pod "dns-default-l98bt" (UID: "0cfb1a71-c3ea-499d-8b91-db6188e1b952") : secret "dns-default-metrics-tls" not found Jun 09 14:51:28.334117 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:28.334078 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:28.334646 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:28.334078 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:28.334646 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:28.334086 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:51:28.337302 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:28.337282 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 14:51:28.337434 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:28.337337 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zv6s4\"" Jun 09 14:51:28.337434 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:28.337282 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 14:51:28.337706 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:28.337689 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 14:51:28.338428 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:28.338408 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rw98s\"" Jun 09 14:51:28.338428 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:28.338423 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 14:51:28.537626 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:28.537586 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vbdtd" event={"ID":"ffe38d93-a450-48ed-812a-7a2f8ce02e3d","Type":"ContainerStarted","Data":"30212dcfe33dde24368df42205ef4c9f68ce6fa31f9b3e0f365acbfdf283298e"} Jun 09 14:51:28.538854 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:28.538828 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gcxj7" event={"ID":"99263755-4406-4d24-a336-6ece74ce3e0f","Type":"ContainerStarted","Data":"9956edfb433ad7115c0d9527efa1dd5fbdb24d865b9e6ed09f0c1060d07ebbbb"} Jun 09 14:51:28.562241 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:28.562196 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vbdtd" podStartSLOduration=8.075036335 podStartE2EDuration="36.562181651s" totalImagesPullingTime="28.487145316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:50:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:51:28.560155692 +0000 UTC m=+36.704736695" watchObservedRunningTime="2026-06-09 14:51:28.562181651 +0000 UTC m=+36.706762635" Jun 09 14:51:28.951197 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:28.951155 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:51:28.951401 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:28.951291 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:51:28.951401 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:28.951358 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls podName:0cfb1a71-c3ea-499d-8b91-db6188e1b952 nodeName:}" failed. No retries permitted until 2026-06-09 14:51:30.951340245 +0000 UTC m=+39.095921225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls") pod "dns-default-l98bt" (UID: "0cfb1a71-c3ea-499d-8b91-db6188e1b952") : secret "dns-default-metrics-tls" not found Jun 09 14:51:30.545166 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:30.544917 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gcxj7" event={"ID":"99263755-4406-4d24-a336-6ece74ce3e0f","Type":"ContainerStarted","Data":"5de7cae3827fa189151d6f03b8a2d421ffb297d5a28f8f8023e8005defa7f66e"} Jun 09 14:51:30.563560 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:30.563514 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gcxj7" podStartSLOduration=1.580722994 podStartE2EDuration="3.563499948s" totalImagesPullingTime="1.982776954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:51:30.56289088 +0000 UTC m=+38.707471865" watchObservedRunningTime="2026-06-09 14:51:30.563499948 +0000 UTC m=+38.708080933" Jun 09 14:51:30.967456 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:30.967420 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:51:30.967650 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:30.967559 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:51:30.967650 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:30.967615 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls podName:0cfb1a71-c3ea-499d-8b91-db6188e1b952 nodeName:}" failed. No retries permitted until 2026-06-09 14:51:34.967601239 +0000 UTC m=+43.112182222 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls") pod "dns-default-l98bt" (UID: "0cfb1a71-c3ea-499d-8b91-db6188e1b952") : secret "dns-default-metrics-tls" not found Jun 09 14:51:34.997556 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:34.997514 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:51:34.998024 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:34.997646 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:51:34.998024 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:34.997701 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls podName:0cfb1a71-c3ea-499d-8b91-db6188e1b952 nodeName:}" failed. No retries permitted until 2026-06-09 14:51:42.997686814 +0000 UTC m=+51.142267777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls") pod "dns-default-l98bt" (UID: "0cfb1a71-c3ea-499d-8b91-db6188e1b952") : secret "dns-default-metrics-tls" not found Jun 09 14:51:43.051694 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:43.051656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:51:43.052208 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:43.051806 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:51:43.052208 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:43.051876 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls podName:0cfb1a71-c3ea-499d-8b91-db6188e1b952 nodeName:}" failed. No retries permitted until 2026-06-09 14:51:59.051852778 +0000 UTC m=+67.196433742 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls") pod "dns-default-l98bt" (UID: "0cfb1a71-c3ea-499d-8b91-db6188e1b952") : secret "dns-default-metrics-tls" not found Jun 09 14:51:52.523409 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:52.523377 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nc4z6" Jun 09 14:51:58.063103 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:58.063045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs\") pod \"network-metrics-daemon-6pz99\" (UID: \"e78820c0-87e6-4a86-a8b3-efbe056c96b7\") " pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:51:58.063103 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:58.063109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret\") pod \"global-pull-secret-syncer-zh67p\" (UID: \"1198225a-bbaf-478c-ab60-f712653822aa\") " pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:58.066078 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:58.066056 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 14:51:58.066187 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:58.066172 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 14:51:58.073448 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:58.073425 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 14:51:58.073522 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:58.073506 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs podName:e78820c0-87e6-4a86-a8b3-efbe056c96b7 nodeName:}" failed. No retries permitted until 2026-06-09 14:53:02.073485774 +0000 UTC m=+130.218066756 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs") pod "network-metrics-daemon-6pz99" (UID: "e78820c0-87e6-4a86-a8b3-efbe056c96b7") : secret "metrics-daemon-secret" not found Jun 09 14:51:58.077162 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:58.077140 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1198225a-bbaf-478c-ab60-f712653822aa-original-pull-secret\") pod \"global-pull-secret-syncer-zh67p\" (UID: \"1198225a-bbaf-478c-ab60-f712653822aa\") " pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:58.163577 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:58.163531 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gfjl\" (UniqueName: \"kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl\") pod \"network-check-target-72v7w\" (UID: \"dea690ee-0ba8-44a4-a025-863f659225af\") " pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:58.166759 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:58.166738 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 14:51:58.176697 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:58.176678 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 14:51:58.187372 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:58.187336 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gfjl\" (UniqueName: \"kubernetes.io/projected/dea690ee-0ba8-44a4-a025-863f659225af-kube-api-access-5gfjl\") pod \"network-check-target-72v7w\" (UID: \"dea690ee-0ba8-44a4-a025-863f659225af\") " pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:58.350382 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:58.350355 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rw98s\"" Jun 09 14:51:58.358574 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:58.358553 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:51:58.365428 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:58.365404 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zh67p" Jun 09 14:51:58.494792 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:58.494762 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zh67p"] Jun 09 14:51:58.498277 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:51:58.498250 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1198225a_bbaf_478c_ab60_f712653822aa.slice/crio-4588f45e5450203dcf2715f4bc245696af460ddb5015322d0b65a0ff2bfe3f23 WatchSource:0}: Error finding container 4588f45e5450203dcf2715f4bc245696af460ddb5015322d0b65a0ff2bfe3f23: Status 404 returned error can't find the container with id 4588f45e5450203dcf2715f4bc245696af460ddb5015322d0b65a0ff2bfe3f23 Jun 09 14:51:58.506821 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:58.506798 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-72v7w"] Jun 09 14:51:58.509174 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:51:58.509151 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea690ee_0ba8_44a4_a025_863f659225af.slice/crio-954503b091b642841515f2ef4a4b7da6f0d4425ccdd4848040068e1387b8e42d WatchSource:0}: Error finding container 954503b091b642841515f2ef4a4b7da6f0d4425ccdd4848040068e1387b8e42d: Status 404 returned error can't find the container with id 954503b091b642841515f2ef4a4b7da6f0d4425ccdd4848040068e1387b8e42d Jun 09 14:51:58.610246 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:58.610150 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zh67p" event={"ID":"1198225a-bbaf-478c-ab60-f712653822aa","Type":"ContainerStarted","Data":"4588f45e5450203dcf2715f4bc245696af460ddb5015322d0b65a0ff2bfe3f23"} Jun 09 14:51:58.611201 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:58.611175 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-72v7w" event={"ID":"dea690ee-0ba8-44a4-a025-863f659225af","Type":"ContainerStarted","Data":"954503b091b642841515f2ef4a4b7da6f0d4425ccdd4848040068e1387b8e42d"} Jun 09 14:51:59.068212 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:51:59.068173 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:51:59.068635 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:59.068318 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:51:59.068635 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:51:59.068387 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls podName:0cfb1a71-c3ea-499d-8b91-db6188e1b952 nodeName:}" failed. No retries permitted until 2026-06-09 14:52:31.068365459 +0000 UTC m=+99.212946440 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls") pod "dns-default-l98bt" (UID: "0cfb1a71-c3ea-499d-8b91-db6188e1b952") : secret "dns-default-metrics-tls" not found Jun 09 14:52:01.621863 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:52:01.621785 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-72v7w" event={"ID":"dea690ee-0ba8-44a4-a025-863f659225af","Type":"ContainerStarted","Data":"ee6d871190068965868bffc40299cd34c031ec3c13dc251a8c121bad515a3858"} Jun 09 14:52:01.622338 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:52:01.621914 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:52:01.639529 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:52:01.639441 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-72v7w" podStartSLOduration=66.853584952 podStartE2EDuration="1m9.639419597s" totalImagesPullingTime="2.785834645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:52:01.638920029 +0000 UTC m=+69.783501011" watchObservedRunningTime="2026-06-09 14:52:01.639419597 +0000 UTC m=+69.784000584" Jun 09 14:52:03.629170 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:52:03.629128 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zh67p" event={"ID":"1198225a-bbaf-478c-ab60-f712653822aa","Type":"ContainerStarted","Data":"7ab0ffe79bf711f13a01f0f4bb3eec2185021e3f5728e79997ab1a22d0a4ae07"} Jun 09 14:52:03.648304 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:52:03.648245 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zh67p" podStartSLOduration=67.162251895 podStartE2EDuration="1m11.648227838s" totalImagesPullingTime="4.485975943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:52:03.647827621 +0000 UTC m=+71.792408606" watchObservedRunningTime="2026-06-09 14:52:03.648227838 +0000 UTC m=+71.792808823" Jun 09 14:52:31.070450 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:52:31.070417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:52:31.070943 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:52:31.070569 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:52:31.070943 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:52:31.070634 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls podName:0cfb1a71-c3ea-499d-8b91-db6188e1b952 nodeName:}" failed. No retries permitted until 2026-06-09 14:53:35.070618636 +0000 UTC m=+163.215199601 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls") pod "dns-default-l98bt" (UID: "0cfb1a71-c3ea-499d-8b91-db6188e1b952") : secret "dns-default-metrics-tls" not found Jun 09 14:52:32.627194 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:52:32.627161 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-72v7w" Jun 09 14:53:02.090302 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:02.090257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs\") pod \"network-metrics-daemon-6pz99\" (UID: \"e78820c0-87e6-4a86-a8b3-efbe056c96b7\") " pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:53:02.090816 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:53:02.090381 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 14:53:02.090816 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:53:02.090446 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs podName:e78820c0-87e6-4a86-a8b3-efbe056c96b7 nodeName:}" failed. No retries permitted until 2026-06-09 14:55:04.090429468 +0000 UTC m=+252.235010431 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs") pod "network-metrics-daemon-6pz99" (UID: "e78820c0-87e6-4a86-a8b3-efbe056c96b7") : secret "metrics-daemon-secret" not found Jun 09 14:53:30.235396 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:53:30.235340 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-l98bt" podUID="0cfb1a71-c3ea-499d-8b91-db6188e1b952" Jun 09 14:53:30.834787 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:30.834756 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l98bt" Jun 09 14:53:31.358897 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:53:31.358847 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6pz99" podUID="e78820c0-87e6-4a86-a8b3-efbe056c96b7" Jun 09 14:53:35.115638 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:35.115590 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:53:35.116056 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:53:35.115745 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:53:35.116056 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:53:35.115805 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls podName:0cfb1a71-c3ea-499d-8b91-db6188e1b952 nodeName:}" failed. No retries permitted until 2026-06-09 14:55:37.115791047 +0000 UTC m=+285.260372010 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls") pod "dns-default-l98bt" (UID: "0cfb1a71-c3ea-499d-8b91-db6188e1b952") : secret "dns-default-metrics-tls" not found Jun 09 14:53:44.338035 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:44.337908 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:53:58.393007 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.392974 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-kkp7w"] Jun 09 14:53:58.394580 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.394563 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-575b9d94b7-5jjqp"] Jun 09 14:53:58.394707 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.394687 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" Jun 09 14:53:58.396135 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.396117 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:53:58.397547 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.397519 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 14:53:58.397671 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.397549 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 14:53:58.397784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.397666 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rgm5n\"" Jun 09 14:53:58.397784 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.397693 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 14:53:58.397922 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.397910 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 14:53:58.399176 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.399163 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 09 14:53:58.400237 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.400214 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 09 14:53:58.400328 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.400266 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 14:53:58.400381 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.400354 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 14:53:58.400424 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.400410 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 09 14:53:58.400674 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.400659 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 09 14:53:58.401859 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.401494 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9ltld\"" Jun 09 14:53:58.404338 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.404318 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 14:53:58.408222 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.408201 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-kkp7w"] Jun 09 14:53:58.413257 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.413239 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-575b9d94b7-5jjqp"] Jun 09 14:53:58.480128 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.480095 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ngk"] Jun 09 14:53:58.481876 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.481859 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ngk" Jun 09 14:53:58.484166 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.484143 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bf7d9c4cf-82cd4"] Jun 09 14:53:58.484419 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.484374 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 14:53:58.484571 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.484553 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9575w\"" Jun 09 14:53:58.484906 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.484886 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 14:53:58.485806 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.485791 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.488974 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.488956 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 14:53:58.489683 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.489665 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 14:53:58.489763 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.489682 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qdn5n\"" Jun 09 14:53:58.489763 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.489706 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 14:53:58.494626 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.494451 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 14:53:58.495180 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.495160 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ngk"] Jun 09 14:53:58.499796 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.499773 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bf7d9c4cf-82cd4"] Jun 09 14:53:58.567220 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.567184 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thgkh\" (UniqueName: \"kubernetes.io/projected/0ab77b52-1ec6-4db7-9452-26d0f6866afe-kube-api-access-thgkh\") pod \"console-operator-668fdbf85c-kkp7w\" (UID: \"0ab77b52-1ec6-4db7-9452-26d0f6866afe\") " pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" Jun 09 14:53:58.567396 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.567231 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvfz8\" (UniqueName: \"kubernetes.io/projected/7a9edcb9-728c-4eba-9cdf-cc677ec92497-kube-api-access-fvfz8\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:53:58.567396 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.567258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:53:58.567396 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.567318 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ab77b52-1ec6-4db7-9452-26d0f6866afe-serving-cert\") pod \"console-operator-668fdbf85c-kkp7w\" (UID: \"0ab77b52-1ec6-4db7-9452-26d0f6866afe\") " pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" Jun 09 14:53:58.567396 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.567368 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68qmb\" (UniqueName: \"kubernetes.io/projected/6e837d6a-f29b-4234-b2f3-6ba514e0d332-kube-api-access-68qmb\") pod \"volume-data-source-validator-78dd696465-h8ngk\" (UID: \"6e837d6a-f29b-4234-b2f3-6ba514e0d332\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ngk" Jun 09 14:53:58.567396 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.567387 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-default-certificate\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:53:58.567587 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.567456 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ab77b52-1ec6-4db7-9452-26d0f6866afe-config\") pod \"console-operator-668fdbf85c-kkp7w\" (UID: \"0ab77b52-1ec6-4db7-9452-26d0f6866afe\") " pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" Jun 09 14:53:58.567587 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.567497 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ab77b52-1ec6-4db7-9452-26d0f6866afe-trusted-ca\") pod \"console-operator-668fdbf85c-kkp7w\" (UID: \"0ab77b52-1ec6-4db7-9452-26d0f6866afe\") " pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" Jun 09 14:53:58.567587 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.567516 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-stats-auth\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:53:58.567587 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.567537 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:53:58.668307 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.668207 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns48k\" (UniqueName: \"kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-kube-api-access-ns48k\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.668307 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.668251 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b67a741a-24b2-4790-9507-23e977da8936-ca-trust-extracted\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.668307 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.668282 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68qmb\" (UniqueName: \"kubernetes.io/projected/6e837d6a-f29b-4234-b2f3-6ba514e0d332-kube-api-access-68qmb\") pod \"volume-data-source-validator-78dd696465-h8ngk\" (UID: \"6e837d6a-f29b-4234-b2f3-6ba514e0d332\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ngk" Jun 09 14:53:58.668597 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.668305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-default-certificate\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:53:58.668597 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.668330 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b67a741a-24b2-4790-9507-23e977da8936-trusted-ca\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.668597 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.668352 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-registry-tls\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.668597 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.668394 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ab77b52-1ec6-4db7-9452-26d0f6866afe-config\") pod \"console-operator-668fdbf85c-kkp7w\" (UID: \"0ab77b52-1ec6-4db7-9452-26d0f6866afe\") " pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" Jun 09 14:53:58.668597 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.668419 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ab77b52-1ec6-4db7-9452-26d0f6866afe-trusted-ca\") pod \"console-operator-668fdbf85c-kkp7w\" (UID: \"0ab77b52-1ec6-4db7-9452-26d0f6866afe\") " pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" Jun 09 14:53:58.668597 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.668442 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-stats-auth\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:53:58.668597 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.668463 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b67a741a-24b2-4790-9507-23e977da8936-registry-certificates\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.668597 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.668510 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b67a741a-24b2-4790-9507-23e977da8936-installation-pull-secrets\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.668597 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.668537 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-bound-sa-token\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.668987 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.668635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:53:58.668987 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.668707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thgkh\" (UniqueName: \"kubernetes.io/projected/0ab77b52-1ec6-4db7-9452-26d0f6866afe-kube-api-access-thgkh\") pod \"console-operator-668fdbf85c-kkp7w\" (UID: \"0ab77b52-1ec6-4db7-9452-26d0f6866afe\") " pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" Jun 09 14:53:58.668987 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.668781 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvfz8\" (UniqueName: \"kubernetes.io/projected/7a9edcb9-728c-4eba-9cdf-cc677ec92497-kube-api-access-fvfz8\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:53:58.668987 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:53:58.668801 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle podName:7a9edcb9-728c-4eba-9cdf-cc677ec92497 nodeName:}" failed. No retries permitted until 2026-06-09 14:53:59.168777985 +0000 UTC m=+187.313358966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle") pod "router-default-575b9d94b7-5jjqp" (UID: "7a9edcb9-728c-4eba-9cdf-cc677ec92497") : configmap references non-existent config key: service-ca.crt Jun 09 14:53:58.668987 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.668837 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b67a741a-24b2-4790-9507-23e977da8936-image-registry-private-configuration\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.668987 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.668879 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:53:58.668987 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.668910 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ab77b52-1ec6-4db7-9452-26d0f6866afe-serving-cert\") pod \"console-operator-668fdbf85c-kkp7w\" (UID: \"0ab77b52-1ec6-4db7-9452-26d0f6866afe\") " pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" Jun 09 14:53:58.669350 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:53:58.669234 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 14:53:58.669350 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:53:58.669318 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs podName:7a9edcb9-728c-4eba-9cdf-cc677ec92497 nodeName:}" failed. No retries permitted until 2026-06-09 14:53:59.169300014 +0000 UTC m=+187.313880991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs") pod "router-default-575b9d94b7-5jjqp" (UID: "7a9edcb9-728c-4eba-9cdf-cc677ec92497") : secret "router-metrics-certs-default" not found Jun 09 14:53:58.669350 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.669321 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0ab77b52-1ec6-4db7-9452-26d0f6866afe-trusted-ca\") pod \"console-operator-668fdbf85c-kkp7w\" (UID: \"0ab77b52-1ec6-4db7-9452-26d0f6866afe\") " pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" Jun 09 14:53:58.669350 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.669344 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0ab77b52-1ec6-4db7-9452-26d0f6866afe-config\") pod \"console-operator-668fdbf85c-kkp7w\" (UID: \"0ab77b52-1ec6-4db7-9452-26d0f6866afe\") " pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" Jun 09 14:53:58.671106 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.671077 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-stats-auth\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:53:58.671222 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.671127 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-default-certificate\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:53:58.671274 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.671251 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0ab77b52-1ec6-4db7-9452-26d0f6866afe-serving-cert\") pod \"console-operator-668fdbf85c-kkp7w\" (UID: \"0ab77b52-1ec6-4db7-9452-26d0f6866afe\") " pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" Jun 09 14:53:58.681845 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.681813 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thgkh\" (UniqueName: \"kubernetes.io/projected/0ab77b52-1ec6-4db7-9452-26d0f6866afe-kube-api-access-thgkh\") pod \"console-operator-668fdbf85c-kkp7w\" (UID: \"0ab77b52-1ec6-4db7-9452-26d0f6866afe\") " pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" Jun 09 14:53:58.681992 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.681863 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68qmb\" (UniqueName: \"kubernetes.io/projected/6e837d6a-f29b-4234-b2f3-6ba514e0d332-kube-api-access-68qmb\") pod \"volume-data-source-validator-78dd696465-h8ngk\" (UID: \"6e837d6a-f29b-4234-b2f3-6ba514e0d332\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ngk" Jun 09 14:53:58.682253 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.682231 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvfz8\" (UniqueName: \"kubernetes.io/projected/7a9edcb9-728c-4eba-9cdf-cc677ec92497-kube-api-access-fvfz8\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:53:58.705245 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.705208 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" Jun 09 14:53:58.770213 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.770165 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b67a741a-24b2-4790-9507-23e977da8936-image-registry-private-configuration\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.770213 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.770214 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns48k\" (UniqueName: \"kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-kube-api-access-ns48k\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.770441 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.770237 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b67a741a-24b2-4790-9507-23e977da8936-ca-trust-extracted\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.770441 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.770256 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b67a741a-24b2-4790-9507-23e977da8936-trusted-ca\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.770441 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.770274 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-registry-tls\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.770441 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.770304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b67a741a-24b2-4790-9507-23e977da8936-registry-certificates\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.770441 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.770320 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b67a741a-24b2-4790-9507-23e977da8936-installation-pull-secrets\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.770441 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.770336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-bound-sa-token\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.770790 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:53:58.770673 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 14:53:58.770790 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:53:58.770694 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bf7d9c4cf-82cd4: secret "image-registry-tls" not found Jun 09 14:53:58.770790 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.770731 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b67a741a-24b2-4790-9507-23e977da8936-ca-trust-extracted\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.770790 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:53:58.770782 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-registry-tls podName:b67a741a-24b2-4790-9507-23e977da8936 nodeName:}" failed. No retries permitted until 2026-06-09 14:53:59.270759848 +0000 UTC m=+187.415340832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-registry-tls") pod "image-registry-6bf7d9c4cf-82cd4" (UID: "b67a741a-24b2-4790-9507-23e977da8936") : secret "image-registry-tls" not found Jun 09 14:53:58.771186 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.771125 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b67a741a-24b2-4790-9507-23e977da8936-registry-certificates\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.771658 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.771636 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b67a741a-24b2-4790-9507-23e977da8936-trusted-ca\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.772842 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.772818 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b67a741a-24b2-4790-9507-23e977da8936-image-registry-private-configuration\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.773207 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.773187 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b67a741a-24b2-4790-9507-23e977da8936-installation-pull-secrets\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.780942 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.780918 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-bound-sa-token\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.781136 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.781116 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns48k\" (UniqueName: \"kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-kube-api-access-ns48k\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:58.792911 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.792882 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ngk" Jun 09 14:53:58.832194 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.832035 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-kkp7w"] Jun 09 14:53:58.836073 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:53:58.836042 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab77b52_1ec6_4db7_9452_26d0f6866afe.slice/crio-853fe32a6e59048401d540b8f4455ccd4b1e71d559c3962a4421dbd0d9189af7 WatchSource:0}: Error finding container 853fe32a6e59048401d540b8f4455ccd4b1e71d559c3962a4421dbd0d9189af7: Status 404 returned error can't find the container with id 853fe32a6e59048401d540b8f4455ccd4b1e71d559c3962a4421dbd0d9189af7 Jun 09 14:53:58.904267 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.904229 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" event={"ID":"0ab77b52-1ec6-4db7-9452-26d0f6866afe","Type":"ContainerStarted","Data":"853fe32a6e59048401d540b8f4455ccd4b1e71d559c3962a4421dbd0d9189af7"} Jun 09 14:53:58.918498 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:58.918408 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ngk"] Jun 09 14:53:58.921062 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:53:58.921032 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e837d6a_f29b_4234_b2f3_6ba514e0d332.slice/crio-fdfcf8b29cf2082340304c8125bd3bbdad325126a2b6582339faf6b8ac337dea WatchSource:0}: Error finding container fdfcf8b29cf2082340304c8125bd3bbdad325126a2b6582339faf6b8ac337dea: Status 404 returned error can't find the container with id fdfcf8b29cf2082340304c8125bd3bbdad325126a2b6582339faf6b8ac337dea Jun 09 14:53:59.173332 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:59.173245 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:53:59.173332 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:59.173299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:53:59.173539 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:53:59.173416 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 14:53:59.173539 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:53:59.173463 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle podName:7a9edcb9-728c-4eba-9cdf-cc677ec92497 nodeName:}" failed. No retries permitted until 2026-06-09 14:54:00.173439842 +0000 UTC m=+188.318020808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle") pod "router-default-575b9d94b7-5jjqp" (UID: "7a9edcb9-728c-4eba-9cdf-cc677ec92497") : configmap references non-existent config key: service-ca.crt Jun 09 14:53:59.173539 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:53:59.173520 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs podName:7a9edcb9-728c-4eba-9cdf-cc677ec92497 nodeName:}" failed. No retries permitted until 2026-06-09 14:54:00.173508107 +0000 UTC m=+188.318089073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs") pod "router-default-575b9d94b7-5jjqp" (UID: "7a9edcb9-728c-4eba-9cdf-cc677ec92497") : secret "router-metrics-certs-default" not found Jun 09 14:53:59.274118 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:59.274069 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-registry-tls\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:53:59.274288 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:53:59.274234 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 14:53:59.274288 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:53:59.274255 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bf7d9c4cf-82cd4: secret "image-registry-tls" not found Jun 09 14:53:59.274363 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:53:59.274316 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-registry-tls podName:b67a741a-24b2-4790-9507-23e977da8936 nodeName:}" failed. No retries permitted until 2026-06-09 14:54:00.274300085 +0000 UTC m=+188.418881048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-registry-tls") pod "image-registry-6bf7d9c4cf-82cd4" (UID: "b67a741a-24b2-4790-9507-23e977da8936") : secret "image-registry-tls" not found Jun 09 14:53:59.909330 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:53:59.909288 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ngk" event={"ID":"6e837d6a-f29b-4234-b2f3-6ba514e0d332","Type":"ContainerStarted","Data":"fdfcf8b29cf2082340304c8125bd3bbdad325126a2b6582339faf6b8ac337dea"} Jun 09 14:54:00.183597 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:00.183567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:54:00.183755 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:00.183650 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:54:00.183821 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:00.183761 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 14:54:00.183821 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:00.183773 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle podName:7a9edcb9-728c-4eba-9cdf-cc677ec92497 nodeName:}" failed. No retries permitted until 2026-06-09 14:54:02.183690137 +0000 UTC m=+190.328271115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle") pod "router-default-575b9d94b7-5jjqp" (UID: "7a9edcb9-728c-4eba-9cdf-cc677ec92497") : configmap references non-existent config key: service-ca.crt Jun 09 14:54:00.183821 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:00.183809 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs podName:7a9edcb9-728c-4eba-9cdf-cc677ec92497 nodeName:}" failed. No retries permitted until 2026-06-09 14:54:02.183793128 +0000 UTC m=+190.328374093 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs") pod "router-default-575b9d94b7-5jjqp" (UID: "7a9edcb9-728c-4eba-9cdf-cc677ec92497") : secret "router-metrics-certs-default" not found Jun 09 14:54:00.284206 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:00.284161 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-registry-tls\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:54:00.284391 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:00.284347 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 14:54:00.284391 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:00.284370 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bf7d9c4cf-82cd4: secret "image-registry-tls" not found Jun 09 14:54:00.284528 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:00.284446 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-registry-tls podName:b67a741a-24b2-4790-9507-23e977da8936 nodeName:}" failed. No retries permitted until 2026-06-09 14:54:02.284422635 +0000 UTC m=+190.429003615 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-registry-tls") pod "image-registry-6bf7d9c4cf-82cd4" (UID: "b67a741a-24b2-4790-9507-23e977da8936") : secret "image-registry-tls" not found Jun 09 14:54:00.913698 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:00.913673 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-kkp7w_0ab77b52-1ec6-4db7-9452-26d0f6866afe/console-operator/0.log" Jun 09 14:54:00.914133 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:00.913713 2578 generic.go:356] "Generic (PLEG): container finished" podID="0ab77b52-1ec6-4db7-9452-26d0f6866afe" containerID="4243b21ed21ccdc223712a954233e9b793fad0937803899644078dab8f9cee82" exitCode=255 Jun 09 14:54:00.914133 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:00.913795 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" event={"ID":"0ab77b52-1ec6-4db7-9452-26d0f6866afe","Type":"ContainerDied","Data":"4243b21ed21ccdc223712a954233e9b793fad0937803899644078dab8f9cee82"} Jun 09 14:54:00.914133 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:00.913997 2578 scope.go:117] "RemoveContainer" containerID="4243b21ed21ccdc223712a954233e9b793fad0937803899644078dab8f9cee82" Jun 09 14:54:00.915363 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:00.915339 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ngk" event={"ID":"6e837d6a-f29b-4234-b2f3-6ba514e0d332","Type":"ContainerStarted","Data":"81f5d4e93e0d2d9692dca4bdf13d96d7ae4916eb48798cdbf3cbbe941945ddb3"} Jun 09 14:54:00.945693 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:00.945642 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ngk" podStartSLOduration=1.733077065 podStartE2EDuration="2.945626839s" totalImagesPullingTime="1.212549774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:54:00.944815163 +0000 UTC m=+189.089396148" watchObservedRunningTime="2026-06-09 14:54:00.945626839 +0000 UTC m=+189.090207824" Jun 09 14:54:01.919102 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:01.919074 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-kkp7w_0ab77b52-1ec6-4db7-9452-26d0f6866afe/console-operator/1.log" Jun 09 14:54:01.919544 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:01.919465 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-kkp7w_0ab77b52-1ec6-4db7-9452-26d0f6866afe/console-operator/0.log" Jun 09 14:54:01.919544 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:01.919518 2578 generic.go:356] "Generic (PLEG): container finished" podID="0ab77b52-1ec6-4db7-9452-26d0f6866afe" containerID="9dc540097bd11ac06879f840050cf732767ea33e0f4f07f65426962339520254" exitCode=255 Jun 09 14:54:01.919639 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:01.919588 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" event={"ID":"0ab77b52-1ec6-4db7-9452-26d0f6866afe","Type":"ContainerDied","Data":"9dc540097bd11ac06879f840050cf732767ea33e0f4f07f65426962339520254"} Jun 09 14:54:01.919683 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:01.919652 2578 scope.go:117] "RemoveContainer" containerID="4243b21ed21ccdc223712a954233e9b793fad0937803899644078dab8f9cee82" Jun 09 14:54:01.919858 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:01.919833 2578 scope.go:117] "RemoveContainer" containerID="9dc540097bd11ac06879f840050cf732767ea33e0f4f07f65426962339520254" Jun 09 14:54:01.920024 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:01.920004 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-kkp7w_openshift-console-operator(0ab77b52-1ec6-4db7-9452-26d0f6866afe)\"" pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" podUID="0ab77b52-1ec6-4db7-9452-26d0f6866afe" Jun 09 14:54:02.201121 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:02.201015 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:54:02.201121 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:02.201090 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:54:02.201320 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:02.201176 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 14:54:02.201320 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:02.201176 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle podName:7a9edcb9-728c-4eba-9cdf-cc677ec92497 nodeName:}" failed. No retries permitted until 2026-06-09 14:54:06.201159035 +0000 UTC m=+194.345739998 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle") pod "router-default-575b9d94b7-5jjqp" (UID: "7a9edcb9-728c-4eba-9cdf-cc677ec92497") : configmap references non-existent config key: service-ca.crt Jun 09 14:54:02.201320 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:02.201222 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs podName:7a9edcb9-728c-4eba-9cdf-cc677ec92497 nodeName:}" failed. No retries permitted until 2026-06-09 14:54:06.201212006 +0000 UTC m=+194.345792969 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs") pod "router-default-575b9d94b7-5jjqp" (UID: "7a9edcb9-728c-4eba-9cdf-cc677ec92497") : secret "router-metrics-certs-default" not found Jun 09 14:54:02.302213 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:02.302178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-registry-tls\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:54:02.302360 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:02.302333 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 14:54:02.302360 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:02.302355 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bf7d9c4cf-82cd4: secret "image-registry-tls" not found Jun 09 14:54:02.302593 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:02.302418 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-registry-tls podName:b67a741a-24b2-4790-9507-23e977da8936 nodeName:}" failed. No retries permitted until 2026-06-09 14:54:06.30240003 +0000 UTC m=+194.446980993 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-registry-tls") pod "image-registry-6bf7d9c4cf-82cd4" (UID: "b67a741a-24b2-4790-9507-23e977da8936") : secret "image-registry-tls" not found Jun 09 14:54:02.924527 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:02.924497 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-kkp7w_0ab77b52-1ec6-4db7-9452-26d0f6866afe/console-operator/1.log" Jun 09 14:54:02.924896 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:02.924821 2578 scope.go:117] "RemoveContainer" containerID="9dc540097bd11ac06879f840050cf732767ea33e0f4f07f65426962339520254" Jun 09 14:54:02.924989 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:02.924967 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-kkp7w_openshift-console-operator(0ab77b52-1ec6-4db7-9452-26d0f6866afe)\"" pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" podUID="0ab77b52-1ec6-4db7-9452-26d0f6866afe" Jun 09 14:54:06.233792 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.233752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:54:06.234189 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.233825 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:54:06.234189 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:06.233935 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle podName:7a9edcb9-728c-4eba-9cdf-cc677ec92497 nodeName:}" failed. No retries permitted until 2026-06-09 14:54:14.233916151 +0000 UTC m=+202.378497127 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle") pod "router-default-575b9d94b7-5jjqp" (UID: "7a9edcb9-728c-4eba-9cdf-cc677ec92497") : configmap references non-existent config key: service-ca.crt Jun 09 14:54:06.234189 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:06.233935 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 14:54:06.234189 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:06.233979 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs podName:7a9edcb9-728c-4eba-9cdf-cc677ec92497 nodeName:}" failed. No retries permitted until 2026-06-09 14:54:14.233968488 +0000 UTC m=+202.378549452 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs") pod "router-default-575b9d94b7-5jjqp" (UID: "7a9edcb9-728c-4eba-9cdf-cc677ec92497") : secret "router-metrics-certs-default" not found Jun 09 14:54:06.334219 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.334175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-registry-tls\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:54:06.334380 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:06.334308 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 14:54:06.334380 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:06.334330 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bf7d9c4cf-82cd4: secret "image-registry-tls" not found Jun 09 14:54:06.334380 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:06.334380 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-registry-tls podName:b67a741a-24b2-4790-9507-23e977da8936 nodeName:}" failed. No retries permitted until 2026-06-09 14:54:14.33436611 +0000 UTC m=+202.478947075 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-registry-tls") pod "image-registry-6bf7d9c4cf-82cd4" (UID: "b67a741a-24b2-4790-9507-23e977da8936") : secret "image-registry-tls" not found Jun 09 14:54:06.568367 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.568339 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-t25gc"] Jun 09 14:54:06.571087 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.571073 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-t25gc" Jun 09 14:54:06.573616 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.573591 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 09 14:54:06.573722 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.573611 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 09 14:54:06.574712 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.574695 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 09 14:54:06.574805 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.574784 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-95rlz\"" Jun 09 14:54:06.575369 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.575349 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 09 14:54:06.581152 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.581129 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-t25gc"] Jun 09 14:54:06.737579 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.737537 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jst5b\" (UniqueName: \"kubernetes.io/projected/baeacbfc-88bf-4761-842b-17e711163e85-kube-api-access-jst5b\") pod \"service-ca-7d74d578b8-t25gc\" (UID: \"baeacbfc-88bf-4761-842b-17e711163e85\") " pod="openshift-service-ca/service-ca-7d74d578b8-t25gc" Jun 09 14:54:06.737579 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.737582 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/baeacbfc-88bf-4761-842b-17e711163e85-signing-cabundle\") pod \"service-ca-7d74d578b8-t25gc\" (UID: \"baeacbfc-88bf-4761-842b-17e711163e85\") " pod="openshift-service-ca/service-ca-7d74d578b8-t25gc" Jun 09 14:54:06.737810 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.737615 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/baeacbfc-88bf-4761-842b-17e711163e85-signing-key\") pod \"service-ca-7d74d578b8-t25gc\" (UID: \"baeacbfc-88bf-4761-842b-17e711163e85\") " pod="openshift-service-ca/service-ca-7d74d578b8-t25gc" Jun 09 14:54:06.838005 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.837915 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/baeacbfc-88bf-4761-842b-17e711163e85-signing-key\") pod \"service-ca-7d74d578b8-t25gc\" (UID: \"baeacbfc-88bf-4761-842b-17e711163e85\") " pod="openshift-service-ca/service-ca-7d74d578b8-t25gc" Jun 09 14:54:06.838114 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.838048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jst5b\" (UniqueName: \"kubernetes.io/projected/baeacbfc-88bf-4761-842b-17e711163e85-kube-api-access-jst5b\") pod \"service-ca-7d74d578b8-t25gc\" (UID: \"baeacbfc-88bf-4761-842b-17e711163e85\") " pod="openshift-service-ca/service-ca-7d74d578b8-t25gc" Jun 09 14:54:06.838114 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.838086 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/baeacbfc-88bf-4761-842b-17e711163e85-signing-cabundle\") pod \"service-ca-7d74d578b8-t25gc\" (UID: \"baeacbfc-88bf-4761-842b-17e711163e85\") " pod="openshift-service-ca/service-ca-7d74d578b8-t25gc" Jun 09 14:54:06.838727 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.838707 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/baeacbfc-88bf-4761-842b-17e711163e85-signing-cabundle\") pod \"service-ca-7d74d578b8-t25gc\" (UID: \"baeacbfc-88bf-4761-842b-17e711163e85\") " pod="openshift-service-ca/service-ca-7d74d578b8-t25gc" Jun 09 14:54:06.840428 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.840406 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/baeacbfc-88bf-4761-842b-17e711163e85-signing-key\") pod \"service-ca-7d74d578b8-t25gc\" (UID: \"baeacbfc-88bf-4761-842b-17e711163e85\") " pod="openshift-service-ca/service-ca-7d74d578b8-t25gc" Jun 09 14:54:06.846664 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.846643 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jst5b\" (UniqueName: \"kubernetes.io/projected/baeacbfc-88bf-4761-842b-17e711163e85-kube-api-access-jst5b\") pod \"service-ca-7d74d578b8-t25gc\" (UID: \"baeacbfc-88bf-4761-842b-17e711163e85\") " pod="openshift-service-ca/service-ca-7d74d578b8-t25gc" Jun 09 14:54:06.882539 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:06.882502 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-t25gc" Jun 09 14:54:07.009950 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:07.009913 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-t25gc"] Jun 09 14:54:07.012555 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:54:07.012525 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaeacbfc_88bf_4761_842b_17e711163e85.slice/crio-12444f095b76687382985d17d53f4e47ca0ae4661df2fad36386ea15ffb1c38f WatchSource:0}: Error finding container 12444f095b76687382985d17d53f4e47ca0ae4661df2fad36386ea15ffb1c38f: Status 404 returned error can't find the container with id 12444f095b76687382985d17d53f4e47ca0ae4661df2fad36386ea15ffb1c38f Jun 09 14:54:07.034979 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:07.034953 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xmr49_a0b8851c-1232-44c1-bd3d-7755e87421ee/dns-node-resolver/0.log" Jun 09 14:54:07.942141 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:07.942100 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-t25gc" event={"ID":"baeacbfc-88bf-4761-842b-17e711163e85","Type":"ContainerStarted","Data":"12444f095b76687382985d17d53f4e47ca0ae4661df2fad36386ea15ffb1c38f"} Jun 09 14:54:08.036251 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:08.036222 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cvjp4_40cc8edc-ca98-45ed-ac67-8ccdd0698b5e/node-ca/0.log" Jun 09 14:54:08.635444 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:08.635418 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gcxj7_99263755-4406-4d24-a336-6ece74ce3e0f/serve-healthcheck-canary/0.log" Jun 09 14:54:08.706097 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:08.706053 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" Jun 09 14:54:08.706288 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:08.706115 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" Jun 09 14:54:08.706578 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:08.706562 2578 scope.go:117] "RemoveContainer" containerID="9dc540097bd11ac06879f840050cf732767ea33e0f4f07f65426962339520254" Jun 09 14:54:08.706766 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:08.706742 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-kkp7w_openshift-console-operator(0ab77b52-1ec6-4db7-9452-26d0f6866afe)\"" pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" podUID="0ab77b52-1ec6-4db7-9452-26d0f6866afe" Jun 09 14:54:09.950183 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:09.950147 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-t25gc" event={"ID":"baeacbfc-88bf-4761-842b-17e711163e85","Type":"ContainerStarted","Data":"d3504af7ca202c1a25ec063ea52b5b6d2cac1e9313b6d48d08168e2607fd6b61"} Jun 09 14:54:09.968219 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:09.968170 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-t25gc" podStartSLOduration=1.967229268 podStartE2EDuration="3.968154243s" totalImagesPullingTime="2.000924975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:54:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:54:09.967553752 +0000 UTC m=+198.112134738" watchObservedRunningTime="2026-06-09 14:54:09.968154243 +0000 UTC m=+198.112735269" Jun 09 14:54:14.298751 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:14.298705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:54:14.299129 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:14.298763 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:54:14.299129 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:14.298854 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 14:54:14.299129 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:14.298869 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle podName:7a9edcb9-728c-4eba-9cdf-cc677ec92497 nodeName:}" failed. No retries permitted until 2026-06-09 14:54:30.298853817 +0000 UTC m=+218.443434780 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle") pod "router-default-575b9d94b7-5jjqp" (UID: "7a9edcb9-728c-4eba-9cdf-cc677ec92497") : configmap references non-existent config key: service-ca.crt Jun 09 14:54:14.299129 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:14.298916 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs podName:7a9edcb9-728c-4eba-9cdf-cc677ec92497 nodeName:}" failed. No retries permitted until 2026-06-09 14:54:30.298901722 +0000 UTC m=+218.443482685 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs") pod "router-default-575b9d94b7-5jjqp" (UID: "7a9edcb9-728c-4eba-9cdf-cc677ec92497") : secret "router-metrics-certs-default" not found Jun 09 14:54:14.399970 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:14.399934 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-registry-tls\") pod \"image-registry-6bf7d9c4cf-82cd4\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:54:14.400151 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:14.400052 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 14:54:14.400151 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:14.400063 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bf7d9c4cf-82cd4: secret "image-registry-tls" not found Jun 09 14:54:14.400151 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:14.400118 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-registry-tls podName:b67a741a-24b2-4790-9507-23e977da8936 nodeName:}" failed. No retries permitted until 2026-06-09 14:54:30.400105811 +0000 UTC m=+218.544686774 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-registry-tls") pod "image-registry-6bf7d9c4cf-82cd4" (UID: "b67a741a-24b2-4790-9507-23e977da8936") : secret "image-registry-tls" not found Jun 09 14:54:23.334756 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:23.334721 2578 scope.go:117] "RemoveContainer" containerID="9dc540097bd11ac06879f840050cf732767ea33e0f4f07f65426962339520254" Jun 09 14:54:23.997370 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:23.997311 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-kkp7w_0ab77b52-1ec6-4db7-9452-26d0f6866afe/console-operator/1.log" Jun 09 14:54:23.997575 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:23.997409 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" event={"ID":"0ab77b52-1ec6-4db7-9452-26d0f6866afe","Type":"ContainerStarted","Data":"105ab6d51c376e360f8562d689813c1b357c3f5e43b977afe49fb0168dc0a5b0"} Jun 09 14:54:23.997725 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:23.997706 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" Jun 09 14:54:24.002454 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:24.002436 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" Jun 09 14:54:24.051249 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:24.051195 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-kkp7w" podStartSLOduration=24.136752807 podStartE2EDuration="26.051177306s" totalImagesPullingTime="1.914424499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:54:24.028315419 +0000 UTC m=+212.172896405" watchObservedRunningTime="2026-06-09 14:54:24.051177306 +0000 UTC m=+212.195758291" Jun 09 14:54:27.841312 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:27.841277 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g6tvn"] Jun 09 14:54:27.843979 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:27.843964 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g6tvn" Jun 09 14:54:27.847101 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:27.847072 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 14:54:27.847244 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:27.847108 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 14:54:27.847244 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:27.847133 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 14:54:27.847244 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:27.847226 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tghxs\"" Jun 09 14:54:27.847502 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:27.847485 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 14:54:27.859293 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:27.859186 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g6tvn"] Jun 09 14:54:27.883191 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:27.883162 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-v7xmv"] Jun 09 14:54:27.885318 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:27.885304 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-v7xmv" Jun 09 14:54:27.888064 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:27.888043 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nvskl\"" Jun 09 14:54:27.888275 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:27.888262 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 14:54:27.888340 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:27.888306 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 14:54:27.896219 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:27.896197 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-v7xmv"] Jun 09 14:54:27.899790 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:27.899767 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bf7d9c4cf-82cd4"] Jun 09 14:54:27.900009 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:27.899984 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" podUID="b67a741a-24b2-4790-9507-23e977da8936" Jun 09 14:54:27.902002 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:27.901980 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2ea92f8-20bf-42bd-a300-b23e6997f3b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g6tvn\" (UID: \"a2ea92f8-20bf-42bd-a300-b23e6997f3b0\") " pod="openshift-insights/insights-runtime-extractor-g6tvn" Jun 09 14:54:27.902084 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:27.902031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2ea92f8-20bf-42bd-a300-b23e6997f3b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g6tvn\" (UID: \"a2ea92f8-20bf-42bd-a300-b23e6997f3b0\") " pod="openshift-insights/insights-runtime-extractor-g6tvn" Jun 09 14:54:27.902125 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:27.902081 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2ea92f8-20bf-42bd-a300-b23e6997f3b0-data-volume\") pod \"insights-runtime-extractor-g6tvn\" (UID: \"a2ea92f8-20bf-42bd-a300-b23e6997f3b0\") " pod="openshift-insights/insights-runtime-extractor-g6tvn" Jun 09 14:54:27.902125 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:27.902100 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a2ea92f8-20bf-42bd-a300-b23e6997f3b0-crio-socket\") pod \"insights-runtime-extractor-g6tvn\" (UID: \"a2ea92f8-20bf-42bd-a300-b23e6997f3b0\") " pod="openshift-insights/insights-runtime-extractor-g6tvn" Jun 09 14:54:27.902191 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:27.902176 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt986\" (UniqueName: \"kubernetes.io/projected/a2ea92f8-20bf-42bd-a300-b23e6997f3b0-kube-api-access-dt986\") pod \"insights-runtime-extractor-g6tvn\" (UID: \"a2ea92f8-20bf-42bd-a300-b23e6997f3b0\") " pod="openshift-insights/insights-runtime-extractor-g6tvn" Jun 09 14:54:28.003251 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.003219 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnh9b\" (UniqueName: \"kubernetes.io/projected/a283f045-0274-4381-8226-bc3824379571-kube-api-access-qnh9b\") pod \"downloads-6657875f97-v7xmv\" (UID: \"a283f045-0274-4381-8226-bc3824379571\") " pod="openshift-console/downloads-6657875f97-v7xmv" Jun 09 14:54:28.003251 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.003258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2ea92f8-20bf-42bd-a300-b23e6997f3b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g6tvn\" (UID: \"a2ea92f8-20bf-42bd-a300-b23e6997f3b0\") " pod="openshift-insights/insights-runtime-extractor-g6tvn" Jun 09 14:54:28.003494 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.003383 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2ea92f8-20bf-42bd-a300-b23e6997f3b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g6tvn\" (UID: \"a2ea92f8-20bf-42bd-a300-b23e6997f3b0\") " pod="openshift-insights/insights-runtime-extractor-g6tvn" Jun 09 14:54:28.003494 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.003420 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2ea92f8-20bf-42bd-a300-b23e6997f3b0-data-volume\") pod \"insights-runtime-extractor-g6tvn\" (UID: \"a2ea92f8-20bf-42bd-a300-b23e6997f3b0\") " pod="openshift-insights/insights-runtime-extractor-g6tvn" Jun 09 14:54:28.003494 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.003442 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a2ea92f8-20bf-42bd-a300-b23e6997f3b0-crio-socket\") pod \"insights-runtime-extractor-g6tvn\" (UID: \"a2ea92f8-20bf-42bd-a300-b23e6997f3b0\") " pod="openshift-insights/insights-runtime-extractor-g6tvn" Jun 09 14:54:28.003633 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.003528 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt986\" (UniqueName: \"kubernetes.io/projected/a2ea92f8-20bf-42bd-a300-b23e6997f3b0-kube-api-access-dt986\") pod \"insights-runtime-extractor-g6tvn\" (UID: \"a2ea92f8-20bf-42bd-a300-b23e6997f3b0\") " pod="openshift-insights/insights-runtime-extractor-g6tvn" Jun 09 14:54:28.003633 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.003555 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a2ea92f8-20bf-42bd-a300-b23e6997f3b0-crio-socket\") pod \"insights-runtime-extractor-g6tvn\" (UID: \"a2ea92f8-20bf-42bd-a300-b23e6997f3b0\") " pod="openshift-insights/insights-runtime-extractor-g6tvn" Jun 09 14:54:28.003761 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.003740 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2ea92f8-20bf-42bd-a300-b23e6997f3b0-data-volume\") pod \"insights-runtime-extractor-g6tvn\" (UID: \"a2ea92f8-20bf-42bd-a300-b23e6997f3b0\") " pod="openshift-insights/insights-runtime-extractor-g6tvn" Jun 09 14:54:28.003800 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.003784 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2ea92f8-20bf-42bd-a300-b23e6997f3b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g6tvn\" (UID: \"a2ea92f8-20bf-42bd-a300-b23e6997f3b0\") " pod="openshift-insights/insights-runtime-extractor-g6tvn" Jun 09 14:54:28.006242 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.006217 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2ea92f8-20bf-42bd-a300-b23e6997f3b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g6tvn\" (UID: \"a2ea92f8-20bf-42bd-a300-b23e6997f3b0\") " pod="openshift-insights/insights-runtime-extractor-g6tvn" Jun 09 14:54:28.008210 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.008185 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:54:28.016133 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.016117 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:54:28.018273 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.018255 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt986\" (UniqueName: \"kubernetes.io/projected/a2ea92f8-20bf-42bd-a300-b23e6997f3b0-kube-api-access-dt986\") pod \"insights-runtime-extractor-g6tvn\" (UID: \"a2ea92f8-20bf-42bd-a300-b23e6997f3b0\") " pod="openshift-insights/insights-runtime-extractor-g6tvn" Jun 09 14:54:28.104651 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.104568 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns48k\" (UniqueName: \"kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-kube-api-access-ns48k\") pod \"b67a741a-24b2-4790-9507-23e977da8936\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " Jun 09 14:54:28.104651 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.104621 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b67a741a-24b2-4790-9507-23e977da8936-trusted-ca\") pod \"b67a741a-24b2-4790-9507-23e977da8936\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " Jun 09 14:54:28.104651 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.104649 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b67a741a-24b2-4790-9507-23e977da8936-image-registry-private-configuration\") pod \"b67a741a-24b2-4790-9507-23e977da8936\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " Jun 09 14:54:28.104893 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.104770 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b67a741a-24b2-4790-9507-23e977da8936-ca-trust-extracted\") pod \"b67a741a-24b2-4790-9507-23e977da8936\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " Jun 09 14:54:28.104893 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.104802 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-bound-sa-token\") pod \"b67a741a-24b2-4790-9507-23e977da8936\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " Jun 09 14:54:28.104893 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.104836 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b67a741a-24b2-4790-9507-23e977da8936-registry-certificates\") pod \"b67a741a-24b2-4790-9507-23e977da8936\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " Jun 09 14:54:28.104893 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.104882 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b67a741a-24b2-4790-9507-23e977da8936-installation-pull-secrets\") pod \"b67a741a-24b2-4790-9507-23e977da8936\" (UID: \"b67a741a-24b2-4790-9507-23e977da8936\") " Jun 09 14:54:28.105098 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.105014 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b67a741a-24b2-4790-9507-23e977da8936-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b67a741a-24b2-4790-9507-23e977da8936" (UID: "b67a741a-24b2-4790-9507-23e977da8936"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:54:28.105098 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.105034 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b67a741a-24b2-4790-9507-23e977da8936-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b67a741a-24b2-4790-9507-23e977da8936" (UID: "b67a741a-24b2-4790-9507-23e977da8936"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:54:28.105098 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.105056 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnh9b\" (UniqueName: \"kubernetes.io/projected/a283f045-0274-4381-8226-bc3824379571-kube-api-access-qnh9b\") pod \"downloads-6657875f97-v7xmv\" (UID: \"a283f045-0274-4381-8226-bc3824379571\") " pod="openshift-console/downloads-6657875f97-v7xmv" Jun 09 14:54:28.105235 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.105193 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b67a741a-24b2-4790-9507-23e977da8936-ca-trust-extracted\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:54:28.105235 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.105211 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b67a741a-24b2-4790-9507-23e977da8936-trusted-ca\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:54:28.105323 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.105243 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b67a741a-24b2-4790-9507-23e977da8936-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b67a741a-24b2-4790-9507-23e977da8936" (UID: "b67a741a-24b2-4790-9507-23e977da8936"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:54:28.107143 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.107109 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b67a741a-24b2-4790-9507-23e977da8936-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b67a741a-24b2-4790-9507-23e977da8936" (UID: "b67a741a-24b2-4790-9507-23e977da8936"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:54:28.107143 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.107124 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-kube-api-access-ns48k" (OuterVolumeSpecName: "kube-api-access-ns48k") pod "b67a741a-24b2-4790-9507-23e977da8936" (UID: "b67a741a-24b2-4790-9507-23e977da8936"). InnerVolumeSpecName "kube-api-access-ns48k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:54:28.107143 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.107110 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b67a741a-24b2-4790-9507-23e977da8936" (UID: "b67a741a-24b2-4790-9507-23e977da8936"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:54:28.107347 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.107202 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b67a741a-24b2-4790-9507-23e977da8936-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b67a741a-24b2-4790-9507-23e977da8936" (UID: "b67a741a-24b2-4790-9507-23e977da8936"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:54:28.119736 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.119711 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnh9b\" (UniqueName: \"kubernetes.io/projected/a283f045-0274-4381-8226-bc3824379571-kube-api-access-qnh9b\") pod \"downloads-6657875f97-v7xmv\" (UID: \"a283f045-0274-4381-8226-bc3824379571\") " pod="openshift-console/downloads-6657875f97-v7xmv" Jun 09 14:54:28.152678 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.152645 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g6tvn" Jun 09 14:54:28.194359 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.194329 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-v7xmv" Jun 09 14:54:28.206568 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.206539 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-bound-sa-token\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:54:28.206568 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.206564 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b67a741a-24b2-4790-9507-23e977da8936-registry-certificates\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:54:28.206568 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.206576 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b67a741a-24b2-4790-9507-23e977da8936-installation-pull-secrets\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:54:28.206828 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.206588 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns48k\" (UniqueName: \"kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-kube-api-access-ns48k\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:54:28.206828 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.206599 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b67a741a-24b2-4790-9507-23e977da8936-image-registry-private-configuration\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:54:28.285031 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.285000 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g6tvn"] Jun 09 14:54:28.288492 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:54:28.288442 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ea92f8_20bf_42bd_a300_b23e6997f3b0.slice/crio-3d80e2938e19afd24d465c5ba030b70cfde5b3b0824e0c98bdbdb8f6848b015c WatchSource:0}: Error finding container 3d80e2938e19afd24d465c5ba030b70cfde5b3b0824e0c98bdbdb8f6848b015c: Status 404 returned error can't find the container with id 3d80e2938e19afd24d465c5ba030b70cfde5b3b0824e0c98bdbdb8f6848b015c Jun 09 14:54:28.338328 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:28.338299 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-v7xmv"] Jun 09 14:54:28.339491 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:54:28.339454 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda283f045_0274_4381_8226_bc3824379571.slice/crio-7b4e6608eb0edf31d508a1b58242a4de35c496371ac4e1dc4ee1e46ec2a0960d WatchSource:0}: Error finding container 7b4e6608eb0edf31d508a1b58242a4de35c496371ac4e1dc4ee1e46ec2a0960d: Status 404 returned error can't find the container with id 7b4e6608eb0edf31d508a1b58242a4de35c496371ac4e1dc4ee1e46ec2a0960d Jun 09 14:54:29.012370 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:29.012340 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g6tvn" event={"ID":"a2ea92f8-20bf-42bd-a300-b23e6997f3b0","Type":"ContainerStarted","Data":"077864461e0ed9b98f004ce3ec98294cf4ff4ed942d176636e262ad04d54b4b9"} Jun 09 14:54:29.012710 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:29.012437 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g6tvn" event={"ID":"a2ea92f8-20bf-42bd-a300-b23e6997f3b0","Type":"ContainerStarted","Data":"495b0d701699e1581467f6f855934a40f876bd5f656af9f9e5185bd6810a4192"} Jun 09 14:54:29.012710 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:29.012460 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g6tvn" event={"ID":"a2ea92f8-20bf-42bd-a300-b23e6997f3b0","Type":"ContainerStarted","Data":"3d80e2938e19afd24d465c5ba030b70cfde5b3b0824e0c98bdbdb8f6848b015c"} Jun 09 14:54:29.013522 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:29.013498 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-v7xmv" event={"ID":"a283f045-0274-4381-8226-bc3824379571","Type":"ContainerStarted","Data":"7b4e6608eb0edf31d508a1b58242a4de35c496371ac4e1dc4ee1e46ec2a0960d"} Jun 09 14:54:29.013522 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:29.013521 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bf7d9c4cf-82cd4" Jun 09 14:54:29.044537 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:29.044514 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bf7d9c4cf-82cd4"] Jun 09 14:54:29.048239 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:29.048217 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bf7d9c4cf-82cd4"] Jun 09 14:54:29.114746 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:29.114713 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b67a741a-24b2-4790-9507-23e977da8936-registry-tls\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:54:30.324774 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:30.324742 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:54:30.325232 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:30.324791 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:54:30.325519 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:30.325491 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9edcb9-728c-4eba-9cdf-cc677ec92497-service-ca-bundle\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:54:30.327748 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:30.327722 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9edcb9-728c-4eba-9cdf-cc677ec92497-metrics-certs\") pod \"router-default-575b9d94b7-5jjqp\" (UID: \"7a9edcb9-728c-4eba-9cdf-cc677ec92497\") " pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:54:30.338992 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:30.338964 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b67a741a-24b2-4790-9507-23e977da8936" path="/var/lib/kubelet/pods/b67a741a-24b2-4790-9507-23e977da8936/volumes" Jun 09 14:54:30.510719 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:30.510666 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:54:30.682666 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:30.682640 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-575b9d94b7-5jjqp"] Jun 09 14:54:30.686964 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:54:30.686938 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a9edcb9_728c_4eba_9cdf_cc677ec92497.slice/crio-fa108c87555cc84d94fed3a9b70d2156afad72f988e33435264bdcbfa24d2a59 WatchSource:0}: Error finding container fa108c87555cc84d94fed3a9b70d2156afad72f988e33435264bdcbfa24d2a59: Status 404 returned error can't find the container with id fa108c87555cc84d94fed3a9b70d2156afad72f988e33435264bdcbfa24d2a59 Jun 09 14:54:31.023057 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:31.022968 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-575b9d94b7-5jjqp" event={"ID":"7a9edcb9-728c-4eba-9cdf-cc677ec92497","Type":"ContainerStarted","Data":"1f5348b74a8c5d9beeb19fea89b756ada6c27c818456fa36998a0510f392e87d"} Jun 09 14:54:31.023057 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:31.023024 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-575b9d94b7-5jjqp" event={"ID":"7a9edcb9-728c-4eba-9cdf-cc677ec92497","Type":"ContainerStarted","Data":"fa108c87555cc84d94fed3a9b70d2156afad72f988e33435264bdcbfa24d2a59"} Jun 09 14:54:31.025233 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:31.025209 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g6tvn" event={"ID":"a2ea92f8-20bf-42bd-a300-b23e6997f3b0","Type":"ContainerStarted","Data":"40c4135d0b9755f236bbf77667da319450c149a632fbe966466650beb73698ae"} Jun 09 14:54:31.045412 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:31.045355 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-575b9d94b7-5jjqp" podStartSLOduration=33.04533627 podStartE2EDuration="33.04533627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:53:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:54:31.044725277 +0000 UTC m=+219.189306262" watchObservedRunningTime="2026-06-09 14:54:31.04533627 +0000 UTC m=+219.189917256" Jun 09 14:54:31.063682 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:31.063635 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g6tvn" podStartSLOduration=1.8643087600000001 podStartE2EDuration="4.063621728s" totalImagesPullingTime="2.199312968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:54:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:54:31.06270665 +0000 UTC m=+219.207287661" watchObservedRunningTime="2026-06-09 14:54:31.063621728 +0000 UTC m=+219.208202713" Jun 09 14:54:31.511548 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:31.511511 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:54:31.514118 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:31.514099 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:54:32.028532 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:32.028491 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:54:32.029666 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:32.029642 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-575b9d94b7-5jjqp" Jun 09 14:54:33.246276 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.246241 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gldbb"] Jun 09 14:54:33.249268 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.249234 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gldbb" Jun 09 14:54:33.252004 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.251984 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 14:54:33.252287 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.252271 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rw8bk\"" Jun 09 14:54:33.258118 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.258098 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gldbb"] Jun 09 14:54:33.349815 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.349764 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/125c19c4-f673-4012-91bd-0a904247d816-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-gldbb\" (UID: \"125c19c4-f673-4012-91bd-0a904247d816\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gldbb" Jun 09 14:54:33.450288 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.450255 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/125c19c4-f673-4012-91bd-0a904247d816-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-gldbb\" (UID: \"125c19c4-f673-4012-91bd-0a904247d816\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gldbb" Jun 09 14:54:33.450495 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:33.450422 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 09 14:54:33.450559 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:33.450523 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/125c19c4-f673-4012-91bd-0a904247d816-tls-certificates podName:125c19c4-f673-4012-91bd-0a904247d816 nodeName:}" failed. No retries permitted until 2026-06-09 14:54:33.950499559 +0000 UTC m=+222.095080523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/125c19c4-f673-4012-91bd-0a904247d816-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-gldbb" (UID: "125c19c4-f673-4012-91bd-0a904247d816") : secret "prometheus-operator-admission-webhook-tls" not found Jun 09 14:54:33.475723 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.475677 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9ff488864-c5rqs"] Jun 09 14:54:33.478415 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.478394 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:33.481169 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.481147 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 14:54:33.481322 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.481298 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 14:54:33.481498 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.481443 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 14:54:33.481498 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.481463 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2p9hj\"" Jun 09 14:54:33.481642 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.481513 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 14:54:33.481786 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.481771 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 14:54:33.489570 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.489544 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9ff488864-c5rqs"] Jun 09 14:54:33.551603 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.551510 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31c9b17f-a758-4e02-b230-12364ca6d85e-oauth-serving-cert\") pod \"console-9ff488864-c5rqs\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:33.551603 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.551594 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7hng\" (UniqueName: \"kubernetes.io/projected/31c9b17f-a758-4e02-b230-12364ca6d85e-kube-api-access-m7hng\") pod \"console-9ff488864-c5rqs\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:33.551836 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.551634 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31c9b17f-a758-4e02-b230-12364ca6d85e-console-oauth-config\") pod \"console-9ff488864-c5rqs\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:33.551836 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.551666 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31c9b17f-a758-4e02-b230-12364ca6d85e-console-serving-cert\") pod \"console-9ff488864-c5rqs\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:33.551836 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.551725 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31c9b17f-a758-4e02-b230-12364ca6d85e-service-ca\") pod \"console-9ff488864-c5rqs\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:33.551836 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.551800 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31c9b17f-a758-4e02-b230-12364ca6d85e-console-config\") pod \"console-9ff488864-c5rqs\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:33.652962 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.652923 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31c9b17f-a758-4e02-b230-12364ca6d85e-console-config\") pod \"console-9ff488864-c5rqs\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:33.653235 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.653004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31c9b17f-a758-4e02-b230-12364ca6d85e-oauth-serving-cert\") pod \"console-9ff488864-c5rqs\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:33.653235 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.653044 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7hng\" (UniqueName: \"kubernetes.io/projected/31c9b17f-a758-4e02-b230-12364ca6d85e-kube-api-access-m7hng\") pod \"console-9ff488864-c5rqs\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:33.653235 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.653077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31c9b17f-a758-4e02-b230-12364ca6d85e-console-oauth-config\") pod \"console-9ff488864-c5rqs\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:33.653235 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.653188 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31c9b17f-a758-4e02-b230-12364ca6d85e-console-serving-cert\") pod \"console-9ff488864-c5rqs\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:33.653505 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.653240 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31c9b17f-a758-4e02-b230-12364ca6d85e-service-ca\") pod \"console-9ff488864-c5rqs\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:33.654100 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.654076 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31c9b17f-a758-4e02-b230-12364ca6d85e-oauth-serving-cert\") pod \"console-9ff488864-c5rqs\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:33.654212 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.654099 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31c9b17f-a758-4e02-b230-12364ca6d85e-console-config\") pod \"console-9ff488864-c5rqs\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:33.654268 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.654205 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31c9b17f-a758-4e02-b230-12364ca6d85e-service-ca\") pod \"console-9ff488864-c5rqs\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:33.656086 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.656050 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31c9b17f-a758-4e02-b230-12364ca6d85e-console-oauth-config\") pod \"console-9ff488864-c5rqs\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:33.656918 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.656897 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31c9b17f-a758-4e02-b230-12364ca6d85e-console-serving-cert\") pod \"console-9ff488864-c5rqs\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:33.662455 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.662427 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7hng\" (UniqueName: \"kubernetes.io/projected/31c9b17f-a758-4e02-b230-12364ca6d85e-kube-api-access-m7hng\") pod \"console-9ff488864-c5rqs\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:33.789603 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.789565 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:33.944001 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.943972 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9ff488864-c5rqs"] Jun 09 14:54:33.946989 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:54:33.946956 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c9b17f_a758_4e02_b230_12364ca6d85e.slice/crio-4b49e30f155ee42313536329199f53f6b7569954727e5a6aa7b13a09d6ddf2eb WatchSource:0}: Error finding container 4b49e30f155ee42313536329199f53f6b7569954727e5a6aa7b13a09d6ddf2eb: Status 404 returned error can't find the container with id 4b49e30f155ee42313536329199f53f6b7569954727e5a6aa7b13a09d6ddf2eb Jun 09 14:54:33.956338 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.956303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/125c19c4-f673-4012-91bd-0a904247d816-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-gldbb\" (UID: \"125c19c4-f673-4012-91bd-0a904247d816\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gldbb" Jun 09 14:54:33.958760 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:33.958741 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/125c19c4-f673-4012-91bd-0a904247d816-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-gldbb\" (UID: \"125c19c4-f673-4012-91bd-0a904247d816\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gldbb" Jun 09 14:54:34.037274 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:34.037221 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9ff488864-c5rqs" event={"ID":"31c9b17f-a758-4e02-b230-12364ca6d85e","Type":"ContainerStarted","Data":"4b49e30f155ee42313536329199f53f6b7569954727e5a6aa7b13a09d6ddf2eb"} Jun 09 14:54:34.160518 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:34.160434 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gldbb" Jun 09 14:54:34.297042 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:34.296867 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gldbb"] Jun 09 14:54:34.299691 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:54:34.299667 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod125c19c4_f673_4012_91bd_0a904247d816.slice/crio-955995c77f68078f4ae3615cb79e7efb4ce0e19e085286622a484c97f287e850 WatchSource:0}: Error finding container 955995c77f68078f4ae3615cb79e7efb4ce0e19e085286622a484c97f287e850: Status 404 returned error can't find the container with id 955995c77f68078f4ae3615cb79e7efb4ce0e19e085286622a484c97f287e850 Jun 09 14:54:35.043460 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:35.043409 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gldbb" event={"ID":"125c19c4-f673-4012-91bd-0a904247d816","Type":"ContainerStarted","Data":"955995c77f68078f4ae3615cb79e7efb4ce0e19e085286622a484c97f287e850"} Jun 09 14:54:36.049917 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:36.049878 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gldbb" event={"ID":"125c19c4-f673-4012-91bd-0a904247d816","Type":"ContainerStarted","Data":"5a16c3d7eeea643a966eff82e7a762bd6bbc7d454de4bb9c8f8b11da1a7815cd"} Jun 09 14:54:36.050444 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:36.050115 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gldbb" Jun 09 14:54:36.055986 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:36.055961 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gldbb" Jun 09 14:54:36.066161 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:36.066115 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gldbb" podStartSLOduration=1.807028457 podStartE2EDuration="3.066095708s" totalImagesPullingTime="1.259067251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:54:36.065221649 +0000 UTC m=+224.209802635" watchObservedRunningTime="2026-06-09 14:54:36.066095708 +0000 UTC m=+224.210676694" Jun 09 14:54:38.060551 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:38.060450 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9ff488864-c5rqs" event={"ID":"31c9b17f-a758-4e02-b230-12364ca6d85e","Type":"ContainerStarted","Data":"756894000eb5d22d1142c03db005874b99db191ca0f3b1848978123f1ecf5822"} Jun 09 14:54:38.080929 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:38.080878 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9ff488864-c5rqs" podStartSLOduration=1.3421703329999999 podStartE2EDuration="5.080860608s" totalImagesPullingTime="3.738690275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:54:38.080230616 +0000 UTC m=+226.224811600" watchObservedRunningTime="2026-06-09 14:54:38.080860608 +0000 UTC m=+226.225441595" Jun 09 14:54:40.652709 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.652671 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc"] Jun 09 14:54:40.657844 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.656808 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc" Jun 09 14:54:40.661697 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.661007 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 14:54:40.661697 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.661247 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-m6s9x\"" Jun 09 14:54:40.662987 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.662391 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 14:54:40.662987 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.662686 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 14:54:40.662987 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.662847 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 14:54:40.662987 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.662964 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 14:54:40.673090 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.672984 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc"] Jun 09 14:54:40.696764 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.696312 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zv5wf"] Jun 09 14:54:40.699835 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.699811 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.707552 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.707497 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 14:54:40.707968 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.707946 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 14:54:40.708397 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.708179 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 14:54:40.708397 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.708048 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-77t79\"" Jun 09 14:54:40.718423 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.718394 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8f29f61-478a-4b35-a379-5de150730980-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-z9vlc\" (UID: \"e8f29f61-478a-4b35-a379-5de150730980\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc" Jun 09 14:54:40.718562 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.718438 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8f29f61-478a-4b35-a379-5de150730980-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-z9vlc\" (UID: \"e8f29f61-478a-4b35-a379-5de150730980\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc" Jun 09 14:54:40.718562 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.718506 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8f29f61-478a-4b35-a379-5de150730980-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-z9vlc\" (UID: \"e8f29f61-478a-4b35-a379-5de150730980\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc" Jun 09 14:54:40.718562 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.718543 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4sjp\" (UniqueName: \"kubernetes.io/projected/e8f29f61-478a-4b35-a379-5de150730980-kube-api-access-q4sjp\") pod \"openshift-state-metrics-65f78d5c66-z9vlc\" (UID: \"e8f29f61-478a-4b35-a379-5de150730980\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc" Jun 09 14:54:40.819192 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.819152 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qgrf\" (UniqueName: \"kubernetes.io/projected/a377faaa-04b5-46d3-9195-1bea36f5ab97-kube-api-access-4qgrf\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.819395 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.819211 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4sjp\" (UniqueName: \"kubernetes.io/projected/e8f29f61-478a-4b35-a379-5de150730980-kube-api-access-q4sjp\") pod \"openshift-state-metrics-65f78d5c66-z9vlc\" (UID: \"e8f29f61-478a-4b35-a379-5de150730980\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc" Jun 09 14:54:40.819395 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.819249 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a377faaa-04b5-46d3-9195-1bea36f5ab97-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.819395 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.819314 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a377faaa-04b5-46d3-9195-1bea36f5ab97-node-exporter-textfile\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.819585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.819425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a377faaa-04b5-46d3-9195-1bea36f5ab97-root\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.819585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.819497 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a377faaa-04b5-46d3-9195-1bea36f5ab97-sys\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.819585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.819527 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a377faaa-04b5-46d3-9195-1bea36f5ab97-node-exporter-tls\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.819585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.819566 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a377faaa-04b5-46d3-9195-1bea36f5ab97-metrics-client-ca\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.819781 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.819611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8f29f61-478a-4b35-a379-5de150730980-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-z9vlc\" (UID: \"e8f29f61-478a-4b35-a379-5de150730980\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc" Jun 09 14:54:40.819781 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.819646 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8f29f61-478a-4b35-a379-5de150730980-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-z9vlc\" (UID: \"e8f29f61-478a-4b35-a379-5de150730980\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc" Jun 09 14:54:40.819781 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.819697 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a377faaa-04b5-46d3-9195-1bea36f5ab97-node-exporter-wtmp\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.819781 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.819734 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a377faaa-04b5-46d3-9195-1bea36f5ab97-node-exporter-accelerators-collector-config\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.819969 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.819788 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8f29f61-478a-4b35-a379-5de150730980-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-z9vlc\" (UID: \"e8f29f61-478a-4b35-a379-5de150730980\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc" Jun 09 14:54:40.820429 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.820369 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8f29f61-478a-4b35-a379-5de150730980-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-z9vlc\" (UID: \"e8f29f61-478a-4b35-a379-5de150730980\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc" Jun 09 14:54:40.822649 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.822624 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8f29f61-478a-4b35-a379-5de150730980-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-z9vlc\" (UID: \"e8f29f61-478a-4b35-a379-5de150730980\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc" Jun 09 14:54:40.822649 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.822638 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8f29f61-478a-4b35-a379-5de150730980-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-z9vlc\" (UID: \"e8f29f61-478a-4b35-a379-5de150730980\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc" Jun 09 14:54:40.836383 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.836351 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4sjp\" (UniqueName: \"kubernetes.io/projected/e8f29f61-478a-4b35-a379-5de150730980-kube-api-access-q4sjp\") pod \"openshift-state-metrics-65f78d5c66-z9vlc\" (UID: \"e8f29f61-478a-4b35-a379-5de150730980\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc" Jun 09 14:54:40.920674 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.920575 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a377faaa-04b5-46d3-9195-1bea36f5ab97-metrics-client-ca\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.920674 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.920652 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a377faaa-04b5-46d3-9195-1bea36f5ab97-node-exporter-wtmp\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.920907 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.920683 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a377faaa-04b5-46d3-9195-1bea36f5ab97-node-exporter-accelerators-collector-config\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.920907 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.920751 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qgrf\" (UniqueName: \"kubernetes.io/projected/a377faaa-04b5-46d3-9195-1bea36f5ab97-kube-api-access-4qgrf\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.920907 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.920784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a377faaa-04b5-46d3-9195-1bea36f5ab97-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.920907 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.920808 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a377faaa-04b5-46d3-9195-1bea36f5ab97-node-exporter-textfile\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.920907 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.920833 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a377faaa-04b5-46d3-9195-1bea36f5ab97-root\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.921142 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.920876 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a377faaa-04b5-46d3-9195-1bea36f5ab97-node-exporter-wtmp\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.921142 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.920878 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a377faaa-04b5-46d3-9195-1bea36f5ab97-sys\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.921142 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.920971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a377faaa-04b5-46d3-9195-1bea36f5ab97-node-exporter-tls\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.921329 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.921253 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a377faaa-04b5-46d3-9195-1bea36f5ab97-node-exporter-textfile\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.921329 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.921271 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a377faaa-04b5-46d3-9195-1bea36f5ab97-root\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.921329 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.921274 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a377faaa-04b5-46d3-9195-1bea36f5ab97-metrics-client-ca\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.921329 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.921311 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a377faaa-04b5-46d3-9195-1bea36f5ab97-node-exporter-accelerators-collector-config\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.921329 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.921320 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a377faaa-04b5-46d3-9195-1bea36f5ab97-sys\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.923824 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.923799 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a377faaa-04b5-46d3-9195-1bea36f5ab97-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.923982 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.923962 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a377faaa-04b5-46d3-9195-1bea36f5ab97-node-exporter-tls\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.933111 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.933087 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qgrf\" (UniqueName: \"kubernetes.io/projected/a377faaa-04b5-46d3-9195-1bea36f5ab97-kube-api-access-4qgrf\") pod \"node-exporter-zv5wf\" (UID: \"a377faaa-04b5-46d3-9195-1bea36f5ab97\") " pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:40.973144 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:40.973099 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc" Jun 09 14:54:41.012678 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.012636 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zv5wf" Jun 09 14:54:41.738898 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.738865 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 14:54:41.744175 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.743383 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.748136 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.747904 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 14:54:41.748136 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.748036 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 14:54:41.748303 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.748188 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 14:54:41.748954 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.748345 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jmlbn\"" Jun 09 14:54:41.749174 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.748386 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 14:54:41.749303 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.748425 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 14:54:41.749429 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.748490 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 14:54:41.749522 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.748537 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 14:54:41.750575 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.750553 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 14:54:41.750757 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.750588 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 14:54:41.756896 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.756871 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 14:54:41.828960 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.828926 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef1db7b3-4925-4947-aa36-9ac950016f36-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.829120 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.828983 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-web-config\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.829120 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.829070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.829242 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.829120 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hgq9\" (UniqueName: \"kubernetes.io/projected/ef1db7b3-4925-4947-aa36-9ac950016f36-kube-api-access-4hgq9\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.829242 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.829151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.829242 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.829194 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef1db7b3-4925-4947-aa36-9ac950016f36-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.829383 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.829252 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.829383 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.829282 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.829383 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.829314 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef1db7b3-4925-4947-aa36-9ac950016f36-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.829383 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.829341 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-config-volume\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.829383 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.829364 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef1db7b3-4925-4947-aa36-9ac950016f36-config-out\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.829625 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.829398 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ef1db7b3-4925-4947-aa36-9ac950016f36-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.829625 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.829426 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.930722 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.930685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef1db7b3-4925-4947-aa36-9ac950016f36-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.930915 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.930738 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-web-config\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.930915 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.930777 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.930915 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.930802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hgq9\" (UniqueName: \"kubernetes.io/projected/ef1db7b3-4925-4947-aa36-9ac950016f36-kube-api-access-4hgq9\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.930915 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.930826 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.931107 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.930918 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef1db7b3-4925-4947-aa36-9ac950016f36-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.931107 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.930973 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.931107 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.931011 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.931107 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.931051 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef1db7b3-4925-4947-aa36-9ac950016f36-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.931107 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.931076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-config-volume\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.931107 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.931096 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef1db7b3-4925-4947-aa36-9ac950016f36-config-out\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.931381 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.931122 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ef1db7b3-4925-4947-aa36-9ac950016f36-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.931381 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.931144 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.931876 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.931590 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ef1db7b3-4925-4947-aa36-9ac950016f36-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.931876 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.931615 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef1db7b3-4925-4947-aa36-9ac950016f36-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.931876 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:41.931802 2578 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 09 14:54:41.931876 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:54:41.931873 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-main-tls podName:ef1db7b3-4925-4947-aa36-9ac950016f36 nodeName:}" failed. No retries permitted until 2026-06-09 14:54:42.431853129 +0000 UTC m=+230.576434095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "ef1db7b3-4925-4947-aa36-9ac950016f36") : secret "alertmanager-main-tls" not found Jun 09 14:54:41.932171 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.932017 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef1db7b3-4925-4947-aa36-9ac950016f36-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.934874 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.934832 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-web-config\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.935293 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.935271 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef1db7b3-4925-4947-aa36-9ac950016f36-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.935697 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.935677 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.935868 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.935819 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef1db7b3-4925-4947-aa36-9ac950016f36-config-out\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.935973 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.935888 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.936773 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.936752 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.936886 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.936862 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-config-volume\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.937541 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.937522 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:41.939376 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:41.939351 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hgq9\" (UniqueName: \"kubernetes.io/projected/ef1db7b3-4925-4947-aa36-9ac950016f36-kube-api-access-4hgq9\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:42.271955 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.271916 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-669f58544d-482kr"] Jun 09 14:54:42.276511 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.276485 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.284519 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.284443 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 14:54:42.286561 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.286535 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-669f58544d-482kr"] Jun 09 14:54:42.434857 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.434822 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-trusted-ca-bundle\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.435018 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.434866 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-console-config\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.435018 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.434978 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt5dp\" (UniqueName: \"kubernetes.io/projected/82a6cee3-c195-4187-9053-3d96acbf716b-kube-api-access-gt5dp\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.435134 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.435047 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82a6cee3-c195-4187-9053-3d96acbf716b-console-serving-cert\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.435134 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.435071 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-service-ca\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.435134 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.435096 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82a6cee3-c195-4187-9053-3d96acbf716b-console-oauth-config\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.435134 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.435126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:42.435314 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.435185 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-oauth-serving-cert\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.438090 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.438064 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:42.535748 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.535653 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-trusted-ca-bundle\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.535748 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.535706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-console-config\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.535995 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.535766 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt5dp\" (UniqueName: \"kubernetes.io/projected/82a6cee3-c195-4187-9053-3d96acbf716b-kube-api-access-gt5dp\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.535995 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.535813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82a6cee3-c195-4187-9053-3d96acbf716b-console-serving-cert\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.535995 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.535835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-service-ca\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.535995 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.535868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82a6cee3-c195-4187-9053-3d96acbf716b-console-oauth-config\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.536277 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.536238 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-oauth-serving-cert\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.536702 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.536675 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-trusted-ca-bundle\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.536800 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.536763 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-console-config\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.536844 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.536795 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-service-ca\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.537214 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.537178 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-oauth-serving-cert\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.538549 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.538530 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82a6cee3-c195-4187-9053-3d96acbf716b-console-oauth-config\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.538833 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.538808 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82a6cee3-c195-4187-9053-3d96acbf716b-console-serving-cert\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.544352 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.544323 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt5dp\" (UniqueName: \"kubernetes.io/projected/82a6cee3-c195-4187-9053-3d96acbf716b-kube-api-access-gt5dp\") pod \"console-669f58544d-482kr\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.589804 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.589769 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:42.656793 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.656758 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:54:42.754117 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.754083 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-776984bcb-vjn4r"] Jun 09 14:54:42.757836 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.757805 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.762828 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.762803 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 09 14:54:42.763253 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.763231 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-802ta4c6dnra9\"" Jun 09 14:54:42.763373 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.763353 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 09 14:54:42.763500 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.763467 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 09 14:54:42.763500 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.763490 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hbl8t\"" Jun 09 14:54:42.764335 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.764308 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 09 14:54:42.764335 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.764319 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 09 14:54:42.781804 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.781776 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-776984bcb-vjn4r"] Jun 09 14:54:42.838788 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.838752 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a5c2516-be88-4273-a28e-5d107f7c471e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.838969 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.838793 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a5c2516-be88-4273-a28e-5d107f7c471e-secret-grpc-tls\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.838969 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.838823 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a5c2516-be88-4273-a28e-5d107f7c471e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.838969 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.838852 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8a5c2516-be88-4273-a28e-5d107f7c471e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.838969 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.838940 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8a5c2516-be88-4273-a28e-5d107f7c471e-secret-thanos-querier-tls\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.839203 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.838994 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a5c2516-be88-4273-a28e-5d107f7c471e-metrics-client-ca\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.839203 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.839019 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fppvk\" (UniqueName: \"kubernetes.io/projected/8a5c2516-be88-4273-a28e-5d107f7c471e-kube-api-access-fppvk\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.839203 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.839061 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8a5c2516-be88-4273-a28e-5d107f7c471e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.939729 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.939680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8a5c2516-be88-4273-a28e-5d107f7c471e-secret-thanos-querier-tls\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.939938 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.939746 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a5c2516-be88-4273-a28e-5d107f7c471e-metrics-client-ca\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.939938 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.939774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fppvk\" (UniqueName: \"kubernetes.io/projected/8a5c2516-be88-4273-a28e-5d107f7c471e-kube-api-access-fppvk\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.939938 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.939815 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8a5c2516-be88-4273-a28e-5d107f7c471e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.940108 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.940012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a5c2516-be88-4273-a28e-5d107f7c471e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.940108 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.940052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a5c2516-be88-4273-a28e-5d107f7c471e-secret-grpc-tls\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.940193 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.940110 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a5c2516-be88-4273-a28e-5d107f7c471e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.940193 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.940142 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8a5c2516-be88-4273-a28e-5d107f7c471e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.940821 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.940771 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a5c2516-be88-4273-a28e-5d107f7c471e-metrics-client-ca\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.942900 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.942868 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8a5c2516-be88-4273-a28e-5d107f7c471e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.943091 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.943031 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8a5c2516-be88-4273-a28e-5d107f7c471e-secret-thanos-querier-tls\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.943621 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.943597 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a5c2516-be88-4273-a28e-5d107f7c471e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.943621 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.943613 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a5c2516-be88-4273-a28e-5d107f7c471e-secret-grpc-tls\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.943965 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.943917 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a5c2516-be88-4273-a28e-5d107f7c471e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.944397 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.944375 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8a5c2516-be88-4273-a28e-5d107f7c471e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:42.949308 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:42.949271 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fppvk\" (UniqueName: \"kubernetes.io/projected/8a5c2516-be88-4273-a28e-5d107f7c471e-kube-api-access-fppvk\") pod \"thanos-querier-776984bcb-vjn4r\" (UID: \"8a5c2516-be88-4273-a28e-5d107f7c471e\") " pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:43.069141 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:43.069107 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:43.789955 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:43.789918 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:43.790402 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:43.790014 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:54:43.791540 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:43.791512 2578 patch_prober.go:28] interesting pod/console-9ff488864-c5rqs container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body= Jun 09 14:54:43.791670 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:43.791577 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-9ff488864-c5rqs" podUID="31c9b17f-a758-4e02-b230-12364ca6d85e" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" Jun 09 14:54:45.165114 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.165081 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-59644566f7-9d7kk"] Jun 09 14:54:45.168571 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.168548 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.172535 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.172507 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 09 14:54:45.172535 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.172520 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 09 14:54:45.172731 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.172553 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 14:54:45.172731 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.172605 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xbrt2\"" Jun 09 14:54:45.172731 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.172515 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5hfjjna66hva2\"" Jun 09 14:54:45.172731 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.172633 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 09 14:54:45.178970 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.178948 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-59644566f7-9d7kk"] Jun 09 14:54:45.262974 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.262931 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0240a1cd-475e-45b9-9539-55c66b0bf22b-secret-metrics-server-tls\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.262974 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.262979 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0240a1cd-475e-45b9-9539-55c66b0bf22b-client-ca-bundle\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.263222 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.263047 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0240a1cd-475e-45b9-9539-55c66b0bf22b-metrics-server-audit-profiles\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.263222 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.263073 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nfp9\" (UniqueName: \"kubernetes.io/projected/0240a1cd-475e-45b9-9539-55c66b0bf22b-kube-api-access-8nfp9\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.263222 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.263173 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0240a1cd-475e-45b9-9539-55c66b0bf22b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.263222 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.263208 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0240a1cd-475e-45b9-9539-55c66b0bf22b-secret-metrics-server-client-certs\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.263411 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.263272 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0240a1cd-475e-45b9-9539-55c66b0bf22b-audit-log\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.364118 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.364067 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0240a1cd-475e-45b9-9539-55c66b0bf22b-secret-metrics-server-tls\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.364364 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.364128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0240a1cd-475e-45b9-9539-55c66b0bf22b-client-ca-bundle\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.364364 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.364188 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0240a1cd-475e-45b9-9539-55c66b0bf22b-metrics-server-audit-profiles\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.364364 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.364212 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nfp9\" (UniqueName: \"kubernetes.io/projected/0240a1cd-475e-45b9-9539-55c66b0bf22b-kube-api-access-8nfp9\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.364364 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.364278 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0240a1cd-475e-45b9-9539-55c66b0bf22b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.364364 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.364309 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0240a1cd-475e-45b9-9539-55c66b0bf22b-secret-metrics-server-client-certs\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.364681 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.364639 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0240a1cd-475e-45b9-9539-55c66b0bf22b-audit-log\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.365075 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.365021 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0240a1cd-475e-45b9-9539-55c66b0bf22b-audit-log\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.365327 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.365276 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0240a1cd-475e-45b9-9539-55c66b0bf22b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.365837 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.365810 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0240a1cd-475e-45b9-9539-55c66b0bf22b-metrics-server-audit-profiles\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.367636 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.367612 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0240a1cd-475e-45b9-9539-55c66b0bf22b-client-ca-bundle\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.367747 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.367621 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0240a1cd-475e-45b9-9539-55c66b0bf22b-secret-metrics-server-tls\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.367934 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.367913 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0240a1cd-475e-45b9-9539-55c66b0bf22b-secret-metrics-server-client-certs\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.373002 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.372981 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nfp9\" (UniqueName: \"kubernetes.io/projected/0240a1cd-475e-45b9-9539-55c66b0bf22b-kube-api-access-8nfp9\") pod \"metrics-server-59644566f7-9d7kk\" (UID: \"0240a1cd-475e-45b9-9539-55c66b0bf22b\") " pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.465721 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.465636 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9ff488864-c5rqs"] Jun 09 14:54:45.479254 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.479105 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:54:45.502137 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.502107 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-574886f55f-s8s4f"] Jun 09 14:54:45.505577 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.505549 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.516515 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.516483 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-574886f55f-s8s4f"] Jun 09 14:54:45.667400 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.667361 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-service-ca\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.667606 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.667422 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-console-config\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.667606 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.667496 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-oauth-serving-cert\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.667606 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.667552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbnh9\" (UniqueName: \"kubernetes.io/projected/242f54d0-c841-4982-a1cb-f1a03d62c24e-kube-api-access-hbnh9\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.667746 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.667648 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/242f54d0-c841-4982-a1cb-f1a03d62c24e-console-oauth-config\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.667746 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.667681 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/242f54d0-c841-4982-a1cb-f1a03d62c24e-console-serving-cert\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.667746 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.667705 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-trusted-ca-bundle\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.768527 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.768418 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/242f54d0-c841-4982-a1cb-f1a03d62c24e-console-oauth-config\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.768527 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.768464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/242f54d0-c841-4982-a1cb-f1a03d62c24e-console-serving-cert\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.768527 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.768511 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-trusted-ca-bundle\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.768816 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.768563 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-service-ca\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.768816 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.768595 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-console-config\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.768816 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.768772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-oauth-serving-cert\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.768965 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.768834 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbnh9\" (UniqueName: \"kubernetes.io/projected/242f54d0-c841-4982-a1cb-f1a03d62c24e-kube-api-access-hbnh9\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.769485 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.769448 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-service-ca\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.769614 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.769605 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-trusted-ca-bundle\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.769680 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.769661 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-console-config\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.769740 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.769713 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-oauth-serving-cert\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.771369 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.771343 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/242f54d0-c841-4982-a1cb-f1a03d62c24e-console-serving-cert\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.771526 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.771504 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/242f54d0-c841-4982-a1cb-f1a03d62c24e-console-oauth-config\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.779085 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.779058 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbnh9\" (UniqueName: \"kubernetes.io/projected/242f54d0-c841-4982-a1cb-f1a03d62c24e-kube-api-access-hbnh9\") pod \"console-574886f55f-s8s4f\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:45.818185 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:45.818141 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:46.948830 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:46.948793 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 14:54:46.955667 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:46.955642 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:46.958579 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:46.958555 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 14:54:46.958579 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:46.958574 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 14:54:46.958776 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:46.958612 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 14:54:46.958776 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:46.958574 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 14:54:46.958776 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:46.958555 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 14:54:46.958776 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:46.958708 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 14:54:46.959123 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:46.959107 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 14:54:46.959272 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:46.959227 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 14:54:46.961219 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:46.961197 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 14:54:46.961342 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:46.961279 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cq66v\"" Jun 09 14:54:46.961414 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:46.961342 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 14:54:46.961414 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:46.961403 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 14:54:46.961551 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:46.961523 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 14:54:46.961927 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:46.961844 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 14:54:46.962399 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:46.962382 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3dcoeiikkiiko\"" Jun 09 14:54:46.966281 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:46.966263 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 14:54:46.968521 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:46.968501 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 14:54:47.087376 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.087329 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.087376 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.087377 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.087626 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.087424 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/773de10c-346d-4f2f-94d3-32a27b6d290e-config-out\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.087626 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.087451 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.087626 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.087534 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-web-config\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.087626 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.087576 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-config\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.087626 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.087599 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.087853 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.087645 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.087853 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.087713 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.087853 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.087747 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.087853 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.087781 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.087853 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.087813 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.088106 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.087901 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.088106 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.087944 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.088106 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.087981 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.088106 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.088044 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.088106 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.088069 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/773de10c-346d-4f2f-94d3-32a27b6d290e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.088106 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.088104 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.088386 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.088181 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.088386 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.088242 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72x9q\" (UniqueName: \"kubernetes.io/projected/773de10c-346d-4f2f-94d3-32a27b6d290e-kube-api-access-72x9q\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.188880 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.188843 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-web-config\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.189090 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.188906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-config\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.189090 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.188937 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.189090 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.188983 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.189268 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.189074 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.189268 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.189118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.189268 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.189136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.189268 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.189160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.189268 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.189198 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.189268 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.189223 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.189268 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.189251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.189639 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.189289 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.189639 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.189316 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/773de10c-346d-4f2f-94d3-32a27b6d290e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.189639 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.189344 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.190108 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.189993 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.191116 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.190457 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.191116 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.190745 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.191116 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.190772 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.191116 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.190805 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72x9q\" (UniqueName: \"kubernetes.io/projected/773de10c-346d-4f2f-94d3-32a27b6d290e-kube-api-access-72x9q\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.191116 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.190839 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.191116 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.190871 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.191116 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.190911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/773de10c-346d-4f2f-94d3-32a27b6d290e-config-out\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.191116 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.190936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.191780 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.191584 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.193067 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.192369 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.193067 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.192982 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.193067 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.193003 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.193816 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.193798 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.193984 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.193954 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.194969 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.194923 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.195127 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.195100 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.196031 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.195220 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.196031 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.195744 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.196031 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.195839 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.196247 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.196221 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-web-config\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.196423 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.196404 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/773de10c-346d-4f2f-94d3-32a27b6d290e-config-out\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.196940 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.196895 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.197030 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.196982 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/773de10c-346d-4f2f-94d3-32a27b6d290e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.198404 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.198383 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-config\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.202302 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.202254 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72x9q\" (UniqueName: \"kubernetes.io/projected/773de10c-346d-4f2f-94d3-32a27b6d290e-kube-api-access-72x9q\") pod \"prometheus-k8s-0\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:47.267880 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:47.267842 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:54:48.009375 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:48.009344 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-669f58544d-482kr"] Jun 09 14:54:48.010515 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:54:48.010485 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a6cee3_c195_4187_9053_3d96acbf716b.slice/crio-fa5918caacc046461266d3310689d8ed9ab51d625748e180bb0f098cf9aeebed WatchSource:0}: Error finding container fa5918caacc046461266d3310689d8ed9ab51d625748e180bb0f098cf9aeebed: Status 404 returned error can't find the container with id fa5918caacc046461266d3310689d8ed9ab51d625748e180bb0f098cf9aeebed Jun 09 14:54:48.027499 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:48.027150 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc"] Jun 09 14:54:48.029716 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:54:48.029682 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8f29f61_478a_4b35_a379_5de150730980.slice/crio-ae6212e4d7d0a34b57d1c4866020d3e672bce6708d3fed1ff6abd4abdf934e24 WatchSource:0}: Error finding container ae6212e4d7d0a34b57d1c4866020d3e672bce6708d3fed1ff6abd4abdf934e24: Status 404 returned error can't find the container with id ae6212e4d7d0a34b57d1c4866020d3e672bce6708d3fed1ff6abd4abdf934e24 Jun 09 14:54:48.096747 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:48.096716 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zv5wf" event={"ID":"a377faaa-04b5-46d3-9195-1bea36f5ab97","Type":"ContainerStarted","Data":"9e5cdf0168a80e34b4b705bd48fdb307e10f18bb73b29966f71b3b9ef981e8bb"} Jun 09 14:54:48.099109 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:48.099080 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc" event={"ID":"e8f29f61-478a-4b35-a379-5de150730980","Type":"ContainerStarted","Data":"0316b32e0446d5e78f89d9d51a3bc2a4294999715be4eef664818bb506fbd895"} Jun 09 14:54:48.099255 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:48.099136 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc" event={"ID":"e8f29f61-478a-4b35-a379-5de150730980","Type":"ContainerStarted","Data":"ae6212e4d7d0a34b57d1c4866020d3e672bce6708d3fed1ff6abd4abdf934e24"} Jun 09 14:54:48.101053 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:48.101011 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669f58544d-482kr" event={"ID":"82a6cee3-c195-4187-9053-3d96acbf716b","Type":"ContainerStarted","Data":"2d15b01007545f2c490f01584da36c980d3ee8ebc795334e0f18a886a4608fe5"} Jun 09 14:54:48.101167 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:48.101076 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669f58544d-482kr" event={"ID":"82a6cee3-c195-4187-9053-3d96acbf716b","Type":"ContainerStarted","Data":"fa5918caacc046461266d3310689d8ed9ab51d625748e180bb0f098cf9aeebed"} Jun 09 14:54:48.107001 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:48.106966 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-v7xmv" event={"ID":"a283f045-0274-4381-8226-bc3824379571","Type":"ContainerStarted","Data":"183702b4308b46ce19c89205d89874fe9115d0ea6a53aee7ad2260dadddc7330"} Jun 09 14:54:48.107426 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:48.107378 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-v7xmv" Jun 09 14:54:48.108539 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:48.108497 2578 patch_prober.go:28] interesting pod/downloads-6657875f97-v7xmv container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused" start-of-body= Jun 09 14:54:48.108652 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:48.108548 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6657875f97-v7xmv" podUID="a283f045-0274-4381-8226-bc3824379571" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused" Jun 09 14:54:48.122666 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:48.122585 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-776984bcb-vjn4r"] Jun 09 14:54:48.125571 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:54:48.125538 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a5c2516_be88_4273_a28e_5d107f7c471e.slice/crio-4bb2d07356b00799cdeaa0a991cd76e27b4cc30ab514751939b1ff11b4dc3bbc WatchSource:0}: Error finding container 4bb2d07356b00799cdeaa0a991cd76e27b4cc30ab514751939b1ff11b4dc3bbc: Status 404 returned error can't find the container with id 4bb2d07356b00799cdeaa0a991cd76e27b4cc30ab514751939b1ff11b4dc3bbc Jun 09 14:54:48.125818 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:48.125785 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-669f58544d-482kr" podStartSLOduration=6.125768319 podStartE2EDuration="6.125768319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:54:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:54:48.121021714 +0000 UTC m=+236.265602694" watchObservedRunningTime="2026-06-09 14:54:48.125768319 +0000 UTC m=+236.270349298" Jun 09 14:54:48.142505 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:48.140411 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-v7xmv" podStartSLOduration=1.577076009 podStartE2EDuration="21.140390957s" totalImagesPullingTime="19.563314948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:54:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:54:48.138519764 +0000 UTC m=+236.283100744" watchObservedRunningTime="2026-06-09 14:54:48.140390957 +0000 UTC m=+236.284971942" Jun 09 14:54:48.195290 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:48.195038 2578 patch_prober.go:28] interesting pod/downloads-6657875f97-v7xmv container/download-server namespace/openshift-console: Liveness probe status=failure output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused" start-of-body= Jun 09 14:54:48.195290 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:48.195093 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-console/downloads-6657875f97-v7xmv" podUID="a283f045-0274-4381-8226-bc3824379571" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused" Jun 09 14:54:48.250930 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:48.250749 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-59644566f7-9d7kk"] Jun 09 14:54:48.258720 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:48.258366 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 14:54:48.258971 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:54:48.258938 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0240a1cd_475e_45b9_9539_55c66b0bf22b.slice/crio-de4ce9be39a00b6cb45a058a2f85fd7d2e4a9cdbe0029f067320a29c9a157e96 WatchSource:0}: Error finding container de4ce9be39a00b6cb45a058a2f85fd7d2e4a9cdbe0029f067320a29c9a157e96: Status 404 returned error can't find the container with id de4ce9be39a00b6cb45a058a2f85fd7d2e4a9cdbe0029f067320a29c9a157e96 Jun 09 14:54:48.265991 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:54:48.265948 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef1db7b3_4925_4947_aa36_9ac950016f36.slice/crio-aa8153079351ba3187e701a2bfe6ef08f0f58bccf952fa9482eb3806c1a9c35c WatchSource:0}: Error finding container aa8153079351ba3187e701a2bfe6ef08f0f58bccf952fa9482eb3806c1a9c35c: Status 404 returned error can't find the container with id aa8153079351ba3187e701a2bfe6ef08f0f58bccf952fa9482eb3806c1a9c35c Jun 09 14:54:48.294307 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:48.294277 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-574886f55f-s8s4f"] Jun 09 14:54:48.297319 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:54:48.297283 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod242f54d0_c841_4982_a1cb_f1a03d62c24e.slice/crio-d309a385eef9881c185838065c374db523268429539d95a7ec504257c8567465 WatchSource:0}: Error finding container d309a385eef9881c185838065c374db523268429539d95a7ec504257c8567465: Status 404 returned error can't find the container with id d309a385eef9881c185838065c374db523268429539d95a7ec504257c8567465 Jun 09 14:54:48.302623 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:48.302594 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 14:54:48.306283 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:54:48.306238 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod773de10c_346d_4f2f_94d3_32a27b6d290e.slice/crio-52e877c8e14c8a49f8913eb2a4a9f519fb147903d2b1f6e9e7452d2506069466 WatchSource:0}: Error finding container 52e877c8e14c8a49f8913eb2a4a9f519fb147903d2b1f6e9e7452d2506069466: Status 404 returned error can't find the container with id 52e877c8e14c8a49f8913eb2a4a9f519fb147903d2b1f6e9e7452d2506069466 Jun 09 14:54:49.124709 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:49.124528 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc" event={"ID":"e8f29f61-478a-4b35-a379-5de150730980","Type":"ContainerStarted","Data":"fba1f15f58afa6ada19ddf93d0680fd6baaac7c7e447fbc40161522a0fd1feaa"} Jun 09 14:54:49.127426 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:49.127388 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" event={"ID":"0240a1cd-475e-45b9-9539-55c66b0bf22b","Type":"ContainerStarted","Data":"de4ce9be39a00b6cb45a058a2f85fd7d2e4a9cdbe0029f067320a29c9a157e96"} Jun 09 14:54:49.132036 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:49.132003 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef1db7b3-4925-4947-aa36-9ac950016f36","Type":"ContainerStarted","Data":"aa8153079351ba3187e701a2bfe6ef08f0f58bccf952fa9482eb3806c1a9c35c"} Jun 09 14:54:49.134112 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:49.134004 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"773de10c-346d-4f2f-94d3-32a27b6d290e","Type":"ContainerStarted","Data":"52e877c8e14c8a49f8913eb2a4a9f519fb147903d2b1f6e9e7452d2506069466"} Jun 09 14:54:49.138415 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:49.138382 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574886f55f-s8s4f" event={"ID":"242f54d0-c841-4982-a1cb-f1a03d62c24e","Type":"ContainerStarted","Data":"81d8075ee472b40f49c585315d61fa15ca2e70142e09bab49b96fb01d880e3c4"} Jun 09 14:54:49.138555 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:49.138433 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574886f55f-s8s4f" event={"ID":"242f54d0-c841-4982-a1cb-f1a03d62c24e","Type":"ContainerStarted","Data":"d309a385eef9881c185838065c374db523268429539d95a7ec504257c8567465"} Jun 09 14:54:49.141698 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:49.141662 2578 generic.go:356] "Generic (PLEG): container finished" podID="a377faaa-04b5-46d3-9195-1bea36f5ab97" containerID="94ed2ecef1efc33ffc8a2463d987ec0eb8af72a8b6be07b0d96634de57a54e4d" exitCode=0 Jun 09 14:54:49.141818 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:49.141732 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zv5wf" event={"ID":"a377faaa-04b5-46d3-9195-1bea36f5ab97","Type":"ContainerDied","Data":"94ed2ecef1efc33ffc8a2463d987ec0eb8af72a8b6be07b0d96634de57a54e4d"} Jun 09 14:54:49.145923 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:49.144440 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" event={"ID":"8a5c2516-be88-4273-a28e-5d107f7c471e","Type":"ContainerStarted","Data":"4bb2d07356b00799cdeaa0a991cd76e27b4cc30ab514751939b1ff11b4dc3bbc"} Jun 09 14:54:49.150440 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:49.150385 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-v7xmv" Jun 09 14:54:49.222522 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:49.216233 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-574886f55f-s8s4f" podStartSLOduration=4.216211462 podStartE2EDuration="4.216211462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:54:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:54:49.18351699 +0000 UTC m=+237.328097977" watchObservedRunningTime="2026-06-09 14:54:49.216211462 +0000 UTC m=+237.360792450" Jun 09 14:54:50.157441 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:50.156843 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zv5wf" event={"ID":"a377faaa-04b5-46d3-9195-1bea36f5ab97","Type":"ContainerStarted","Data":"3a36c71459ac2664e1776bf63bde6aa8961522f9d161c3c001248c23a711adb7"} Jun 09 14:54:50.157441 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:50.156905 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zv5wf" event={"ID":"a377faaa-04b5-46d3-9195-1bea36f5ab97","Type":"ContainerStarted","Data":"4fca5944dd5d6fd37f8481df1d2837728a76d2244a5a190ae26891ee652e54ed"} Jun 09 14:54:50.181002 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:50.180287 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zv5wf" podStartSLOduration=9.050550648 podStartE2EDuration="10.180264021s" totalImagesPullingTime="1.036729106s" totalInitContainerRuntime="92.984267ms" isStatefulPod=true podCreationTimestamp="2026-06-09 14:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:54:50.177817433 +0000 UTC m=+238.322398429" watchObservedRunningTime="2026-06-09 14:54:50.180264021 +0000 UTC m=+238.324845007" Jun 09 14:54:52.590415 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:52.590381 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:52.590832 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:52.590451 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-669f58544d-482kr" Jun 09 14:54:52.592083 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:52.592047 2578 patch_prober.go:28] interesting pod/console-669f58544d-482kr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jun 09 14:54:52.592190 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:52.592105 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-669f58544d-482kr" podUID="82a6cee3-c195-4187-9053-3d96acbf716b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jun 09 14:54:53.179673 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:53.179628 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" event={"ID":"8a5c2516-be88-4273-a28e-5d107f7c471e","Type":"ContainerStarted","Data":"fcfe2ef1537fac88631948a8f360484e8b7f9f9cd5893039243a768f6ef57d07"} Jun 09 14:54:53.182309 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:53.182281 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc" event={"ID":"e8f29f61-478a-4b35-a379-5de150730980","Type":"ContainerStarted","Data":"033b9409052252a7d27bcf238f467141ccdcc51ca70ce8a19530f598dfb975e5"} Jun 09 14:54:53.184184 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:53.184151 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" event={"ID":"0240a1cd-475e-45b9-9539-55c66b0bf22b","Type":"ContainerStarted","Data":"93e6a2d1e674fa7715f1b0ec65dae551a5f899996da9d19d58d771bc8d8e21ca"} Jun 09 14:54:53.186181 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:53.186156 2578 generic.go:356] "Generic (PLEG): container finished" podID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerID="847a655c0daa85391f7acb803ad44a18caf036cc68a44daa9ace01c30a89f4fa" exitCode=0 Jun 09 14:54:53.186577 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:53.186551 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef1db7b3-4925-4947-aa36-9ac950016f36","Type":"ContainerDied","Data":"847a655c0daa85391f7acb803ad44a18caf036cc68a44daa9ace01c30a89f4fa"} Jun 09 14:54:53.189033 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:53.188932 2578 generic.go:356] "Generic (PLEG): container finished" podID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerID="2b196d886bc44fa93e8002cfe6592b94c9fad9f03198c6871b0e5402ac669dc1" exitCode=0 Jun 09 14:54:53.189033 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:53.188971 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"773de10c-346d-4f2f-94d3-32a27b6d290e","Type":"ContainerDied","Data":"2b196d886bc44fa93e8002cfe6592b94c9fad9f03198c6871b0e5402ac669dc1"} Jun 09 14:54:53.204814 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:53.204768 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z9vlc" podStartSLOduration=8.754166492 podStartE2EDuration="13.204749611s" totalImagesPullingTime="4.450583119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:54:53.203349694 +0000 UTC m=+241.347930678" watchObservedRunningTime="2026-06-09 14:54:53.204749611 +0000 UTC m=+241.349330588" Jun 09 14:54:54.197505 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:54.197431 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" event={"ID":"8a5c2516-be88-4273-a28e-5d107f7c471e","Type":"ContainerStarted","Data":"91ce45053b630c32fb8df5761f9b2df55395efa126ca08cf416a4584b1193e24"} Jun 09 14:54:54.197996 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:54.197517 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" event={"ID":"8a5c2516-be88-4273-a28e-5d107f7c471e","Type":"ContainerStarted","Data":"f0100c549ac00e4862674246733dd30373e1aa257d44c9572065377b0b3bfb4b"} Jun 09 14:54:55.819357 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:55.819329 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:55.820580 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:55.820518 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:54:55.825228 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:55.825194 2578 patch_prober.go:28] interesting pod/console-574886f55f-s8s4f container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 09 14:54:55.826346 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:55.826228 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-574886f55f-s8s4f" podUID="242f54d0-c841-4982-a1cb-f1a03d62c24e" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 09 14:54:56.211910 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:56.211802 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" event={"ID":"8a5c2516-be88-4273-a28e-5d107f7c471e","Type":"ContainerStarted","Data":"026b4b426f8b4daaf54017b3361c1258d48c53ca12272186f4e012eb0cf105d5"} Jun 09 14:54:56.212082 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:56.211933 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" event={"ID":"8a5c2516-be88-4273-a28e-5d107f7c471e","Type":"ContainerStarted","Data":"1ccba6aaaa48ed3bf294591289a666cb5ec1b554060e047b53188b3e6ab7c0d1"} Jun 09 14:54:56.212082 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:56.211978 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" event={"ID":"8a5c2516-be88-4273-a28e-5d107f7c471e","Type":"ContainerStarted","Data":"be95f17a78a08002e128dfba8fb7b0b09c3a8c718aaae81dca26bd31c1818db7"} Jun 09 14:54:56.213151 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:56.213127 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:56.217236 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:56.217204 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef1db7b3-4925-4947-aa36-9ac950016f36","Type":"ContainerStarted","Data":"ec3826782f83f5c73227a3ccdda2f36f4298fb92c8f6e3c5baaec10a1d720f94"} Jun 09 14:54:56.217349 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:56.217284 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef1db7b3-4925-4947-aa36-9ac950016f36","Type":"ContainerStarted","Data":"17b1b6ceeee3e31df3ecef3e9df5a624cb598b276c1e631e9d9147b4fd659da2"} Jun 09 14:54:56.217349 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:56.217325 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef1db7b3-4925-4947-aa36-9ac950016f36","Type":"ContainerStarted","Data":"4e6c36891ee3880270bad2a6dc1969c200aaf165384c4dd63218324e38957126"} Jun 09 14:54:56.241248 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:56.240665 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" podStartSLOduration=7.213626908 podStartE2EDuration="14.240643028s" totalImagesPullingTime="7.02701612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:54:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:54:56.238238751 +0000 UTC m=+244.382819738" watchObservedRunningTime="2026-06-09 14:54:56.240643028 +0000 UTC m=+244.385224013" Jun 09 14:54:56.242197 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:56.242147 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" podStartSLOduration=6.865675817 podStartE2EDuration="11.242131036s" totalImagesPullingTime="4.376455219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:54:53.284586084 +0000 UTC m=+241.429167070" watchObservedRunningTime="2026-06-09 14:54:56.242131036 +0000 UTC m=+244.386712022" Jun 09 14:54:58.231947 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:58.231918 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef1db7b3-4925-4947-aa36-9ac950016f36","Type":"ContainerStarted","Data":"fb784aa43edb260ffc961bf182bfc24be6925cacf890d8cc51a9ee362c7c3e5f"} Jun 09 14:54:58.232461 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:58.231979 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef1db7b3-4925-4947-aa36-9ac950016f36","Type":"ContainerStarted","Data":"629b82c34b3d512622b0c52c90b582b71b3dd10b20fe812757a1adbef70277f1"} Jun 09 14:54:58.232461 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:58.232006 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef1db7b3-4925-4947-aa36-9ac950016f36","Type":"ContainerStarted","Data":"c968879f8cd857f9969282cb868d8f0707afbe297b9c3391a83af6e663e561f3"} Jun 09 14:54:58.234732 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:58.234703 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"773de10c-346d-4f2f-94d3-32a27b6d290e","Type":"ContainerStarted","Data":"bbc750ed6be27c699219fdbd93710716d07ffb9e7cea555968145dbd21b6c569"} Jun 09 14:54:58.234854 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:58.234775 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"773de10c-346d-4f2f-94d3-32a27b6d290e","Type":"ContainerStarted","Data":"cb9fba5495d53fbc50fe4cb91f69ce4684f112c5141aa4a2a99622cc19fb4d76"} Jun 09 14:54:58.234854 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:58.234818 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"773de10c-346d-4f2f-94d3-32a27b6d290e","Type":"ContainerStarted","Data":"71c0edccb0fe056e51486d76c35d803d95f928b8bd718383e912cab50606d740"} Jun 09 14:54:58.241060 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:58.241039 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-776984bcb-vjn4r" Jun 09 14:54:58.260551 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:58.260458 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=10.444597005 podStartE2EDuration="17.26043884s" totalImagesPullingTime="6.791006938s" totalInitContainerRuntime="24.834897ms" isStatefulPod=false podCreationTimestamp="2026-06-09 14:54:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:54:58.259909352 +0000 UTC m=+246.404490338" watchObservedRunningTime="2026-06-09 14:54:58.26043884 +0000 UTC m=+246.405019826" Jun 09 14:54:59.243131 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:59.243088 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"773de10c-346d-4f2f-94d3-32a27b6d290e","Type":"ContainerStarted","Data":"130d1cc4bbc9657ac28ad0399f310007ac34be994f3cc0edf0b0c9fbf2b2f77d"} Jun 09 14:54:59.243668 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:59.243179 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"773de10c-346d-4f2f-94d3-32a27b6d290e","Type":"ContainerStarted","Data":"0e2ac18f012635ed7d093633f834c079ea0b5db78f8de2b07e1659fe9b6f9efe"} Jun 09 14:54:59.243668 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:59.243214 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"773de10c-346d-4f2f-94d3-32a27b6d290e","Type":"ContainerStarted","Data":"b4a00698f8d3d4b6de5fef67aa3943b22e169e24f4ee1cc9fb5c0dc61fb3071d"} Jun 09 14:54:59.276617 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:54:59.276561 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.321152556 podStartE2EDuration="13.276543526s" totalImagesPullingTime="8.938464216s" totalInitContainerRuntime="16.926754ms" isStatefulPod=false podCreationTimestamp="2026-06-09 14:54:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:54:59.274076872 +0000 UTC m=+247.418657856" watchObservedRunningTime="2026-06-09 14:54:59.276543526 +0000 UTC m=+247.421124510" Jun 09 14:55:02.268022 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:02.267987 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:55:02.590222 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:02.590184 2578 patch_prober.go:28] interesting pod/console-669f58544d-482kr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jun 09 14:55:02.590400 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:02.590245 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-669f58544d-482kr" podUID="82a6cee3-c195-4187-9053-3d96acbf716b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jun 09 14:55:04.187707 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:04.187661 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs\") pod \"network-metrics-daemon-6pz99\" (UID: \"e78820c0-87e6-4a86-a8b3-efbe056c96b7\") " pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:55:04.190133 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:04.190111 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e78820c0-87e6-4a86-a8b3-efbe056c96b7-metrics-certs\") pod \"network-metrics-daemon-6pz99\" (UID: \"e78820c0-87e6-4a86-a8b3-efbe056c96b7\") " pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:55:04.442265 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:04.442179 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zv6s4\"" Jun 09 14:55:04.449238 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:04.449212 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6pz99" Jun 09 14:55:04.612714 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:04.612692 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6pz99"] Jun 09 14:55:04.615163 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:55:04.615123 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode78820c0_87e6_4a86_a8b3_efbe056c96b7.slice/crio-0cfb03885c0c3a5013b58d8ef56eef641e3c579a62d04de83a508ed46b3fd740 WatchSource:0}: Error finding container 0cfb03885c0c3a5013b58d8ef56eef641e3c579a62d04de83a508ed46b3fd740: Status 404 returned error can't find the container with id 0cfb03885c0c3a5013b58d8ef56eef641e3c579a62d04de83a508ed46b3fd740 Jun 09 14:55:05.276335 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:05.276296 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6pz99" event={"ID":"e78820c0-87e6-4a86-a8b3-efbe056c96b7","Type":"ContainerStarted","Data":"0cfb03885c0c3a5013b58d8ef56eef641e3c579a62d04de83a508ed46b3fd740"} Jun 09 14:55:05.479356 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:05.479313 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:55:05.479566 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:05.479382 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:55:05.819041 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:05.819004 2578 patch_prober.go:28] interesting pod/console-574886f55f-s8s4f container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 09 14:55:05.819235 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:05.819075 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-574886f55f-s8s4f" podUID="242f54d0-c841-4982-a1cb-f1a03d62c24e" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 09 14:55:07.292279 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:07.292242 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6pz99" event={"ID":"e78820c0-87e6-4a86-a8b3-efbe056c96b7","Type":"ContainerStarted","Data":"894c1f6c7bebfa91f01d8e2298cb9539183b96432ea48c83cc5a25cd72526a94"} Jun 09 14:55:07.292748 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:07.292302 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6pz99" event={"ID":"e78820c0-87e6-4a86-a8b3-efbe056c96b7","Type":"ContainerStarted","Data":"49279a4313dfa9326a154dd43560dd9baf12125e7020f4606f86d0f0b30c455f"} Jun 09 14:55:07.312335 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:07.312280 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6pz99" podStartSLOduration=253.715652301 podStartE2EDuration="4m15.312265599s" totalImagesPullingTime="1.596613298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:55:07.311176003 +0000 UTC m=+255.455756990" watchObservedRunningTime="2026-06-09 14:55:07.312265599 +0000 UTC m=+255.456846583" Jun 09 14:55:10.488848 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:10.488766 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-9ff488864-c5rqs" podUID="31c9b17f-a758-4e02-b230-12364ca6d85e" containerName="console" containerID="cri-o://756894000eb5d22d1142c03db005874b99db191ca0f3b1848978123f1ecf5822" gracePeriod=15 Jun 09 14:55:12.590576 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:12.590542 2578 patch_prober.go:28] interesting pod/console-669f58544d-482kr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jun 09 14:55:12.591014 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:12.590596 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-669f58544d-482kr" podUID="82a6cee3-c195-4187-9053-3d96acbf716b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jun 09 14:55:15.819504 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:15.819442 2578 patch_prober.go:28] interesting pod/console-574886f55f-s8s4f container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 09 14:55:15.819976 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:15.819537 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-574886f55f-s8s4f" podUID="242f54d0-c841-4982-a1cb-f1a03d62c24e" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 09 14:55:16.876292 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:16.876260 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef1db7b3-4925-4947-aa36-9ac950016f36/init-config-reloader/0.log" Jun 09 14:55:17.076641 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:17.076615 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef1db7b3-4925-4947-aa36-9ac950016f36/alertmanager/0.log" Jun 09 14:55:17.276808 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:17.276735 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef1db7b3-4925-4947-aa36-9ac950016f36/config-reloader/0.log" Jun 09 14:55:17.475711 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:17.475677 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef1db7b3-4925-4947-aa36-9ac950016f36/kube-rbac-proxy-web/0.log" Jun 09 14:55:17.676505 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:17.676446 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef1db7b3-4925-4947-aa36-9ac950016f36/kube-rbac-proxy/0.log" Jun 09 14:55:17.876388 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:17.876359 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef1db7b3-4925-4947-aa36-9ac950016f36/kube-rbac-proxy-metric/0.log" Jun 09 14:55:18.075609 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:18.075582 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef1db7b3-4925-4947-aa36-9ac950016f36/prom-label-proxy/0.log" Jun 09 14:55:19.076011 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:19.075981 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-59644566f7-9d7kk_0240a1cd-475e-45b9-9539-55c66b0bf22b/metrics-server/0.log" Jun 09 14:55:20.675994 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:20.675968 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zv5wf_a377faaa-04b5-46d3-9195-1bea36f5ab97/init-textfile/0.log" Jun 09 14:55:20.876747 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:20.876708 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zv5wf_a377faaa-04b5-46d3-9195-1bea36f5ab97/node-exporter/0.log" Jun 09 14:55:21.075359 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:21.075330 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zv5wf_a377faaa-04b5-46d3-9195-1bea36f5ab97/kube-rbac-proxy/0.log" Jun 09 14:55:21.275542 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:21.275511 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-z9vlc_e8f29f61-478a-4b35-a379-5de150730980/kube-rbac-proxy-main/0.log" Jun 09 14:55:21.475650 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:21.475572 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-z9vlc_e8f29f61-478a-4b35-a379-5de150730980/kube-rbac-proxy-self/0.log" Jun 09 14:55:21.675091 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:21.675061 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-z9vlc_e8f29f61-478a-4b35-a379-5de150730980/openshift-state-metrics/0.log" Jun 09 14:55:21.875988 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:21.875957 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_773de10c-346d-4f2f-94d3-32a27b6d290e/init-config-reloader/0.log" Jun 09 14:55:22.076821 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:22.076790 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_773de10c-346d-4f2f-94d3-32a27b6d290e/prometheus/0.log" Jun 09 14:55:22.276628 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:22.276552 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_773de10c-346d-4f2f-94d3-32a27b6d290e/config-reloader/0.log" Jun 09 14:55:22.475781 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:22.475755 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_773de10c-346d-4f2f-94d3-32a27b6d290e/thanos-sidecar/0.log" Jun 09 14:55:22.591124 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:22.591093 2578 patch_prober.go:28] interesting pod/console-669f58544d-482kr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jun 09 14:55:22.591278 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:22.591143 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-669f58544d-482kr" podUID="82a6cee3-c195-4187-9053-3d96acbf716b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jun 09 14:55:22.675773 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:22.675747 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_773de10c-346d-4f2f-94d3-32a27b6d290e/kube-rbac-proxy-web/0.log" Jun 09 14:55:22.876790 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:22.876718 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_773de10c-346d-4f2f-94d3-32a27b6d290e/kube-rbac-proxy/0.log" Jun 09 14:55:23.076260 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:23.076232 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_773de10c-346d-4f2f-94d3-32a27b6d290e/kube-rbac-proxy-thanos/0.log" Jun 09 14:55:23.675208 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:23.675180 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-gldbb_125c19c4-f673-4012-91bd-0a904247d816/prometheus-operator-admission-webhook/0.log" Jun 09 14:55:23.875460 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:23.875434 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776984bcb-vjn4r_8a5c2516-be88-4273-a28e-5d107f7c471e/thanos-query/0.log" Jun 09 14:55:24.075122 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:24.075101 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776984bcb-vjn4r_8a5c2516-be88-4273-a28e-5d107f7c471e/kube-rbac-proxy-web/0.log" Jun 09 14:55:24.275238 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:24.275206 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776984bcb-vjn4r_8a5c2516-be88-4273-a28e-5d107f7c471e/kube-rbac-proxy/0.log" Jun 09 14:55:24.476501 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:24.476406 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776984bcb-vjn4r_8a5c2516-be88-4273-a28e-5d107f7c471e/prom-label-proxy/0.log" Jun 09 14:55:24.676310 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:24.676284 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776984bcb-vjn4r_8a5c2516-be88-4273-a28e-5d107f7c471e/kube-rbac-proxy-rules/0.log" Jun 09 14:55:24.875693 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:24.875646 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776984bcb-vjn4r_8a5c2516-be88-4273-a28e-5d107f7c471e/kube-rbac-proxy-metrics/0.log" Jun 09 14:55:25.276031 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:25.275932 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-kkp7w_0ab77b52-1ec6-4db7-9452-26d0f6866afe/console-operator/1.log" Jun 09 14:55:25.477374 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:25.477348 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-kkp7w_0ab77b52-1ec6-4db7-9452-26d0f6866afe/console-operator/2.log" Jun 09 14:55:25.485117 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:25.485095 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:55:25.488968 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:25.488947 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-59644566f7-9d7kk" Jun 09 14:55:25.676232 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:25.676205 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-574886f55f-s8s4f_242f54d0-c841-4982-a1cb-f1a03d62c24e/console/0.log" Jun 09 14:55:25.819191 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:25.819159 2578 patch_prober.go:28] interesting pod/console-574886f55f-s8s4f container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 09 14:55:25.819367 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:25.819209 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-574886f55f-s8s4f" podUID="242f54d0-c841-4982-a1cb-f1a03d62c24e" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 09 14:55:25.876059 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:25.876024 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-669f58544d-482kr_82a6cee3-c195-4187-9053-3d96acbf716b/console/0.log" Jun 09 14:55:26.076028 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.076000 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9ff488864-c5rqs_31c9b17f-a758-4e02-b230-12364ca6d85e/console/0.log" Jun 09 14:55:26.148992 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.148970 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9ff488864-c5rqs_31c9b17f-a758-4e02-b230-12364ca6d85e/console/0.log" Jun 09 14:55:26.172386 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.172355 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:55:26.190192 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.190160 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31c9b17f-a758-4e02-b230-12364ca6d85e-console-oauth-config\") pod \"31c9b17f-a758-4e02-b230-12364ca6d85e\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " Jun 09 14:55:26.190375 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.190216 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31c9b17f-a758-4e02-b230-12364ca6d85e-console-serving-cert\") pod \"31c9b17f-a758-4e02-b230-12364ca6d85e\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " Jun 09 14:55:26.190375 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.190275 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7hng\" (UniqueName: \"kubernetes.io/projected/31c9b17f-a758-4e02-b230-12364ca6d85e-kube-api-access-m7hng\") pod \"31c9b17f-a758-4e02-b230-12364ca6d85e\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " Jun 09 14:55:26.190375 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.190325 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31c9b17f-a758-4e02-b230-12364ca6d85e-oauth-serving-cert\") pod \"31c9b17f-a758-4e02-b230-12364ca6d85e\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " Jun 09 14:55:26.190585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.190517 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31c9b17f-a758-4e02-b230-12364ca6d85e-service-ca\") pod \"31c9b17f-a758-4e02-b230-12364ca6d85e\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " Jun 09 14:55:26.190585 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.190562 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31c9b17f-a758-4e02-b230-12364ca6d85e-console-config\") pod \"31c9b17f-a758-4e02-b230-12364ca6d85e\" (UID: \"31c9b17f-a758-4e02-b230-12364ca6d85e\") " Jun 09 14:55:26.190699 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.190680 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31c9b17f-a758-4e02-b230-12364ca6d85e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "31c9b17f-a758-4e02-b230-12364ca6d85e" (UID: "31c9b17f-a758-4e02-b230-12364ca6d85e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:55:26.190870 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.190850 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31c9b17f-a758-4e02-b230-12364ca6d85e-oauth-serving-cert\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:55:26.190991 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.190888 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31c9b17f-a758-4e02-b230-12364ca6d85e-service-ca" (OuterVolumeSpecName: "service-ca") pod "31c9b17f-a758-4e02-b230-12364ca6d85e" (UID: "31c9b17f-a758-4e02-b230-12364ca6d85e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:55:26.191164 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.191107 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31c9b17f-a758-4e02-b230-12364ca6d85e-console-config" (OuterVolumeSpecName: "console-config") pod "31c9b17f-a758-4e02-b230-12364ca6d85e" (UID: "31c9b17f-a758-4e02-b230-12364ca6d85e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:55:26.193522 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.193456 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31c9b17f-a758-4e02-b230-12364ca6d85e-kube-api-access-m7hng" (OuterVolumeSpecName: "kube-api-access-m7hng") pod "31c9b17f-a758-4e02-b230-12364ca6d85e" (UID: "31c9b17f-a758-4e02-b230-12364ca6d85e"). InnerVolumeSpecName "kube-api-access-m7hng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:55:26.193965 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.193935 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31c9b17f-a758-4e02-b230-12364ca6d85e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "31c9b17f-a758-4e02-b230-12364ca6d85e" (UID: "31c9b17f-a758-4e02-b230-12364ca6d85e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:55:26.194088 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.194068 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31c9b17f-a758-4e02-b230-12364ca6d85e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "31c9b17f-a758-4e02-b230-12364ca6d85e" (UID: "31c9b17f-a758-4e02-b230-12364ca6d85e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:55:26.278044 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.277967 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-v7xmv_a283f045-0274-4381-8226-bc3824379571/download-server/0.log" Jun 09 14:55:26.291654 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.291625 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31c9b17f-a758-4e02-b230-12364ca6d85e-service-ca\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:55:26.291654 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.291653 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31c9b17f-a758-4e02-b230-12364ca6d85e-console-config\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:55:26.291817 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.291666 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31c9b17f-a758-4e02-b230-12364ca6d85e-console-oauth-config\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:55:26.291817 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.291675 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31c9b17f-a758-4e02-b230-12364ca6d85e-console-serving-cert\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:55:26.291817 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.291684 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7hng\" (UniqueName: \"kubernetes.io/projected/31c9b17f-a758-4e02-b230-12364ca6d85e-kube-api-access-m7hng\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:55:26.371404 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.371377 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9ff488864-c5rqs_31c9b17f-a758-4e02-b230-12364ca6d85e/console/0.log" Jun 09 14:55:26.371591 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.371420 2578 generic.go:356] "Generic (PLEG): container finished" podID="31c9b17f-a758-4e02-b230-12364ca6d85e" containerID="756894000eb5d22d1142c03db005874b99db191ca0f3b1848978123f1ecf5822" exitCode=137 Jun 09 14:55:26.371591 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.371490 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9ff488864-c5rqs" Jun 09 14:55:26.371591 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.371510 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9ff488864-c5rqs" event={"ID":"31c9b17f-a758-4e02-b230-12364ca6d85e","Type":"ContainerDied","Data":"756894000eb5d22d1142c03db005874b99db191ca0f3b1848978123f1ecf5822"} Jun 09 14:55:26.371591 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.371564 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9ff488864-c5rqs" event={"ID":"31c9b17f-a758-4e02-b230-12364ca6d85e","Type":"ContainerDied","Data":"4b49e30f155ee42313536329199f53f6b7569954727e5a6aa7b13a09d6ddf2eb"} Jun 09 14:55:26.371591 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.371592 2578 scope.go:117] "RemoveContainer" containerID="756894000eb5d22d1142c03db005874b99db191ca0f3b1848978123f1ecf5822" Jun 09 14:55:26.379835 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.379820 2578 scope.go:117] "RemoveContainer" containerID="756894000eb5d22d1142c03db005874b99db191ca0f3b1848978123f1ecf5822" Jun 09 14:55:26.380105 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:55:26.380085 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"756894000eb5d22d1142c03db005874b99db191ca0f3b1848978123f1ecf5822\": container with ID starting with 756894000eb5d22d1142c03db005874b99db191ca0f3b1848978123f1ecf5822 not found: ID does not exist" containerID="756894000eb5d22d1142c03db005874b99db191ca0f3b1848978123f1ecf5822" Jun 09 14:55:26.380160 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.380112 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"756894000eb5d22d1142c03db005874b99db191ca0f3b1848978123f1ecf5822"} err="failed to get container status \"756894000eb5d22d1142c03db005874b99db191ca0f3b1848978123f1ecf5822\": rpc error: code = NotFound desc = could not find container \"756894000eb5d22d1142c03db005874b99db191ca0f3b1848978123f1ecf5822\": container with ID starting with 756894000eb5d22d1142c03db005874b99db191ca0f3b1848978123f1ecf5822 not found: ID does not exist" Jun 09 14:55:26.396704 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.396680 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9ff488864-c5rqs"] Jun 09 14:55:26.400316 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:26.400294 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9ff488864-c5rqs"] Jun 09 14:55:28.075978 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:28.075952 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xmr49_a0b8851c-1232-44c1-bd3d-7755e87421ee/dns-node-resolver/0.log" Jun 09 14:55:28.339309 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:28.339226 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31c9b17f-a758-4e02-b230-12364ca6d85e" path="/var/lib/kubelet/pods/31c9b17f-a758-4e02-b230-12364ca6d85e/volumes" Jun 09 14:55:29.076328 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:29.076295 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cvjp4_40cc8edc-ca98-45ed-ac67-8ccdd0698b5e/node-ca/0.log" Jun 09 14:55:29.275993 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:29.275938 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-575b9d94b7-5jjqp_7a9edcb9-728c-4eba-9cdf-cc677ec92497/router/0.log" Jun 09 14:55:29.676416 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:29.676387 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gcxj7_99263755-4406-4d24-a336-6ece74ce3e0f/serve-healthcheck-canary/0.log" Jun 09 14:55:32.590830 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:32.590794 2578 patch_prober.go:28] interesting pod/console-669f58544d-482kr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jun 09 14:55:32.591254 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:32.590868 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-669f58544d-482kr" podUID="82a6cee3-c195-4187-9053-3d96acbf716b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jun 09 14:55:33.835617 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:55:33.835561 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-l98bt" podUID="0cfb1a71-c3ea-499d-8b91-db6188e1b952" Jun 09 14:55:34.408918 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:34.408886 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l98bt" Jun 09 14:55:35.819631 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:35.819594 2578 patch_prober.go:28] interesting pod/console-574886f55f-s8s4f container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 09 14:55:35.820018 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:35.819666 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-574886f55f-s8s4f" podUID="242f54d0-c841-4982-a1cb-f1a03d62c24e" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 09 14:55:37.198723 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:37.198670 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:55:37.201163 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:37.201132 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0cfb1a71-c3ea-499d-8b91-db6188e1b952-metrics-tls\") pod \"dns-default-l98bt\" (UID: \"0cfb1a71-c3ea-499d-8b91-db6188e1b952\") " pod="openshift-dns/dns-default-l98bt" Jun 09 14:55:37.414898 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:37.414863 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sk827\"" Jun 09 14:55:37.420492 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:37.420449 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l98bt" Jun 09 14:55:37.577794 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:37.577772 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l98bt"] Jun 09 14:55:37.580496 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:55:37.580443 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cfb1a71_c3ea_499d_8b91_db6188e1b952.slice/crio-8c7a7b29bdd193ba7615a37cf6c2fd5d5a965e9f144101715d7d0c49c8199798 WatchSource:0}: Error finding container 8c7a7b29bdd193ba7615a37cf6c2fd5d5a965e9f144101715d7d0c49c8199798: Status 404 returned error can't find the container with id 8c7a7b29bdd193ba7615a37cf6c2fd5d5a965e9f144101715d7d0c49c8199798 Jun 09 14:55:38.426562 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:38.426518 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l98bt" event={"ID":"0cfb1a71-c3ea-499d-8b91-db6188e1b952","Type":"ContainerStarted","Data":"8c7a7b29bdd193ba7615a37cf6c2fd5d5a965e9f144101715d7d0c49c8199798"} Jun 09 14:55:39.432631 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:39.432597 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l98bt" event={"ID":"0cfb1a71-c3ea-499d-8b91-db6188e1b952","Type":"ContainerStarted","Data":"57aa950361e91f25625227e0c57b5c9d567a46a389ff611a7dac89c3fa270662"} Jun 09 14:55:40.439084 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:40.439048 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l98bt" event={"ID":"0cfb1a71-c3ea-499d-8b91-db6188e1b952","Type":"ContainerStarted","Data":"707f6885fcf7c5e5ffe18dbaf5bc150739632c889f558f37f88e792aed8025b9"} Jun 09 14:55:40.439501 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:40.439153 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l98bt" Jun 09 14:55:40.460699 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:40.460636 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l98bt" podStartSLOduration=251.793956428 podStartE2EDuration="4m13.460607972s" totalImagesPullingTime="1.666651544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:55:40.458527176 +0000 UTC m=+288.603108161" watchObservedRunningTime="2026-06-09 14:55:40.460607972 +0000 UTC m=+288.605188957" Jun 09 14:55:42.590729 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:42.590693 2578 patch_prober.go:28] interesting pod/console-669f58544d-482kr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jun 09 14:55:42.591142 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:42.590751 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-669f58544d-482kr" podUID="82a6cee3-c195-4187-9053-3d96acbf716b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jun 09 14:55:45.819418 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:45.819384 2578 patch_prober.go:28] interesting pod/console-574886f55f-s8s4f container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 09 14:55:45.819835 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:45.819435 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-574886f55f-s8s4f" podUID="242f54d0-c841-4982-a1cb-f1a03d62c24e" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 09 14:55:47.268170 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:47.268121 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:55:47.285094 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:47.285065 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:55:47.484205 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:47.484179 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:55:50.445037 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:50.445001 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l98bt" Jun 09 14:55:52.279896 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:52.279870 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-kkp7w_0ab77b52-1ec6-4db7-9452-26d0f6866afe/console-operator/1.log" Jun 09 14:55:52.281653 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:52.281631 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-kkp7w_0ab77b52-1ec6-4db7-9452-26d0f6866afe/console-operator/1.log" Jun 09 14:55:52.284746 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:52.284720 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nc4z6_6e268462-1c4d-45ec-ae83-ac7fb55f6e6b/ovn-acl-logging/0.log" Jun 09 14:55:52.286116 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:52.286099 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nc4z6_6e268462-1c4d-45ec-ae83-ac7fb55f6e6b/ovn-acl-logging/0.log" Jun 09 14:55:52.291662 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:52.291643 2578 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 14:55:52.594315 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:52.594283 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-669f58544d-482kr" Jun 09 14:55:52.598184 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:52.598159 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-669f58544d-482kr" Jun 09 14:55:55.823177 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:55.823146 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:55:55.826898 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:55.826876 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:55:55.903727 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:55:55.903695 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-669f58544d-482kr"] Jun 09 14:56:01.012633 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:01.012598 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 14:56:01.013023 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:01.012891 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="alertmanager" containerID="cri-o://4e6c36891ee3880270bad2a6dc1969c200aaf165384c4dd63218324e38957126" gracePeriod=120 Jun 09 14:56:01.013023 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:01.012956 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="kube-rbac-proxy-metric" containerID="cri-o://629b82c34b3d512622b0c52c90b582b71b3dd10b20fe812757a1adbef70277f1" gracePeriod=120 Jun 09 14:56:01.013151 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:01.013000 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="prom-label-proxy" containerID="cri-o://fb784aa43edb260ffc961bf182bfc24be6925cacf890d8cc51a9ee362c7c3e5f" gracePeriod=120 Jun 09 14:56:01.013151 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:01.013031 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="config-reloader" containerID="cri-o://17b1b6ceeee3e31df3ecef3e9df5a624cb598b276c1e631e9d9147b4fd659da2" gracePeriod=120 Jun 09 14:56:01.013151 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:01.012997 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="kube-rbac-proxy-web" containerID="cri-o://ec3826782f83f5c73227a3ccdda2f36f4298fb92c8f6e3c5baaec10a1d720f94" gracePeriod=120 Jun 09 14:56:01.013316 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:01.013176 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="kube-rbac-proxy" containerID="cri-o://c968879f8cd857f9969282cb868d8f0707afbe297b9c3391a83af6e663e561f3" gracePeriod=120 Jun 09 14:56:01.527909 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:01.527873 2578 generic.go:356] "Generic (PLEG): container finished" podID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerID="fb784aa43edb260ffc961bf182bfc24be6925cacf890d8cc51a9ee362c7c3e5f" exitCode=0 Jun 09 14:56:01.527909 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:01.527899 2578 generic.go:356] "Generic (PLEG): container finished" podID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerID="c968879f8cd857f9969282cb868d8f0707afbe297b9c3391a83af6e663e561f3" exitCode=0 Jun 09 14:56:01.527909 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:01.527905 2578 generic.go:356] "Generic (PLEG): container finished" podID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerID="17b1b6ceeee3e31df3ecef3e9df5a624cb598b276c1e631e9d9147b4fd659da2" exitCode=0 Jun 09 14:56:01.527909 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:01.527910 2578 generic.go:356] "Generic (PLEG): container finished" podID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerID="4e6c36891ee3880270bad2a6dc1969c200aaf165384c4dd63218324e38957126" exitCode=0 Jun 09 14:56:01.528178 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:01.527945 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef1db7b3-4925-4947-aa36-9ac950016f36","Type":"ContainerDied","Data":"fb784aa43edb260ffc961bf182bfc24be6925cacf890d8cc51a9ee362c7c3e5f"} Jun 09 14:56:01.528178 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:01.528011 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef1db7b3-4925-4947-aa36-9ac950016f36","Type":"ContainerDied","Data":"c968879f8cd857f9969282cb868d8f0707afbe297b9c3391a83af6e663e561f3"} Jun 09 14:56:01.528178 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:01.528039 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef1db7b3-4925-4947-aa36-9ac950016f36","Type":"ContainerDied","Data":"17b1b6ceeee3e31df3ecef3e9df5a624cb598b276c1e631e9d9147b4fd659da2"} Jun 09 14:56:01.528178 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:01.528074 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef1db7b3-4925-4947-aa36-9ac950016f36","Type":"ContainerDied","Data":"4e6c36891ee3880270bad2a6dc1969c200aaf165384c4dd63218324e38957126"} Jun 09 14:56:02.254635 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.254611 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.329539 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.329446 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-web-config\") pod \"ef1db7b3-4925-4947-aa36-9ac950016f36\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " Jun 09 14:56:02.329702 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.329538 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-kube-rbac-proxy\") pod \"ef1db7b3-4925-4947-aa36-9ac950016f36\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " Jun 09 14:56:02.329702 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.329584 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-cluster-tls-config\") pod \"ef1db7b3-4925-4947-aa36-9ac950016f36\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " Jun 09 14:56:02.329702 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.329612 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef1db7b3-4925-4947-aa36-9ac950016f36-config-out\") pod \"ef1db7b3-4925-4947-aa36-9ac950016f36\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " Jun 09 14:56:02.329702 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.329637 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-kube-rbac-proxy-web\") pod \"ef1db7b3-4925-4947-aa36-9ac950016f36\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " Jun 09 14:56:02.329702 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.329668 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-main-tls\") pod \"ef1db7b3-4925-4947-aa36-9ac950016f36\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " Jun 09 14:56:02.329702 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.329696 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ef1db7b3-4925-4947-aa36-9ac950016f36\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " Jun 09 14:56:02.330014 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.329735 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef1db7b3-4925-4947-aa36-9ac950016f36-alertmanager-trusted-ca-bundle\") pod \"ef1db7b3-4925-4947-aa36-9ac950016f36\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " Jun 09 14:56:02.330014 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.329762 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef1db7b3-4925-4947-aa36-9ac950016f36-tls-assets\") pod \"ef1db7b3-4925-4947-aa36-9ac950016f36\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " Jun 09 14:56:02.330014 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.329791 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hgq9\" (UniqueName: \"kubernetes.io/projected/ef1db7b3-4925-4947-aa36-9ac950016f36-kube-api-access-4hgq9\") pod \"ef1db7b3-4925-4947-aa36-9ac950016f36\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " Jun 09 14:56:02.330014 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.329847 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-config-volume\") pod \"ef1db7b3-4925-4947-aa36-9ac950016f36\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " Jun 09 14:56:02.330014 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.329871 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ef1db7b3-4925-4947-aa36-9ac950016f36-alertmanager-main-db\") pod \"ef1db7b3-4925-4947-aa36-9ac950016f36\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " Jun 09 14:56:02.330014 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.329913 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef1db7b3-4925-4947-aa36-9ac950016f36-metrics-client-ca\") pod \"ef1db7b3-4925-4947-aa36-9ac950016f36\" (UID: \"ef1db7b3-4925-4947-aa36-9ac950016f36\") " Jun 09 14:56:02.330544 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.330506 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef1db7b3-4925-4947-aa36-9ac950016f36-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ef1db7b3-4925-4947-aa36-9ac950016f36" (UID: "ef1db7b3-4925-4947-aa36-9ac950016f36"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:56:02.332632 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.332586 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef1db7b3-4925-4947-aa36-9ac950016f36-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ef1db7b3-4925-4947-aa36-9ac950016f36" (UID: "ef1db7b3-4925-4947-aa36-9ac950016f36"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:56:02.333052 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.333018 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef1db7b3-4925-4947-aa36-9ac950016f36-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ef1db7b3-4925-4947-aa36-9ac950016f36" (UID: "ef1db7b3-4925-4947-aa36-9ac950016f36"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:56:02.333707 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.333303 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef1db7b3-4925-4947-aa36-9ac950016f36-config-out" (OuterVolumeSpecName: "config-out") pod "ef1db7b3-4925-4947-aa36-9ac950016f36" (UID: "ef1db7b3-4925-4947-aa36-9ac950016f36"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:56:02.333940 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.333904 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ef1db7b3-4925-4947-aa36-9ac950016f36" (UID: "ef1db7b3-4925-4947-aa36-9ac950016f36"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:56:02.334442 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.334407 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ef1db7b3-4925-4947-aa36-9ac950016f36" (UID: "ef1db7b3-4925-4947-aa36-9ac950016f36"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:56:02.334568 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.334512 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef1db7b3-4925-4947-aa36-9ac950016f36-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ef1db7b3-4925-4947-aa36-9ac950016f36" (UID: "ef1db7b3-4925-4947-aa36-9ac950016f36"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:56:02.335178 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.335153 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ef1db7b3-4925-4947-aa36-9ac950016f36" (UID: "ef1db7b3-4925-4947-aa36-9ac950016f36"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:56:02.335447 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.335408 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-config-volume" (OuterVolumeSpecName: "config-volume") pod "ef1db7b3-4925-4947-aa36-9ac950016f36" (UID: "ef1db7b3-4925-4947-aa36-9ac950016f36"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:56:02.336896 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.336864 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef1db7b3-4925-4947-aa36-9ac950016f36-kube-api-access-4hgq9" (OuterVolumeSpecName: "kube-api-access-4hgq9") pod "ef1db7b3-4925-4947-aa36-9ac950016f36" (UID: "ef1db7b3-4925-4947-aa36-9ac950016f36"). InnerVolumeSpecName "kube-api-access-4hgq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:56:02.336987 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.336889 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ef1db7b3-4925-4947-aa36-9ac950016f36" (UID: "ef1db7b3-4925-4947-aa36-9ac950016f36"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:56:02.338906 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.338881 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ef1db7b3-4925-4947-aa36-9ac950016f36" (UID: "ef1db7b3-4925-4947-aa36-9ac950016f36"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:56:02.347346 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.347322 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-web-config" (OuterVolumeSpecName: "web-config") pod "ef1db7b3-4925-4947-aa36-9ac950016f36" (UID: "ef1db7b3-4925-4947-aa36-9ac950016f36"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:56:02.431157 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.431121 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-config-volume\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:02.431157 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.431149 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ef1db7b3-4925-4947-aa36-9ac950016f36-alertmanager-main-db\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:02.431157 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.431161 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef1db7b3-4925-4947-aa36-9ac950016f36-metrics-client-ca\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:02.431382 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.431170 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-web-config\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:02.431382 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.431179 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:02.431382 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.431189 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-cluster-tls-config\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:02.431382 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.431196 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef1db7b3-4925-4947-aa36-9ac950016f36-config-out\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:02.431382 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.431204 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:02.431382 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.431212 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-main-tls\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:02.431382 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.431221 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ef1db7b3-4925-4947-aa36-9ac950016f36-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:02.431382 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.431229 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef1db7b3-4925-4947-aa36-9ac950016f36-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:02.431382 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.431238 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef1db7b3-4925-4947-aa36-9ac950016f36-tls-assets\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:02.431382 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.431246 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hgq9\" (UniqueName: \"kubernetes.io/projected/ef1db7b3-4925-4947-aa36-9ac950016f36-kube-api-access-4hgq9\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:02.534909 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.534877 2578 generic.go:356] "Generic (PLEG): container finished" podID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerID="629b82c34b3d512622b0c52c90b582b71b3dd10b20fe812757a1adbef70277f1" exitCode=0 Jun 09 14:56:02.534909 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.534902 2578 generic.go:356] "Generic (PLEG): container finished" podID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerID="ec3826782f83f5c73227a3ccdda2f36f4298fb92c8f6e3c5baaec10a1d720f94" exitCode=0 Jun 09 14:56:02.535108 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.534958 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef1db7b3-4925-4947-aa36-9ac950016f36","Type":"ContainerDied","Data":"629b82c34b3d512622b0c52c90b582b71b3dd10b20fe812757a1adbef70277f1"} Jun 09 14:56:02.535108 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.534970 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.535108 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.535023 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef1db7b3-4925-4947-aa36-9ac950016f36","Type":"ContainerDied","Data":"ec3826782f83f5c73227a3ccdda2f36f4298fb92c8f6e3c5baaec10a1d720f94"} Jun 09 14:56:02.535108 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.535049 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef1db7b3-4925-4947-aa36-9ac950016f36","Type":"ContainerDied","Data":"aa8153079351ba3187e701a2bfe6ef08f0f58bccf952fa9482eb3806c1a9c35c"} Jun 09 14:56:02.535108 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.535080 2578 scope.go:117] "RemoveContainer" containerID="fb784aa43edb260ffc961bf182bfc24be6925cacf890d8cc51a9ee362c7c3e5f" Jun 09 14:56:02.544007 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.543986 2578 scope.go:117] "RemoveContainer" containerID="629b82c34b3d512622b0c52c90b582b71b3dd10b20fe812757a1adbef70277f1" Jun 09 14:56:02.551319 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.551302 2578 scope.go:117] "RemoveContainer" containerID="c968879f8cd857f9969282cb868d8f0707afbe297b9c3391a83af6e663e561f3" Jun 09 14:56:02.558377 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.558358 2578 scope.go:117] "RemoveContainer" containerID="ec3826782f83f5c73227a3ccdda2f36f4298fb92c8f6e3c5baaec10a1d720f94" Jun 09 14:56:02.562326 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.562304 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 14:56:02.565785 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.565758 2578 scope.go:117] "RemoveContainer" containerID="17b1b6ceeee3e31df3ecef3e9df5a624cb598b276c1e631e9d9147b4fd659da2" Jun 09 14:56:02.569528 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.569503 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 14:56:02.573788 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.573767 2578 scope.go:117] "RemoveContainer" containerID="4e6c36891ee3880270bad2a6dc1969c200aaf165384c4dd63218324e38957126" Jun 09 14:56:02.580968 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.580952 2578 scope.go:117] "RemoveContainer" containerID="847a655c0daa85391f7acb803ad44a18caf036cc68a44daa9ace01c30a89f4fa" Jun 09 14:56:02.588072 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.588043 2578 scope.go:117] "RemoveContainer" containerID="fb784aa43edb260ffc961bf182bfc24be6925cacf890d8cc51a9ee362c7c3e5f" Jun 09 14:56:02.588376 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:56:02.588346 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb784aa43edb260ffc961bf182bfc24be6925cacf890d8cc51a9ee362c7c3e5f\": container with ID starting with fb784aa43edb260ffc961bf182bfc24be6925cacf890d8cc51a9ee362c7c3e5f not found: ID does not exist" containerID="fb784aa43edb260ffc961bf182bfc24be6925cacf890d8cc51a9ee362c7c3e5f" Jun 09 14:56:02.588458 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.588388 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb784aa43edb260ffc961bf182bfc24be6925cacf890d8cc51a9ee362c7c3e5f"} err="failed to get container status \"fb784aa43edb260ffc961bf182bfc24be6925cacf890d8cc51a9ee362c7c3e5f\": rpc error: code = NotFound desc = could not find container \"fb784aa43edb260ffc961bf182bfc24be6925cacf890d8cc51a9ee362c7c3e5f\": container with ID starting with fb784aa43edb260ffc961bf182bfc24be6925cacf890d8cc51a9ee362c7c3e5f not found: ID does not exist" Jun 09 14:56:02.588458 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.588416 2578 scope.go:117] "RemoveContainer" containerID="629b82c34b3d512622b0c52c90b582b71b3dd10b20fe812757a1adbef70277f1" Jun 09 14:56:02.588691 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:56:02.588668 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"629b82c34b3d512622b0c52c90b582b71b3dd10b20fe812757a1adbef70277f1\": container with ID starting with 629b82c34b3d512622b0c52c90b582b71b3dd10b20fe812757a1adbef70277f1 not found: ID does not exist" containerID="629b82c34b3d512622b0c52c90b582b71b3dd10b20fe812757a1adbef70277f1" Jun 09 14:56:02.588741 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.588696 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"629b82c34b3d512622b0c52c90b582b71b3dd10b20fe812757a1adbef70277f1"} err="failed to get container status \"629b82c34b3d512622b0c52c90b582b71b3dd10b20fe812757a1adbef70277f1\": rpc error: code = NotFound desc = could not find container \"629b82c34b3d512622b0c52c90b582b71b3dd10b20fe812757a1adbef70277f1\": container with ID starting with 629b82c34b3d512622b0c52c90b582b71b3dd10b20fe812757a1adbef70277f1 not found: ID does not exist" Jun 09 14:56:02.588741 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.588711 2578 scope.go:117] "RemoveContainer" containerID="c968879f8cd857f9969282cb868d8f0707afbe297b9c3391a83af6e663e561f3" Jun 09 14:56:02.588917 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:56:02.588899 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c968879f8cd857f9969282cb868d8f0707afbe297b9c3391a83af6e663e561f3\": container with ID starting with c968879f8cd857f9969282cb868d8f0707afbe297b9c3391a83af6e663e561f3 not found: ID does not exist" containerID="c968879f8cd857f9969282cb868d8f0707afbe297b9c3391a83af6e663e561f3" Jun 09 14:56:02.589004 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.588923 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c968879f8cd857f9969282cb868d8f0707afbe297b9c3391a83af6e663e561f3"} err="failed to get container status \"c968879f8cd857f9969282cb868d8f0707afbe297b9c3391a83af6e663e561f3\": rpc error: code = NotFound desc = could not find container \"c968879f8cd857f9969282cb868d8f0707afbe297b9c3391a83af6e663e561f3\": container with ID starting with c968879f8cd857f9969282cb868d8f0707afbe297b9c3391a83af6e663e561f3 not found: ID does not exist" Jun 09 14:56:02.589004 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.588938 2578 scope.go:117] "RemoveContainer" containerID="ec3826782f83f5c73227a3ccdda2f36f4298fb92c8f6e3c5baaec10a1d720f94" Jun 09 14:56:02.589210 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:56:02.589191 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec3826782f83f5c73227a3ccdda2f36f4298fb92c8f6e3c5baaec10a1d720f94\": container with ID starting with ec3826782f83f5c73227a3ccdda2f36f4298fb92c8f6e3c5baaec10a1d720f94 not found: ID does not exist" containerID="ec3826782f83f5c73227a3ccdda2f36f4298fb92c8f6e3c5baaec10a1d720f94" Jun 09 14:56:02.589249 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.589216 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec3826782f83f5c73227a3ccdda2f36f4298fb92c8f6e3c5baaec10a1d720f94"} err="failed to get container status \"ec3826782f83f5c73227a3ccdda2f36f4298fb92c8f6e3c5baaec10a1d720f94\": rpc error: code = NotFound desc = could not find container \"ec3826782f83f5c73227a3ccdda2f36f4298fb92c8f6e3c5baaec10a1d720f94\": container with ID starting with ec3826782f83f5c73227a3ccdda2f36f4298fb92c8f6e3c5baaec10a1d720f94 not found: ID does not exist" Jun 09 14:56:02.589249 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.589230 2578 scope.go:117] "RemoveContainer" containerID="17b1b6ceeee3e31df3ecef3e9df5a624cb598b276c1e631e9d9147b4fd659da2" Jun 09 14:56:02.589461 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:56:02.589447 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17b1b6ceeee3e31df3ecef3e9df5a624cb598b276c1e631e9d9147b4fd659da2\": container with ID starting with 17b1b6ceeee3e31df3ecef3e9df5a624cb598b276c1e631e9d9147b4fd659da2 not found: ID does not exist" containerID="17b1b6ceeee3e31df3ecef3e9df5a624cb598b276c1e631e9d9147b4fd659da2" Jun 09 14:56:02.589534 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.589464 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b1b6ceeee3e31df3ecef3e9df5a624cb598b276c1e631e9d9147b4fd659da2"} err="failed to get container status \"17b1b6ceeee3e31df3ecef3e9df5a624cb598b276c1e631e9d9147b4fd659da2\": rpc error: code = NotFound desc = could not find container \"17b1b6ceeee3e31df3ecef3e9df5a624cb598b276c1e631e9d9147b4fd659da2\": container with ID starting with 17b1b6ceeee3e31df3ecef3e9df5a624cb598b276c1e631e9d9147b4fd659da2 not found: ID does not exist" Jun 09 14:56:02.589534 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.589500 2578 scope.go:117] "RemoveContainer" containerID="4e6c36891ee3880270bad2a6dc1969c200aaf165384c4dd63218324e38957126" Jun 09 14:56:02.589738 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:56:02.589718 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e6c36891ee3880270bad2a6dc1969c200aaf165384c4dd63218324e38957126\": container with ID starting with 4e6c36891ee3880270bad2a6dc1969c200aaf165384c4dd63218324e38957126 not found: ID does not exist" containerID="4e6c36891ee3880270bad2a6dc1969c200aaf165384c4dd63218324e38957126" Jun 09 14:56:02.589781 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.589743 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e6c36891ee3880270bad2a6dc1969c200aaf165384c4dd63218324e38957126"} err="failed to get container status \"4e6c36891ee3880270bad2a6dc1969c200aaf165384c4dd63218324e38957126\": rpc error: code = NotFound desc = could not find container \"4e6c36891ee3880270bad2a6dc1969c200aaf165384c4dd63218324e38957126\": container with ID starting with 4e6c36891ee3880270bad2a6dc1969c200aaf165384c4dd63218324e38957126 not found: ID does not exist" Jun 09 14:56:02.589781 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.589757 2578 scope.go:117] "RemoveContainer" containerID="847a655c0daa85391f7acb803ad44a18caf036cc68a44daa9ace01c30a89f4fa" Jun 09 14:56:02.589959 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:56:02.589944 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"847a655c0daa85391f7acb803ad44a18caf036cc68a44daa9ace01c30a89f4fa\": container with ID starting with 847a655c0daa85391f7acb803ad44a18caf036cc68a44daa9ace01c30a89f4fa not found: ID does not exist" containerID="847a655c0daa85391f7acb803ad44a18caf036cc68a44daa9ace01c30a89f4fa" Jun 09 14:56:02.589996 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.589963 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847a655c0daa85391f7acb803ad44a18caf036cc68a44daa9ace01c30a89f4fa"} err="failed to get container status \"847a655c0daa85391f7acb803ad44a18caf036cc68a44daa9ace01c30a89f4fa\": rpc error: code = NotFound desc = could not find container \"847a655c0daa85391f7acb803ad44a18caf036cc68a44daa9ace01c30a89f4fa\": container with ID starting with 847a655c0daa85391f7acb803ad44a18caf036cc68a44daa9ace01c30a89f4fa not found: ID does not exist" Jun 09 14:56:02.589996 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.589977 2578 scope.go:117] "RemoveContainer" containerID="fb784aa43edb260ffc961bf182bfc24be6925cacf890d8cc51a9ee362c7c3e5f" Jun 09 14:56:02.590192 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.590178 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb784aa43edb260ffc961bf182bfc24be6925cacf890d8cc51a9ee362c7c3e5f"} err="failed to get container status \"fb784aa43edb260ffc961bf182bfc24be6925cacf890d8cc51a9ee362c7c3e5f\": rpc error: code = NotFound desc = could not find container \"fb784aa43edb260ffc961bf182bfc24be6925cacf890d8cc51a9ee362c7c3e5f\": container with ID starting with fb784aa43edb260ffc961bf182bfc24be6925cacf890d8cc51a9ee362c7c3e5f not found: ID does not exist" Jun 09 14:56:02.590233 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.590192 2578 scope.go:117] "RemoveContainer" containerID="629b82c34b3d512622b0c52c90b582b71b3dd10b20fe812757a1adbef70277f1" Jun 09 14:56:02.590369 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.590355 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"629b82c34b3d512622b0c52c90b582b71b3dd10b20fe812757a1adbef70277f1"} err="failed to get container status \"629b82c34b3d512622b0c52c90b582b71b3dd10b20fe812757a1adbef70277f1\": rpc error: code = NotFound desc = could not find container \"629b82c34b3d512622b0c52c90b582b71b3dd10b20fe812757a1adbef70277f1\": container with ID starting with 629b82c34b3d512622b0c52c90b582b71b3dd10b20fe812757a1adbef70277f1 not found: ID does not exist" Jun 09 14:56:02.590369 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.590368 2578 scope.go:117] "RemoveContainer" containerID="c968879f8cd857f9969282cb868d8f0707afbe297b9c3391a83af6e663e561f3" Jun 09 14:56:02.590570 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.590553 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c968879f8cd857f9969282cb868d8f0707afbe297b9c3391a83af6e663e561f3"} err="failed to get container status \"c968879f8cd857f9969282cb868d8f0707afbe297b9c3391a83af6e663e561f3\": rpc error: code = NotFound desc = could not find container \"c968879f8cd857f9969282cb868d8f0707afbe297b9c3391a83af6e663e561f3\": container with ID starting with c968879f8cd857f9969282cb868d8f0707afbe297b9c3391a83af6e663e561f3 not found: ID does not exist" Jun 09 14:56:02.590627 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.590569 2578 scope.go:117] "RemoveContainer" containerID="ec3826782f83f5c73227a3ccdda2f36f4298fb92c8f6e3c5baaec10a1d720f94" Jun 09 14:56:02.590748 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.590733 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec3826782f83f5c73227a3ccdda2f36f4298fb92c8f6e3c5baaec10a1d720f94"} err="failed to get container status \"ec3826782f83f5c73227a3ccdda2f36f4298fb92c8f6e3c5baaec10a1d720f94\": rpc error: code = NotFound desc = could not find container \"ec3826782f83f5c73227a3ccdda2f36f4298fb92c8f6e3c5baaec10a1d720f94\": container with ID starting with ec3826782f83f5c73227a3ccdda2f36f4298fb92c8f6e3c5baaec10a1d720f94 not found: ID does not exist" Jun 09 14:56:02.590748 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.590747 2578 scope.go:117] "RemoveContainer" containerID="17b1b6ceeee3e31df3ecef3e9df5a624cb598b276c1e631e9d9147b4fd659da2" Jun 09 14:56:02.590905 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.590892 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b1b6ceeee3e31df3ecef3e9df5a624cb598b276c1e631e9d9147b4fd659da2"} err="failed to get container status \"17b1b6ceeee3e31df3ecef3e9df5a624cb598b276c1e631e9d9147b4fd659da2\": rpc error: code = NotFound desc = could not find container \"17b1b6ceeee3e31df3ecef3e9df5a624cb598b276c1e631e9d9147b4fd659da2\": container with ID starting with 17b1b6ceeee3e31df3ecef3e9df5a624cb598b276c1e631e9d9147b4fd659da2 not found: ID does not exist" Jun 09 14:56:02.590905 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.590904 2578 scope.go:117] "RemoveContainer" containerID="4e6c36891ee3880270bad2a6dc1969c200aaf165384c4dd63218324e38957126" Jun 09 14:56:02.591066 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.591052 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e6c36891ee3880270bad2a6dc1969c200aaf165384c4dd63218324e38957126"} err="failed to get container status \"4e6c36891ee3880270bad2a6dc1969c200aaf165384c4dd63218324e38957126\": rpc error: code = NotFound desc = could not find container \"4e6c36891ee3880270bad2a6dc1969c200aaf165384c4dd63218324e38957126\": container with ID starting with 4e6c36891ee3880270bad2a6dc1969c200aaf165384c4dd63218324e38957126 not found: ID does not exist" Jun 09 14:56:02.591066 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.591065 2578 scope.go:117] "RemoveContainer" containerID="847a655c0daa85391f7acb803ad44a18caf036cc68a44daa9ace01c30a89f4fa" Jun 09 14:56:02.591243 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.591225 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847a655c0daa85391f7acb803ad44a18caf036cc68a44daa9ace01c30a89f4fa"} err="failed to get container status \"847a655c0daa85391f7acb803ad44a18caf036cc68a44daa9ace01c30a89f4fa\": rpc error: code = NotFound desc = could not find container \"847a655c0daa85391f7acb803ad44a18caf036cc68a44daa9ace01c30a89f4fa\": container with ID starting with 847a655c0daa85391f7acb803ad44a18caf036cc68a44daa9ace01c30a89f4fa not found: ID does not exist" Jun 09 14:56:02.598151 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598130 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 14:56:02.598430 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598419 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31c9b17f-a758-4e02-b230-12364ca6d85e" containerName="console" Jun 09 14:56:02.598495 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598432 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="31c9b17f-a758-4e02-b230-12364ca6d85e" containerName="console" Jun 09 14:56:02.598495 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598445 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="kube-rbac-proxy-web" Jun 09 14:56:02.598495 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598451 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="kube-rbac-proxy-web" Jun 09 14:56:02.598495 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598459 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="alertmanager" Jun 09 14:56:02.598495 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598464 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="alertmanager" Jun 09 14:56:02.598655 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598516 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="kube-rbac-proxy-metric" Jun 09 14:56:02.598655 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598524 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="kube-rbac-proxy-metric" Jun 09 14:56:02.598655 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598536 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="prom-label-proxy" Jun 09 14:56:02.598655 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598541 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="prom-label-proxy" Jun 09 14:56:02.598655 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598548 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="config-reloader" Jun 09 14:56:02.598655 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598553 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="config-reloader" Jun 09 14:56:02.598655 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598563 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="init-config-reloader" Jun 09 14:56:02.598655 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598568 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="init-config-reloader" Jun 09 14:56:02.598655 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598574 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="kube-rbac-proxy" Jun 09 14:56:02.598655 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598578 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="kube-rbac-proxy" Jun 09 14:56:02.598655 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598629 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="kube-rbac-proxy-metric" Jun 09 14:56:02.598655 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598637 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="alertmanager" Jun 09 14:56:02.598655 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598644 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="prom-label-proxy" Jun 09 14:56:02.598655 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598649 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="config-reloader" Jun 09 14:56:02.598655 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598655 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="31c9b17f-a758-4e02-b230-12364ca6d85e" containerName="console" Jun 09 14:56:02.598655 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598661 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="kube-rbac-proxy-web" Jun 09 14:56:02.599129 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.598667 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" containerName="kube-rbac-proxy" Jun 09 14:56:02.602560 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.602540 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.605522 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.605489 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 14:56:02.605522 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.605492 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 14:56:02.605686 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.605518 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 14:56:02.605686 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.605531 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jmlbn\"" Jun 09 14:56:02.605816 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.605801 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 14:56:02.605863 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.605834 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 14:56:02.605917 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.605904 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 14:56:02.606094 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.606083 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 14:56:02.606385 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.606373 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 14:56:02.613139 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.613121 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 14:56:02.617401 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.617380 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 14:56:02.632384 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.632348 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbt2v\" (UniqueName: \"kubernetes.io/projected/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-kube-api-access-qbt2v\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.632569 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.632400 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-config-out\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.632569 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.632448 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.632569 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.632499 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-config-volume\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.632569 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.632527 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.632722 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.632596 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.632722 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.632621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-web-config\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.632722 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.632639 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.632722 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.632668 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.632722 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.632715 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.632958 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.632736 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.632958 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.632756 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.632958 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.632805 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.733235 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.733150 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-config-out\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.733422 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.733267 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.733422 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.733296 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-config-volume\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.733422 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.733315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.733422 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.733337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.733422 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.733358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-web-config\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.733422 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.733375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.733788 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.733426 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.733788 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.733512 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.733788 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.733551 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.733788 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.733586 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.733788 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.733623 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.733788 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.733674 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbt2v\" (UniqueName: \"kubernetes.io/projected/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-kube-api-access-qbt2v\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.733788 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.733757 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.734459 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.734339 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.735297 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.735256 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.736745 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.736562 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.736745 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.736705 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-config-out\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.737105 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.737079 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.737184 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.737162 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.737184 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.737176 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.737295 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.737245 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-config-volume\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.737453 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.737434 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-web-config\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.737694 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.737679 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.738173 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.738158 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.742370 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.742353 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbt2v\" (UniqueName: \"kubernetes.io/projected/c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746-kube-api-access-qbt2v\") pod \"alertmanager-main-0\" (UID: \"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:02.913583 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:02.913507 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 14:56:03.064641 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:03.064616 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 14:56:03.066532 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:56:03.066500 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7acd53c_bc6b_4f43_9aba_5cd9a8cd2746.slice/crio-6ee6544f671184e8667a475cab401a8e38f83d591fedb858509b213f2ac44c76 WatchSource:0}: Error finding container 6ee6544f671184e8667a475cab401a8e38f83d591fedb858509b213f2ac44c76: Status 404 returned error can't find the container with id 6ee6544f671184e8667a475cab401a8e38f83d591fedb858509b213f2ac44c76 Jun 09 14:56:03.545393 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:03.545358 2578 generic.go:356] "Generic (PLEG): container finished" podID="c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746" containerID="db73a165d9585b80b0cb7d2a4458ece8326d98a4c1e64703e086ed38fdf23c96" exitCode=0 Jun 09 14:56:03.545863 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:03.545451 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746","Type":"ContainerDied","Data":"db73a165d9585b80b0cb7d2a4458ece8326d98a4c1e64703e086ed38fdf23c96"} Jun 09 14:56:03.545863 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:03.545580 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746","Type":"ContainerStarted","Data":"6ee6544f671184e8667a475cab401a8e38f83d591fedb858509b213f2ac44c76"} Jun 09 14:56:04.338868 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:04.338838 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef1db7b3-4925-4947-aa36-9ac950016f36" path="/var/lib/kubelet/pods/ef1db7b3-4925-4947-aa36-9ac950016f36/volumes" Jun 09 14:56:04.553981 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:04.553950 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746","Type":"ContainerStarted","Data":"5f3e2e97e09dabba2f6e6bc3e23e7c9446264a648f17f1965ffe4345049d9216"} Jun 09 14:56:04.554364 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:04.554013 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746","Type":"ContainerStarted","Data":"fd592e264ff143023940394f7d9685ab2532e3ee52e28bc3388f3574b574c5c3"} Jun 09 14:56:04.554364 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:04.554039 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746","Type":"ContainerStarted","Data":"eb971f73cb6d83b4e459db654fbed514096534c39dbe99afaf6824d0db7d52cc"} Jun 09 14:56:04.554364 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:04.554068 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746","Type":"ContainerStarted","Data":"6ea14c49bc4ba43e523e974456082e19224b543678b3695f6d9739c4d5300ddf"} Jun 09 14:56:04.554364 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:04.554096 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746","Type":"ContainerStarted","Data":"7ad80b9a662fe6c8e6a8f16ff2d9d79420d58ebcac891ac47ff36f8bb61b0748"} Jun 09 14:56:04.554364 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:04.554124 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746","Type":"ContainerStarted","Data":"4255cebdb02e3b3b6898e54c3fafb510fed716fd783f98d6e4ded31ced2efe2d"} Jun 09 14:56:04.593624 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:04.593521 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.577393259 podStartE2EDuration="2.593504421s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.111162ms" isStatefulPod=false podCreationTimestamp="2026-06-09 14:56:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:56:04.590384548 +0000 UTC m=+312.734965536" watchObservedRunningTime="2026-06-09 14:56:04.593504421 +0000 UTC m=+312.738085459" Jun 09 14:56:05.361556 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.361516 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 14:56:05.361855 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.361816 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="prometheus" containerID="cri-o://71c0edccb0fe056e51486d76c35d803d95f928b8bd718383e912cab50606d740" gracePeriod=600 Jun 09 14:56:05.361996 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.361853 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://130d1cc4bbc9657ac28ad0399f310007ac34be994f3cc0edf0b0c9fbf2b2f77d" gracePeriod=600 Jun 09 14:56:05.361996 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.361836 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="thanos-sidecar" containerID="cri-o://bbc750ed6be27c699219fdbd93710716d07ffb9e7cea555968145dbd21b6c569" gracePeriod=600 Jun 09 14:56:05.361996 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.361874 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="kube-rbac-proxy-web" containerID="cri-o://b4a00698f8d3d4b6de5fef67aa3943b22e169e24f4ee1cc9fb5c0dc61fb3071d" gracePeriod=600 Jun 09 14:56:05.361996 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.361895 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="config-reloader" containerID="cri-o://cb9fba5495d53fbc50fe4cb91f69ce4684f112c5141aa4a2a99622cc19fb4d76" gracePeriod=600 Jun 09 14:56:05.361996 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.361827 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="kube-rbac-proxy" containerID="cri-o://0e2ac18f012635ed7d093633f834c079ea0b5db78f8de2b07e1659fe9b6f9efe" gracePeriod=600 Jun 09 14:56:05.564333 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.564299 2578 generic.go:356] "Generic (PLEG): container finished" podID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerID="130d1cc4bbc9657ac28ad0399f310007ac34be994f3cc0edf0b0c9fbf2b2f77d" exitCode=0 Jun 09 14:56:05.564333 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.564324 2578 generic.go:356] "Generic (PLEG): container finished" podID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerID="0e2ac18f012635ed7d093633f834c079ea0b5db78f8de2b07e1659fe9b6f9efe" exitCode=0 Jun 09 14:56:05.564333 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.564331 2578 generic.go:356] "Generic (PLEG): container finished" podID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerID="b4a00698f8d3d4b6de5fef67aa3943b22e169e24f4ee1cc9fb5c0dc61fb3071d" exitCode=0 Jun 09 14:56:05.564333 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.564337 2578 generic.go:356] "Generic (PLEG): container finished" podID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerID="bbc750ed6be27c699219fdbd93710716d07ffb9e7cea555968145dbd21b6c569" exitCode=0 Jun 09 14:56:05.564333 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.564342 2578 generic.go:356] "Generic (PLEG): container finished" podID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerID="cb9fba5495d53fbc50fe4cb91f69ce4684f112c5141aa4a2a99622cc19fb4d76" exitCode=0 Jun 09 14:56:05.564333 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.564347 2578 generic.go:356] "Generic (PLEG): container finished" podID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerID="71c0edccb0fe056e51486d76c35d803d95f928b8bd718383e912cab50606d740" exitCode=0 Jun 09 14:56:05.565062 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.564375 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"773de10c-346d-4f2f-94d3-32a27b6d290e","Type":"ContainerDied","Data":"130d1cc4bbc9657ac28ad0399f310007ac34be994f3cc0edf0b0c9fbf2b2f77d"} Jun 09 14:56:05.565062 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.564466 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"773de10c-346d-4f2f-94d3-32a27b6d290e","Type":"ContainerDied","Data":"0e2ac18f012635ed7d093633f834c079ea0b5db78f8de2b07e1659fe9b6f9efe"} Jun 09 14:56:05.565062 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.564615 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"773de10c-346d-4f2f-94d3-32a27b6d290e","Type":"ContainerDied","Data":"b4a00698f8d3d4b6de5fef67aa3943b22e169e24f4ee1cc9fb5c0dc61fb3071d"} Jun 09 14:56:05.565062 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.564657 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"773de10c-346d-4f2f-94d3-32a27b6d290e","Type":"ContainerDied","Data":"bbc750ed6be27c699219fdbd93710716d07ffb9e7cea555968145dbd21b6c569"} Jun 09 14:56:05.565062 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.564698 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"773de10c-346d-4f2f-94d3-32a27b6d290e","Type":"ContainerDied","Data":"cb9fba5495d53fbc50fe4cb91f69ce4684f112c5141aa4a2a99622cc19fb4d76"} Jun 09 14:56:05.565062 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.564746 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"773de10c-346d-4f2f-94d3-32a27b6d290e","Type":"ContainerDied","Data":"71c0edccb0fe056e51486d76c35d803d95f928b8bd718383e912cab50606d740"} Jun 09 14:56:05.604367 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.604341 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:05.656906 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.656813 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-metrics-client-certs\") pod \"773de10c-346d-4f2f-94d3-32a27b6d290e\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " Jun 09 14:56:05.656906 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.656869 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-grpc-tls\") pod \"773de10c-346d-4f2f-94d3-32a27b6d290e\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " Jun 09 14:56:05.656906 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.656896 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-kube-rbac-proxy\") pod \"773de10c-346d-4f2f-94d3-32a27b6d290e\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " Jun 09 14:56:05.657224 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.656938 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-trusted-ca-bundle\") pod \"773de10c-346d-4f2f-94d3-32a27b6d290e\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " Jun 09 14:56:05.657224 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.656965 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-db\") pod \"773de10c-346d-4f2f-94d3-32a27b6d290e\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " Jun 09 14:56:05.657224 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.657000 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72x9q\" (UniqueName: \"kubernetes.io/projected/773de10c-346d-4f2f-94d3-32a27b6d290e-kube-api-access-72x9q\") pod \"773de10c-346d-4f2f-94d3-32a27b6d290e\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " Jun 09 14:56:05.657224 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.657025 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-rulefiles-0\") pod \"773de10c-346d-4f2f-94d3-32a27b6d290e\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " Jun 09 14:56:05.657224 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.657050 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/773de10c-346d-4f2f-94d3-32a27b6d290e-tls-assets\") pod \"773de10c-346d-4f2f-94d3-32a27b6d290e\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " Jun 09 14:56:05.657224 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.657078 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/773de10c-346d-4f2f-94d3-32a27b6d290e-config-out\") pod \"773de10c-346d-4f2f-94d3-32a27b6d290e\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " Jun 09 14:56:05.657224 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.657102 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-config\") pod \"773de10c-346d-4f2f-94d3-32a27b6d290e\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " Jun 09 14:56:05.657224 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.657132 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"773de10c-346d-4f2f-94d3-32a27b6d290e\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " Jun 09 14:56:05.659333 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.658217 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "773de10c-346d-4f2f-94d3-32a27b6d290e" (UID: "773de10c-346d-4f2f-94d3-32a27b6d290e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:56:05.659333 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.658664 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "773de10c-346d-4f2f-94d3-32a27b6d290e" (UID: "773de10c-346d-4f2f-94d3-32a27b6d290e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:56:05.660207 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.659981 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "773de10c-346d-4f2f-94d3-32a27b6d290e" (UID: "773de10c-346d-4f2f-94d3-32a27b6d290e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:56:05.661249 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.661110 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-config" (OuterVolumeSpecName: "config") pod "773de10c-346d-4f2f-94d3-32a27b6d290e" (UID: "773de10c-346d-4f2f-94d3-32a27b6d290e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:56:05.661929 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.661608 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "773de10c-346d-4f2f-94d3-32a27b6d290e" (UID: "773de10c-346d-4f2f-94d3-32a27b6d290e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:56:05.661929 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.661890 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "773de10c-346d-4f2f-94d3-32a27b6d290e" (UID: "773de10c-346d-4f2f-94d3-32a27b6d290e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:56:05.662202 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.662182 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773de10c-346d-4f2f-94d3-32a27b6d290e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "773de10c-346d-4f2f-94d3-32a27b6d290e" (UID: "773de10c-346d-4f2f-94d3-32a27b6d290e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:56:05.662596 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.662555 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "773de10c-346d-4f2f-94d3-32a27b6d290e" (UID: "773de10c-346d-4f2f-94d3-32a27b6d290e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:56:05.662705 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.662622 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773de10c-346d-4f2f-94d3-32a27b6d290e-kube-api-access-72x9q" (OuterVolumeSpecName: "kube-api-access-72x9q") pod "773de10c-346d-4f2f-94d3-32a27b6d290e" (UID: "773de10c-346d-4f2f-94d3-32a27b6d290e"). InnerVolumeSpecName "kube-api-access-72x9q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:56:05.664014 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.663985 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773de10c-346d-4f2f-94d3-32a27b6d290e-config-out" (OuterVolumeSpecName: "config-out") pod "773de10c-346d-4f2f-94d3-32a27b6d290e" (UID: "773de10c-346d-4f2f-94d3-32a27b6d290e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:56:05.664158 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.664137 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "773de10c-346d-4f2f-94d3-32a27b6d290e" (UID: "773de10c-346d-4f2f-94d3-32a27b6d290e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:56:05.758483 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.758436 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-prometheus-k8s-tls\") pod \"773de10c-346d-4f2f-94d3-32a27b6d290e\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " Jun 09 14:56:05.758651 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.758467 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-web-config\") pod \"773de10c-346d-4f2f-94d3-32a27b6d290e\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " Jun 09 14:56:05.758651 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.758515 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-configmap-metrics-client-ca\") pod \"773de10c-346d-4f2f-94d3-32a27b6d290e\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " Jun 09 14:56:05.758651 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.758537 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-configmap-kubelet-serving-ca-bundle\") pod \"773de10c-346d-4f2f-94d3-32a27b6d290e\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " Jun 09 14:56:05.758651 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.758558 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-rulefiles-2\") pod \"773de10c-346d-4f2f-94d3-32a27b6d290e\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " Jun 09 14:56:05.758651 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.758639 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-thanos-prometheus-http-client-file\") pod \"773de10c-346d-4f2f-94d3-32a27b6d290e\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " Jun 09 14:56:05.758901 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.758655 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-rulefiles-1\") pod \"773de10c-346d-4f2f-94d3-32a27b6d290e\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " Jun 09 14:56:05.758901 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.758695 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-configmap-serving-certs-ca-bundle\") pod \"773de10c-346d-4f2f-94d3-32a27b6d290e\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " Jun 09 14:56:05.758901 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.758724 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"773de10c-346d-4f2f-94d3-32a27b6d290e\" (UID: \"773de10c-346d-4f2f-94d3-32a27b6d290e\") " Jun 09 14:56:05.759051 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.758967 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-metrics-client-certs\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:05.759051 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.758986 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-grpc-tls\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:05.759051 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.758988 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "773de10c-346d-4f2f-94d3-32a27b6d290e" (UID: "773de10c-346d-4f2f-94d3-32a27b6d290e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:56:05.759051 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.759005 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "773de10c-346d-4f2f-94d3-32a27b6d290e" (UID: "773de10c-346d-4f2f-94d3-32a27b6d290e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:56:05.759051 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.758998 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "773de10c-346d-4f2f-94d3-32a27b6d290e" (UID: "773de10c-346d-4f2f-94d3-32a27b6d290e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:56:05.759051 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.759001 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-kube-rbac-proxy\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:05.759331 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.759055 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:05.759331 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.759077 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-db\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:05.759331 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.759092 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72x9q\" (UniqueName: \"kubernetes.io/projected/773de10c-346d-4f2f-94d3-32a27b6d290e-kube-api-access-72x9q\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:05.759331 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.759108 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:05.759331 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.759124 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/773de10c-346d-4f2f-94d3-32a27b6d290e-tls-assets\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:05.759331 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.759138 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/773de10c-346d-4f2f-94d3-32a27b6d290e-config-out\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:05.759331 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.759157 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-config\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:05.759631 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.759309 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:05.759631 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.759360 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "773de10c-346d-4f2f-94d3-32a27b6d290e" (UID: "773de10c-346d-4f2f-94d3-32a27b6d290e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:56:05.759631 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.759421 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "773de10c-346d-4f2f-94d3-32a27b6d290e" (UID: "773de10c-346d-4f2f-94d3-32a27b6d290e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:56:05.760997 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.760966 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "773de10c-346d-4f2f-94d3-32a27b6d290e" (UID: "773de10c-346d-4f2f-94d3-32a27b6d290e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:56:05.761211 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.761191 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "773de10c-346d-4f2f-94d3-32a27b6d290e" (UID: "773de10c-346d-4f2f-94d3-32a27b6d290e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:56:05.761408 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.761375 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "773de10c-346d-4f2f-94d3-32a27b6d290e" (UID: "773de10c-346d-4f2f-94d3-32a27b6d290e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:56:05.771851 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.771824 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-web-config" (OuterVolumeSpecName: "web-config") pod "773de10c-346d-4f2f-94d3-32a27b6d290e" (UID: "773de10c-346d-4f2f-94d3-32a27b6d290e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:56:05.860667 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.860628 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:05.860667 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.860662 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:05.860667 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.860673 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:05.860894 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.860686 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-web-config\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:05.860894 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.860695 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-configmap-metrics-client-ca\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:05.860894 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.860705 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:05.860894 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.860713 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:05.860894 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.860722 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/773de10c-346d-4f2f-94d3-32a27b6d290e-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:05.860894 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:05.860730 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/773de10c-346d-4f2f-94d3-32a27b6d290e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:06.572104 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.572065 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"773de10c-346d-4f2f-94d3-32a27b6d290e","Type":"ContainerDied","Data":"52e877c8e14c8a49f8913eb2a4a9f519fb147903d2b1f6e9e7452d2506069466"} Jun 09 14:56:06.572566 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.572155 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.572566 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.572192 2578 scope.go:117] "RemoveContainer" containerID="130d1cc4bbc9657ac28ad0399f310007ac34be994f3cc0edf0b0c9fbf2b2f77d" Jun 09 14:56:06.580414 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.580392 2578 scope.go:117] "RemoveContainer" containerID="0e2ac18f012635ed7d093633f834c079ea0b5db78f8de2b07e1659fe9b6f9efe" Jun 09 14:56:06.588188 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.588167 2578 scope.go:117] "RemoveContainer" containerID="b4a00698f8d3d4b6de5fef67aa3943b22e169e24f4ee1cc9fb5c0dc61fb3071d" Jun 09 14:56:06.595458 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.595441 2578 scope.go:117] "RemoveContainer" containerID="bbc750ed6be27c699219fdbd93710716d07ffb9e7cea555968145dbd21b6c569" Jun 09 14:56:06.599311 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.599258 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 14:56:06.603147 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.603126 2578 scope.go:117] "RemoveContainer" containerID="cb9fba5495d53fbc50fe4cb91f69ce4684f112c5141aa4a2a99622cc19fb4d76" Jun 09 14:56:06.605521 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.605499 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 14:56:06.611031 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.611014 2578 scope.go:117] "RemoveContainer" containerID="71c0edccb0fe056e51486d76c35d803d95f928b8bd718383e912cab50606d740" Jun 09 14:56:06.618811 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.618791 2578 scope.go:117] "RemoveContainer" containerID="2b196d886bc44fa93e8002cfe6592b94c9fad9f03198c6871b0e5402ac669dc1" Jun 09 14:56:06.636430 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636403 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 14:56:06.637054 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636756 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="init-config-reloader" Jun 09 14:56:06.637054 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636769 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="init-config-reloader" Jun 09 14:56:06.637054 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636782 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="prometheus" Jun 09 14:56:06.637054 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636787 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="prometheus" Jun 09 14:56:06.637054 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636793 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="config-reloader" Jun 09 14:56:06.637054 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636799 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="config-reloader" Jun 09 14:56:06.637054 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636806 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="kube-rbac-proxy-thanos" Jun 09 14:56:06.637054 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636811 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="kube-rbac-proxy-thanos" Jun 09 14:56:06.637054 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636826 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="thanos-sidecar" Jun 09 14:56:06.637054 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636831 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="thanos-sidecar" Jun 09 14:56:06.637054 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636838 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="kube-rbac-proxy" Jun 09 14:56:06.637054 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636843 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="kube-rbac-proxy" Jun 09 14:56:06.637054 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636850 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="kube-rbac-proxy-web" Jun 09 14:56:06.637054 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636856 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="kube-rbac-proxy-web" Jun 09 14:56:06.637054 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636910 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="config-reloader" Jun 09 14:56:06.637054 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636918 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="kube-rbac-proxy" Jun 09 14:56:06.637054 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636925 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="prometheus" Jun 09 14:56:06.637054 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636933 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="kube-rbac-proxy-web" Jun 09 14:56:06.637054 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636940 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="kube-rbac-proxy-thanos" Jun 09 14:56:06.637054 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.636946 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" containerName="thanos-sidecar" Jun 09 14:56:06.639217 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.639199 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.642060 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.642040 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3dcoeiikkiiko\"" Jun 09 14:56:06.642682 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.642661 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 14:56:06.642942 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.642922 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 14:56:06.642942 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.642933 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 14:56:06.642942 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.642939 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 14:56:06.643128 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.643026 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 14:56:06.643352 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.643334 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 14:56:06.643451 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.643359 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 14:56:06.643451 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.643359 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 14:56:06.643643 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.643626 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 14:56:06.643703 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.643687 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 14:56:06.643763 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.643687 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 14:56:06.643763 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.643750 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 14:56:06.644026 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.644011 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cq66v\"" Jun 09 14:56:06.647880 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.647859 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 14:56:06.650751 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.650731 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 14:56:06.660298 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.660274 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 14:56:06.667740 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.667719 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.667836 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.667748 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.667836 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.667768 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.667836 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.667789 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.667836 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.667806 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d9744918-9bcb-401f-80de-5701adea4b73-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.667988 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.667844 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.667988 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.667877 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.667988 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.667928 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.667988 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.667959 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.668159 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.667990 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-config\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.668159 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.668005 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.668159 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.668025 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.668159 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.668051 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.668159 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.668077 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.668159 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.668098 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d9744918-9bcb-401f-80de-5701adea4b73-config-out\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.668159 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.668123 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.668159 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.668142 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d9744918-9bcb-401f-80de-5701adea4b73-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.668159 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.668157 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p27jm\" (UniqueName: \"kubernetes.io/projected/d9744918-9bcb-401f-80de-5701adea4b73-kube-api-access-p27jm\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.668506 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.668217 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.668506 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.668267 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-web-config\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.768971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.768924 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.768971 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.768976 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.769231 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.769008 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.769231 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.769033 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d9744918-9bcb-401f-80de-5701adea4b73-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.769231 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.769056 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.769231 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.769197 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.769420 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.769241 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.769514 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.769461 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.769578 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.769527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-config\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.769578 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.769560 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.769679 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.769609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.769679 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.769643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.769783 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.769676 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.769783 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.769714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d9744918-9bcb-401f-80de-5701adea4b73-config-out\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.769783 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.769742 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.769783 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.769767 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d9744918-9bcb-401f-80de-5701adea4b73-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.770151 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.769792 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p27jm\" (UniqueName: \"kubernetes.io/projected/d9744918-9bcb-401f-80de-5701adea4b73-kube-api-access-p27jm\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.770151 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.769855 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.770151 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.769907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-web-config\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.770151 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.769954 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.770151 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.769980 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.770151 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.770130 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.770488 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.770445 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d9744918-9bcb-401f-80de-5701adea4b73-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.771986 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.770817 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.773006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.772166 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d9744918-9bcb-401f-80de-5701adea4b73-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.773006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.772238 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.773006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.772594 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.773006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.772890 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.773006 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.772900 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.773520 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.773497 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.773628 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.773560 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.773628 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.773585 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d9744918-9bcb-401f-80de-5701adea4b73-config-out\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.773979 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.773789 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9744918-9bcb-401f-80de-5701adea4b73-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.773979 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.773888 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.774918 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.774900 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.775510 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.775494 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-web-config\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.775638 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.775621 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-config\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.775946 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.775925 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.776185 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.776168 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d9744918-9bcb-401f-80de-5701adea4b73-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.782705 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.782681 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p27jm\" (UniqueName: \"kubernetes.io/projected/d9744918-9bcb-401f-80de-5701adea4b73-kube-api-access-p27jm\") pod \"prometheus-k8s-0\" (UID: \"d9744918-9bcb-401f-80de-5701adea4b73\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:06.949941 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:06.949841 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:07.114034 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:07.113918 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 14:56:07.116540 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:56:07.116512 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9744918_9bcb_401f_80de_5701adea4b73.slice/crio-48147054b89dc993955f0ba9af46b1a5e776d367668f5bc7190a619b17c9711e WatchSource:0}: Error finding container 48147054b89dc993955f0ba9af46b1a5e776d367668f5bc7190a619b17c9711e: Status 404 returned error can't find the container with id 48147054b89dc993955f0ba9af46b1a5e776d367668f5bc7190a619b17c9711e Jun 09 14:56:07.578482 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:07.578435 2578 generic.go:356] "Generic (PLEG): container finished" podID="d9744918-9bcb-401f-80de-5701adea4b73" containerID="68b0a25c6b94c16c13c7fa1954cf6bdfcc6cc2ac748aebd0759d12561a88f344" exitCode=0 Jun 09 14:56:07.578832 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:07.578495 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9744918-9bcb-401f-80de-5701adea4b73","Type":"ContainerDied","Data":"68b0a25c6b94c16c13c7fa1954cf6bdfcc6cc2ac748aebd0759d12561a88f344"} Jun 09 14:56:07.578832 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:07.578547 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9744918-9bcb-401f-80de-5701adea4b73","Type":"ContainerStarted","Data":"48147054b89dc993955f0ba9af46b1a5e776d367668f5bc7190a619b17c9711e"} Jun 09 14:56:08.338985 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:08.338953 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="773de10c-346d-4f2f-94d3-32a27b6d290e" path="/var/lib/kubelet/pods/773de10c-346d-4f2f-94d3-32a27b6d290e/volumes" Jun 09 14:56:08.586119 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:08.586080 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9744918-9bcb-401f-80de-5701adea4b73","Type":"ContainerStarted","Data":"2840c666bf7223a9bdb6eb3414f94e653a0295f867d7cddd1563437da468eb0c"} Jun 09 14:56:08.586508 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:08.586151 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9744918-9bcb-401f-80de-5701adea4b73","Type":"ContainerStarted","Data":"24b6df44f36c8bd40200bb9aa271b4cc9625a8f41fde824aa62025da08ebe346"} Jun 09 14:56:08.586508 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:08.586178 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9744918-9bcb-401f-80de-5701adea4b73","Type":"ContainerStarted","Data":"834182bf08c6d5786c24ef620422fd15e061d7d27de29f63c8bc15992a640b68"} Jun 09 14:56:08.586508 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:08.586204 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9744918-9bcb-401f-80de-5701adea4b73","Type":"ContainerStarted","Data":"79d0018466f2113436a914015d519e2c4369094ab5291ba02f909d7bf0ddbd09"} Jun 09 14:56:08.586508 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:08.586246 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9744918-9bcb-401f-80de-5701adea4b73","Type":"ContainerStarted","Data":"aff09d613317f5f881512dd0951d18c4f6c3c029239a053ea388bd7226808477"} Jun 09 14:56:08.586508 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:08.586274 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d9744918-9bcb-401f-80de-5701adea4b73","Type":"ContainerStarted","Data":"39885c12a9b517dbbd1993ed600fba20b02ce77ed55b9ba34e5421ce8251b3d6"} Jun 09 14:56:08.620909 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:08.620776 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.601956655 podStartE2EDuration="2.620752142s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.795487ms" isStatefulPod=false podCreationTimestamp="2026-06-09 14:56:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:56:08.617975388 +0000 UTC m=+316.762556373" watchObservedRunningTime="2026-06-09 14:56:08.620752142 +0000 UTC m=+316.765333128" Jun 09 14:56:09.923737 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:09.923702 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67768cdfb-np6w6"] Jun 09 14:56:09.928995 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:09.928972 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:09.939450 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:09.939425 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67768cdfb-np6w6"] Jun 09 14:56:09.998981 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:09.998948 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-service-ca\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:09.999135 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:09.998990 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2810f8d6-9488-4131-9bf9-a36c19ea86e6-console-oauth-config\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:09.999135 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:09.999011 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-console-config\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:09.999135 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:09.999028 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2810f8d6-9488-4131-9bf9-a36c19ea86e6-console-serving-cert\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:09.999135 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:09.999087 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnmvz\" (UniqueName: \"kubernetes.io/projected/2810f8d6-9488-4131-9bf9-a36c19ea86e6-kube-api-access-gnmvz\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:09.999135 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:09.999117 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-trusted-ca-bundle\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:09.999135 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:09.999133 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-oauth-serving-cert\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:10.100338 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:10.100295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-trusted-ca-bundle\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:10.100338 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:10.100335 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-oauth-serving-cert\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:10.100579 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:10.100496 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-service-ca\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:10.100579 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:10.100560 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2810f8d6-9488-4131-9bf9-a36c19ea86e6-console-oauth-config\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:10.100656 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:10.100589 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-console-config\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:10.100656 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:10.100610 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2810f8d6-9488-4131-9bf9-a36c19ea86e6-console-serving-cert\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:10.100758 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:10.100680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnmvz\" (UniqueName: \"kubernetes.io/projected/2810f8d6-9488-4131-9bf9-a36c19ea86e6-kube-api-access-gnmvz\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:10.101087 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:10.101064 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-oauth-serving-cert\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:10.101241 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:10.101219 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-service-ca\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:10.101308 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:10.101259 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-trusted-ca-bundle\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:10.101364 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:10.101308 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-console-config\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:10.103108 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:10.103083 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2810f8d6-9488-4131-9bf9-a36c19ea86e6-console-oauth-config\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:10.103336 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:10.103314 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2810f8d6-9488-4131-9bf9-a36c19ea86e6-console-serving-cert\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:10.108809 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:10.108788 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnmvz\" (UniqueName: \"kubernetes.io/projected/2810f8d6-9488-4131-9bf9-a36c19ea86e6-kube-api-access-gnmvz\") pod \"console-67768cdfb-np6w6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:10.239818 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:10.239725 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:10.385333 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:10.385306 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67768cdfb-np6w6"] Jun 09 14:56:10.387590 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:56:10.387557 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2810f8d6_9488_4131_9bf9_a36c19ea86e6.slice/crio-f6f84bc9c2016aac9cbcbd2009cd9851e54eefcb6a4587a1475621a2a100586b WatchSource:0}: Error finding container f6f84bc9c2016aac9cbcbd2009cd9851e54eefcb6a4587a1475621a2a100586b: Status 404 returned error can't find the container with id f6f84bc9c2016aac9cbcbd2009cd9851e54eefcb6a4587a1475621a2a100586b Jun 09 14:56:10.596515 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:10.596453 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67768cdfb-np6w6" event={"ID":"2810f8d6-9488-4131-9bf9-a36c19ea86e6","Type":"ContainerStarted","Data":"00300e788afb0bafb689e5968ac91bebcc5733520579dd8dbc2223a1d63547d5"} Jun 09 14:56:10.596717 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:10.596542 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67768cdfb-np6w6" event={"ID":"2810f8d6-9488-4131-9bf9-a36c19ea86e6","Type":"ContainerStarted","Data":"f6f84bc9c2016aac9cbcbd2009cd9851e54eefcb6a4587a1475621a2a100586b"} Jun 09 14:56:10.616648 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:10.616594 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67768cdfb-np6w6" podStartSLOduration=1.61657956 podStartE2EDuration="1.61657956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:56:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:56:10.614690472 +0000 UTC m=+318.759271458" watchObservedRunningTime="2026-06-09 14:56:10.61657956 +0000 UTC m=+318.761160545" Jun 09 14:56:11.950763 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:11.950726 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:56:20.240206 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:20.240150 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:20.240206 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:20.240227 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:20.245114 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:20.245091 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:20.646179 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:20.646152 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:56:20.697875 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:20.697838 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-574886f55f-s8s4f"] Jun 09 14:56:20.925069 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:20.924954 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-669f58544d-482kr" podUID="82a6cee3-c195-4187-9053-3d96acbf716b" containerName="console" containerID="cri-o://2d15b01007545f2c490f01584da36c980d3ee8ebc795334e0f18a886a4608fe5" gracePeriod=15 Jun 09 14:56:21.175347 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.175290 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669f58544d-482kr" Jun 09 14:56:21.303926 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.303880 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-console-config\") pod \"82a6cee3-c195-4187-9053-3d96acbf716b\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " Jun 09 14:56:21.303926 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.303936 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-service-ca\") pod \"82a6cee3-c195-4187-9053-3d96acbf716b\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " Jun 09 14:56:21.304454 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.303965 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82a6cee3-c195-4187-9053-3d96acbf716b-console-oauth-config\") pod \"82a6cee3-c195-4187-9053-3d96acbf716b\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " Jun 09 14:56:21.304454 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.303993 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82a6cee3-c195-4187-9053-3d96acbf716b-console-serving-cert\") pod \"82a6cee3-c195-4187-9053-3d96acbf716b\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " Jun 09 14:56:21.304454 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.304046 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-trusted-ca-bundle\") pod \"82a6cee3-c195-4187-9053-3d96acbf716b\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " Jun 09 14:56:21.304454 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.304095 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-oauth-serving-cert\") pod \"82a6cee3-c195-4187-9053-3d96acbf716b\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " Jun 09 14:56:21.304454 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.304132 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gt5dp\" (UniqueName: \"kubernetes.io/projected/82a6cee3-c195-4187-9053-3d96acbf716b-kube-api-access-gt5dp\") pod \"82a6cee3-c195-4187-9053-3d96acbf716b\" (UID: \"82a6cee3-c195-4187-9053-3d96acbf716b\") " Jun 09 14:56:21.304741 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.304461 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-service-ca" (OuterVolumeSpecName: "service-ca") pod "82a6cee3-c195-4187-9053-3d96acbf716b" (UID: "82a6cee3-c195-4187-9053-3d96acbf716b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:56:21.304741 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.304503 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-console-config" (OuterVolumeSpecName: "console-config") pod "82a6cee3-c195-4187-9053-3d96acbf716b" (UID: "82a6cee3-c195-4187-9053-3d96acbf716b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:56:21.304741 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.304520 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "82a6cee3-c195-4187-9053-3d96acbf716b" (UID: "82a6cee3-c195-4187-9053-3d96acbf716b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:56:21.304741 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.304561 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "82a6cee3-c195-4187-9053-3d96acbf716b" (UID: "82a6cee3-c195-4187-9053-3d96acbf716b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:56:21.306282 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.306259 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82a6cee3-c195-4187-9053-3d96acbf716b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "82a6cee3-c195-4187-9053-3d96acbf716b" (UID: "82a6cee3-c195-4187-9053-3d96acbf716b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:56:21.306401 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.306291 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82a6cee3-c195-4187-9053-3d96acbf716b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "82a6cee3-c195-4187-9053-3d96acbf716b" (UID: "82a6cee3-c195-4187-9053-3d96acbf716b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:56:21.306713 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.306694 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82a6cee3-c195-4187-9053-3d96acbf716b-kube-api-access-gt5dp" (OuterVolumeSpecName: "kube-api-access-gt5dp") pod "82a6cee3-c195-4187-9053-3d96acbf716b" (UID: "82a6cee3-c195-4187-9053-3d96acbf716b"). InnerVolumeSpecName "kube-api-access-gt5dp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:56:21.405594 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.405546 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-console-config\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:21.405594 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.405586 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-service-ca\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:21.405594 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.405595 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82a6cee3-c195-4187-9053-3d96acbf716b-console-oauth-config\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:21.405594 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.405603 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82a6cee3-c195-4187-9053-3d96acbf716b-console-serving-cert\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:21.405594 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.405613 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-trusted-ca-bundle\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:21.405908 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.405621 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82a6cee3-c195-4187-9053-3d96acbf716b-oauth-serving-cert\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:21.405908 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.405631 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gt5dp\" (UniqueName: \"kubernetes.io/projected/82a6cee3-c195-4187-9053-3d96acbf716b-kube-api-access-gt5dp\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:21.655544 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.655504 2578 generic.go:356] "Generic (PLEG): container finished" podID="82a6cee3-c195-4187-9053-3d96acbf716b" containerID="2d15b01007545f2c490f01584da36c980d3ee8ebc795334e0f18a886a4608fe5" exitCode=0 Jun 09 14:56:21.655708 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.655562 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669f58544d-482kr" Jun 09 14:56:21.655708 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.655581 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669f58544d-482kr" event={"ID":"82a6cee3-c195-4187-9053-3d96acbf716b","Type":"ContainerDied","Data":"2d15b01007545f2c490f01584da36c980d3ee8ebc795334e0f18a886a4608fe5"} Jun 09 14:56:21.655708 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.655656 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669f58544d-482kr" event={"ID":"82a6cee3-c195-4187-9053-3d96acbf716b","Type":"ContainerDied","Data":"fa5918caacc046461266d3310689d8ed9ab51d625748e180bb0f098cf9aeebed"} Jun 09 14:56:21.655708 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.655676 2578 scope.go:117] "RemoveContainer" containerID="2d15b01007545f2c490f01584da36c980d3ee8ebc795334e0f18a886a4608fe5" Jun 09 14:56:21.664616 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.664599 2578 scope.go:117] "RemoveContainer" containerID="2d15b01007545f2c490f01584da36c980d3ee8ebc795334e0f18a886a4608fe5" Jun 09 14:56:21.664860 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:56:21.664842 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d15b01007545f2c490f01584da36c980d3ee8ebc795334e0f18a886a4608fe5\": container with ID starting with 2d15b01007545f2c490f01584da36c980d3ee8ebc795334e0f18a886a4608fe5 not found: ID does not exist" containerID="2d15b01007545f2c490f01584da36c980d3ee8ebc795334e0f18a886a4608fe5" Jun 09 14:56:21.664923 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.664867 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d15b01007545f2c490f01584da36c980d3ee8ebc795334e0f18a886a4608fe5"} err="failed to get container status \"2d15b01007545f2c490f01584da36c980d3ee8ebc795334e0f18a886a4608fe5\": rpc error: code = NotFound desc = could not find container \"2d15b01007545f2c490f01584da36c980d3ee8ebc795334e0f18a886a4608fe5\": container with ID starting with 2d15b01007545f2c490f01584da36c980d3ee8ebc795334e0f18a886a4608fe5 not found: ID does not exist" Jun 09 14:56:21.677260 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.677233 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-669f58544d-482kr"] Jun 09 14:56:21.679160 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:21.679141 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-669f58544d-482kr"] Jun 09 14:56:22.339333 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:22.339298 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82a6cee3-c195-4187-9053-3d96acbf716b" path="/var/lib/kubelet/pods/82a6cee3-c195-4187-9053-3d96acbf716b/volumes" Jun 09 14:56:45.724892 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:45.724779 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-574886f55f-s8s4f" podUID="242f54d0-c841-4982-a1cb-f1a03d62c24e" containerName="console" containerID="cri-o://81d8075ee472b40f49c585315d61fa15ca2e70142e09bab49b96fb01d880e3c4" gracePeriod=15 Jun 09 14:56:45.824530 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:45.824465 2578 patch_prober.go:28] interesting pod/console-574886f55f-s8s4f container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 09 14:56:45.824720 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:45.824561 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-574886f55f-s8s4f" podUID="242f54d0-c841-4982-a1cb-f1a03d62c24e" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 09 14:56:45.968051 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:45.968026 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:56:46.123560 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.123529 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/242f54d0-c841-4982-a1cb-f1a03d62c24e-console-serving-cert\") pod \"242f54d0-c841-4982-a1cb-f1a03d62c24e\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " Jun 09 14:56:46.123745 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.123621 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-trusted-ca-bundle\") pod \"242f54d0-c841-4982-a1cb-f1a03d62c24e\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " Jun 09 14:56:46.123745 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.123659 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-service-ca\") pod \"242f54d0-c841-4982-a1cb-f1a03d62c24e\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " Jun 09 14:56:46.123745 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.123676 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-oauth-serving-cert\") pod \"242f54d0-c841-4982-a1cb-f1a03d62c24e\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " Jun 09 14:56:46.123745 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.123701 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-console-config\") pod \"242f54d0-c841-4982-a1cb-f1a03d62c24e\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " Jun 09 14:56:46.123745 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.123722 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbnh9\" (UniqueName: \"kubernetes.io/projected/242f54d0-c841-4982-a1cb-f1a03d62c24e-kube-api-access-hbnh9\") pod \"242f54d0-c841-4982-a1cb-f1a03d62c24e\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " Jun 09 14:56:46.123998 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.123780 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/242f54d0-c841-4982-a1cb-f1a03d62c24e-console-oauth-config\") pod \"242f54d0-c841-4982-a1cb-f1a03d62c24e\" (UID: \"242f54d0-c841-4982-a1cb-f1a03d62c24e\") " Jun 09 14:56:46.124143 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.124116 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "242f54d0-c841-4982-a1cb-f1a03d62c24e" (UID: "242f54d0-c841-4982-a1cb-f1a03d62c24e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:56:46.124206 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.124134 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-service-ca" (OuterVolumeSpecName: "service-ca") pod "242f54d0-c841-4982-a1cb-f1a03d62c24e" (UID: "242f54d0-c841-4982-a1cb-f1a03d62c24e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:56:46.124206 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.124141 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "242f54d0-c841-4982-a1cb-f1a03d62c24e" (UID: "242f54d0-c841-4982-a1cb-f1a03d62c24e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:56:46.124206 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.124130 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-console-config" (OuterVolumeSpecName: "console-config") pod "242f54d0-c841-4982-a1cb-f1a03d62c24e" (UID: "242f54d0-c841-4982-a1cb-f1a03d62c24e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:56:46.125904 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.125883 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/242f54d0-c841-4982-a1cb-f1a03d62c24e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "242f54d0-c841-4982-a1cb-f1a03d62c24e" (UID: "242f54d0-c841-4982-a1cb-f1a03d62c24e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:56:46.126021 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.126002 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/242f54d0-c841-4982-a1cb-f1a03d62c24e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "242f54d0-c841-4982-a1cb-f1a03d62c24e" (UID: "242f54d0-c841-4982-a1cb-f1a03d62c24e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:56:46.126184 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.126164 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/242f54d0-c841-4982-a1cb-f1a03d62c24e-kube-api-access-hbnh9" (OuterVolumeSpecName: "kube-api-access-hbnh9") pod "242f54d0-c841-4982-a1cb-f1a03d62c24e" (UID: "242f54d0-c841-4982-a1cb-f1a03d62c24e"). InnerVolumeSpecName "kube-api-access-hbnh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:56:46.225155 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.225111 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/242f54d0-c841-4982-a1cb-f1a03d62c24e-console-oauth-config\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:46.225155 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.225145 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/242f54d0-c841-4982-a1cb-f1a03d62c24e-console-serving-cert\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:46.225155 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.225157 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-trusted-ca-bundle\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:46.225155 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.225165 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-service-ca\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:46.225431 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.225174 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-oauth-serving-cert\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:46.225431 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.225184 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/242f54d0-c841-4982-a1cb-f1a03d62c24e-console-config\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:46.225431 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.225192 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbnh9\" (UniqueName: \"kubernetes.io/projected/242f54d0-c841-4982-a1cb-f1a03d62c24e-kube-api-access-hbnh9\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:56:46.773535 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.773497 2578 generic.go:356] "Generic (PLEG): container finished" podID="242f54d0-c841-4982-a1cb-f1a03d62c24e" containerID="81d8075ee472b40f49c585315d61fa15ca2e70142e09bab49b96fb01d880e3c4" exitCode=0 Jun 09 14:56:46.773975 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.773571 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574886f55f-s8s4f" event={"ID":"242f54d0-c841-4982-a1cb-f1a03d62c24e","Type":"ContainerDied","Data":"81d8075ee472b40f49c585315d61fa15ca2e70142e09bab49b96fb01d880e3c4"} Jun 09 14:56:46.773975 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.773603 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574886f55f-s8s4f" Jun 09 14:56:46.773975 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.773620 2578 scope.go:117] "RemoveContainer" containerID="81d8075ee472b40f49c585315d61fa15ca2e70142e09bab49b96fb01d880e3c4" Jun 09 14:56:46.773975 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.773607 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574886f55f-s8s4f" event={"ID":"242f54d0-c841-4982-a1cb-f1a03d62c24e","Type":"ContainerDied","Data":"d309a385eef9881c185838065c374db523268429539d95a7ec504257c8567465"} Jun 09 14:56:46.782170 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.782152 2578 scope.go:117] "RemoveContainer" containerID="81d8075ee472b40f49c585315d61fa15ca2e70142e09bab49b96fb01d880e3c4" Jun 09 14:56:46.782465 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:56:46.782443 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81d8075ee472b40f49c585315d61fa15ca2e70142e09bab49b96fb01d880e3c4\": container with ID starting with 81d8075ee472b40f49c585315d61fa15ca2e70142e09bab49b96fb01d880e3c4 not found: ID does not exist" containerID="81d8075ee472b40f49c585315d61fa15ca2e70142e09bab49b96fb01d880e3c4" Jun 09 14:56:46.782554 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.782496 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81d8075ee472b40f49c585315d61fa15ca2e70142e09bab49b96fb01d880e3c4"} err="failed to get container status \"81d8075ee472b40f49c585315d61fa15ca2e70142e09bab49b96fb01d880e3c4\": rpc error: code = NotFound desc = could not find container \"81d8075ee472b40f49c585315d61fa15ca2e70142e09bab49b96fb01d880e3c4\": container with ID starting with 81d8075ee472b40f49c585315d61fa15ca2e70142e09bab49b96fb01d880e3c4 not found: ID does not exist" Jun 09 14:56:46.790417 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.790389 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-574886f55f-s8s4f"] Jun 09 14:56:46.794172 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:46.794142 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-574886f55f-s8s4f"] Jun 09 14:56:48.339688 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:56:48.339655 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="242f54d0-c841-4982-a1cb-f1a03d62c24e" path="/var/lib/kubelet/pods/242f54d0-c841-4982-a1cb-f1a03d62c24e/volumes" Jun 09 14:57:06.950567 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:06.950527 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:57:06.967018 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:06.966987 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:57:07.879765 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:07.879739 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:57:20.905903 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:20.905860 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f54f87476-gtdzq"] Jun 09 14:57:20.906543 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:20.906385 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="242f54d0-c841-4982-a1cb-f1a03d62c24e" containerName="console" Jun 09 14:57:20.906543 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:20.906405 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="242f54d0-c841-4982-a1cb-f1a03d62c24e" containerName="console" Jun 09 14:57:20.906543 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:20.906438 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82a6cee3-c195-4187-9053-3d96acbf716b" containerName="console" Jun 09 14:57:20.906543 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:20.906446 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="82a6cee3-c195-4187-9053-3d96acbf716b" containerName="console" Jun 09 14:57:20.906792 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:20.906551 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="242f54d0-c841-4982-a1cb-f1a03d62c24e" containerName="console" Jun 09 14:57:20.906792 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:20.906565 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="82a6cee3-c195-4187-9053-3d96acbf716b" containerName="console" Jun 09 14:57:20.909791 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:20.909770 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:20.920644 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:20.920614 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f54f87476-gtdzq"] Jun 09 14:57:21.012559 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.012523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7466957e-6ca1-4bfa-9d09-9b839e455739-trusted-ca-bundle\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.012730 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.012582 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7466957e-6ca1-4bfa-9d09-9b839e455739-console-config\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.012730 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.012606 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snckp\" (UniqueName: \"kubernetes.io/projected/7466957e-6ca1-4bfa-9d09-9b839e455739-kube-api-access-snckp\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.012730 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.012703 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7466957e-6ca1-4bfa-9d09-9b839e455739-console-oauth-config\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.012855 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.012743 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7466957e-6ca1-4bfa-9d09-9b839e455739-console-serving-cert\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.012855 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.012761 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7466957e-6ca1-4bfa-9d09-9b839e455739-service-ca\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.012855 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.012816 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7466957e-6ca1-4bfa-9d09-9b839e455739-oauth-serving-cert\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.113575 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.113537 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7466957e-6ca1-4bfa-9d09-9b839e455739-oauth-serving-cert\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.113751 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.113587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7466957e-6ca1-4bfa-9d09-9b839e455739-trusted-ca-bundle\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.113751 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.113670 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7466957e-6ca1-4bfa-9d09-9b839e455739-console-config\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.113751 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.113699 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snckp\" (UniqueName: \"kubernetes.io/projected/7466957e-6ca1-4bfa-9d09-9b839e455739-kube-api-access-snckp\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.113903 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.113757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7466957e-6ca1-4bfa-9d09-9b839e455739-console-oauth-config\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.113903 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.113780 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7466957e-6ca1-4bfa-9d09-9b839e455739-console-serving-cert\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.113903 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.113806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7466957e-6ca1-4bfa-9d09-9b839e455739-service-ca\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.114465 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.114435 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7466957e-6ca1-4bfa-9d09-9b839e455739-service-ca\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.114791 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.114498 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7466957e-6ca1-4bfa-9d09-9b839e455739-console-config\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.114791 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.114549 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7466957e-6ca1-4bfa-9d09-9b839e455739-trusted-ca-bundle\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.114791 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.114544 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7466957e-6ca1-4bfa-9d09-9b839e455739-oauth-serving-cert\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.116508 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.116464 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7466957e-6ca1-4bfa-9d09-9b839e455739-console-oauth-config\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.116606 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.116524 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7466957e-6ca1-4bfa-9d09-9b839e455739-console-serving-cert\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.122867 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.122843 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snckp\" (UniqueName: \"kubernetes.io/projected/7466957e-6ca1-4bfa-9d09-9b839e455739-kube-api-access-snckp\") pod \"console-7f54f87476-gtdzq\" (UID: \"7466957e-6ca1-4bfa-9d09-9b839e455739\") " pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.222058 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.221968 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:21.362301 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.362273 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f54f87476-gtdzq"] Jun 09 14:57:21.364258 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:57:21.364228 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7466957e_6ca1_4bfa_9d09_9b839e455739.slice/crio-d13dca1df993bd10fdd32aeaaefec9b15e3d3e808e201f4ac0ac676ae62950bb WatchSource:0}: Error finding container d13dca1df993bd10fdd32aeaaefec9b15e3d3e808e201f4ac0ac676ae62950bb: Status 404 returned error can't find the container with id d13dca1df993bd10fdd32aeaaefec9b15e3d3e808e201f4ac0ac676ae62950bb Jun 09 14:57:21.921834 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.921791 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f54f87476-gtdzq" event={"ID":"7466957e-6ca1-4bfa-9d09-9b839e455739","Type":"ContainerStarted","Data":"885273bc4463acd570750abf2737618e05dbe90c4b7e1cb0fe08c9a1271c90b6"} Jun 09 14:57:21.922225 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.921848 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f54f87476-gtdzq" event={"ID":"7466957e-6ca1-4bfa-9d09-9b839e455739","Type":"ContainerStarted","Data":"d13dca1df993bd10fdd32aeaaefec9b15e3d3e808e201f4ac0ac676ae62950bb"} Jun 09 14:57:21.941805 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:21.941756 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f54f87476-gtdzq" podStartSLOduration=1.941739828 podStartE2EDuration="1.941739828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:57:21.940623536 +0000 UTC m=+390.085204521" watchObservedRunningTime="2026-06-09 14:57:21.941739828 +0000 UTC m=+390.086320813" Jun 09 14:57:31.222918 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:31.222886 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:31.223304 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:31.222946 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:31.227830 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:31.227804 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:31.964688 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:31.964661 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f54f87476-gtdzq" Jun 09 14:57:32.009030 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:32.008994 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67768cdfb-np6w6"] Jun 09 14:57:57.034464 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.034403 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-67768cdfb-np6w6" podUID="2810f8d6-9488-4131-9bf9-a36c19ea86e6" containerName="console" containerID="cri-o://00300e788afb0bafb689e5968ac91bebcc5733520579dd8dbc2223a1d63547d5" gracePeriod=15 Jun 09 14:57:57.283134 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.283111 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:57:57.435072 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.435036 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnmvz\" (UniqueName: \"kubernetes.io/projected/2810f8d6-9488-4131-9bf9-a36c19ea86e6-kube-api-access-gnmvz\") pod \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " Jun 09 14:57:57.435249 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.435084 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-oauth-serving-cert\") pod \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " Jun 09 14:57:57.435249 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.435106 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-console-config\") pod \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " Jun 09 14:57:57.435249 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.435146 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2810f8d6-9488-4131-9bf9-a36c19ea86e6-console-serving-cert\") pod \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " Jun 09 14:57:57.435249 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.435167 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-service-ca\") pod \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " Jun 09 14:57:57.435249 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.435181 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2810f8d6-9488-4131-9bf9-a36c19ea86e6-console-oauth-config\") pod \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " Jun 09 14:57:57.435249 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.435224 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-trusted-ca-bundle\") pod \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\" (UID: \"2810f8d6-9488-4131-9bf9-a36c19ea86e6\") " Jun 09 14:57:57.435613 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.435560 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2810f8d6-9488-4131-9bf9-a36c19ea86e6" (UID: "2810f8d6-9488-4131-9bf9-a36c19ea86e6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:57:57.435613 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.435670 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-service-ca" (OuterVolumeSpecName: "service-ca") pod "2810f8d6-9488-4131-9bf9-a36c19ea86e6" (UID: "2810f8d6-9488-4131-9bf9-a36c19ea86e6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:57:57.436058 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.435731 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-console-config" (OuterVolumeSpecName: "console-config") pod "2810f8d6-9488-4131-9bf9-a36c19ea86e6" (UID: "2810f8d6-9488-4131-9bf9-a36c19ea86e6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:57:57.436058 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.435759 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2810f8d6-9488-4131-9bf9-a36c19ea86e6" (UID: "2810f8d6-9488-4131-9bf9-a36c19ea86e6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:57:57.437449 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.437422 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2810f8d6-9488-4131-9bf9-a36c19ea86e6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2810f8d6-9488-4131-9bf9-a36c19ea86e6" (UID: "2810f8d6-9488-4131-9bf9-a36c19ea86e6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:57:57.437566 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.437452 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2810f8d6-9488-4131-9bf9-a36c19ea86e6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2810f8d6-9488-4131-9bf9-a36c19ea86e6" (UID: "2810f8d6-9488-4131-9bf9-a36c19ea86e6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:57:57.437566 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.437462 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2810f8d6-9488-4131-9bf9-a36c19ea86e6-kube-api-access-gnmvz" (OuterVolumeSpecName: "kube-api-access-gnmvz") pod "2810f8d6-9488-4131-9bf9-a36c19ea86e6" (UID: "2810f8d6-9488-4131-9bf9-a36c19ea86e6"). InnerVolumeSpecName "kube-api-access-gnmvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:57:57.536787 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.536749 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnmvz\" (UniqueName: \"kubernetes.io/projected/2810f8d6-9488-4131-9bf9-a36c19ea86e6-kube-api-access-gnmvz\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:57:57.536787 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.536778 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-oauth-serving-cert\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:57:57.536787 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.536789 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-console-config\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:57:57.537050 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.536799 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2810f8d6-9488-4131-9bf9-a36c19ea86e6-console-serving-cert\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:57:57.537050 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.536807 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-service-ca\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:57:57.537050 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.536815 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2810f8d6-9488-4131-9bf9-a36c19ea86e6-console-oauth-config\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:57:57.537050 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:57.536823 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2810f8d6-9488-4131-9bf9-a36c19ea86e6-trusted-ca-bundle\") on node \"ip-10-0-135-90.ec2.internal\" DevicePath \"\"" Jun 09 14:57:58.071629 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:58.071594 2578 generic.go:356] "Generic (PLEG): container finished" podID="2810f8d6-9488-4131-9bf9-a36c19ea86e6" containerID="00300e788afb0bafb689e5968ac91bebcc5733520579dd8dbc2223a1d63547d5" exitCode=0 Jun 09 14:57:58.071629 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:58.071642 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67768cdfb-np6w6" Jun 09 14:57:58.072137 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:58.071667 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67768cdfb-np6w6" event={"ID":"2810f8d6-9488-4131-9bf9-a36c19ea86e6","Type":"ContainerDied","Data":"00300e788afb0bafb689e5968ac91bebcc5733520579dd8dbc2223a1d63547d5"} Jun 09 14:57:58.072137 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:58.071716 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67768cdfb-np6w6" event={"ID":"2810f8d6-9488-4131-9bf9-a36c19ea86e6","Type":"ContainerDied","Data":"f6f84bc9c2016aac9cbcbd2009cd9851e54eefcb6a4587a1475621a2a100586b"} Jun 09 14:57:58.072137 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:58.071736 2578 scope.go:117] "RemoveContainer" containerID="00300e788afb0bafb689e5968ac91bebcc5733520579dd8dbc2223a1d63547d5" Jun 09 14:57:58.082928 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:58.082912 2578 scope.go:117] "RemoveContainer" containerID="00300e788afb0bafb689e5968ac91bebcc5733520579dd8dbc2223a1d63547d5" Jun 09 14:57:58.083222 ip-10-0-135-90 kubenswrapper[2578]: E0609 14:57:58.083202 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00300e788afb0bafb689e5968ac91bebcc5733520579dd8dbc2223a1d63547d5\": container with ID starting with 00300e788afb0bafb689e5968ac91bebcc5733520579dd8dbc2223a1d63547d5 not found: ID does not exist" containerID="00300e788afb0bafb689e5968ac91bebcc5733520579dd8dbc2223a1d63547d5" Jun 09 14:57:58.083266 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:58.083231 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00300e788afb0bafb689e5968ac91bebcc5733520579dd8dbc2223a1d63547d5"} err="failed to get container status \"00300e788afb0bafb689e5968ac91bebcc5733520579dd8dbc2223a1d63547d5\": rpc error: code = NotFound desc = could not find container \"00300e788afb0bafb689e5968ac91bebcc5733520579dd8dbc2223a1d63547d5\": container with ID starting with 00300e788afb0bafb689e5968ac91bebcc5733520579dd8dbc2223a1d63547d5 not found: ID does not exist" Jun 09 14:57:58.115825 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:58.115795 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67768cdfb-np6w6"] Jun 09 14:57:58.125691 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:58.125668 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67768cdfb-np6w6"] Jun 09 14:57:58.338527 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:57:58.338448 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2810f8d6-9488-4131-9bf9-a36c19ea86e6" path="/var/lib/kubelet/pods/2810f8d6-9488-4131-9bf9-a36c19ea86e6/volumes" Jun 09 14:58:26.847223 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:26.847144 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zh67p_1198225a-bbaf-478c-ab60-f712653822aa/global-pull-secret-syncer/0.log" Jun 09 14:58:26.942022 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:26.941996 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-npp6l_95378364-27ce-4eb8-b854-5a2e69df7858/konnectivity-agent/0.log" Jun 09 14:58:26.984628 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:26.984602 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-90.ec2.internal_3188748c32a7f1992a074b4a4686f613/haproxy/0.log" Jun 09 14:58:30.696642 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:30.696614 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746/alertmanager/0.log" Jun 09 14:58:30.726060 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:30.726033 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746/config-reloader/0.log" Jun 09 14:58:30.751421 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:30.751387 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746/kube-rbac-proxy-web/0.log" Jun 09 14:58:30.778153 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:30.778075 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746/kube-rbac-proxy/0.log" Jun 09 14:58:30.806233 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:30.806206 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746/kube-rbac-proxy-metric/0.log" Jun 09 14:58:30.833170 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:30.833136 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746/prom-label-proxy/0.log" Jun 09 14:58:30.864839 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:30.864815 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c7acd53c-bc6b-4f43-9aba-5cd9a8cd2746/init-config-reloader/0.log" Jun 09 14:58:31.054968 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:31.054887 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-59644566f7-9d7kk_0240a1cd-475e-45b9-9539-55c66b0bf22b/metrics-server/0.log" Jun 09 14:58:31.337819 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:31.337746 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zv5wf_a377faaa-04b5-46d3-9195-1bea36f5ab97/node-exporter/0.log" Jun 09 14:58:31.362051 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:31.362019 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zv5wf_a377faaa-04b5-46d3-9195-1bea36f5ab97/kube-rbac-proxy/0.log" Jun 09 14:58:31.387048 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:31.387024 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zv5wf_a377faaa-04b5-46d3-9195-1bea36f5ab97/init-textfile/0.log" Jun 09 14:58:31.418364 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:31.418341 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-z9vlc_e8f29f61-478a-4b35-a379-5de150730980/kube-rbac-proxy-main/0.log" Jun 09 14:58:31.447318 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:31.447296 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-z9vlc_e8f29f61-478a-4b35-a379-5de150730980/kube-rbac-proxy-self/0.log" Jun 09 14:58:31.469326 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:31.469294 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-z9vlc_e8f29f61-478a-4b35-a379-5de150730980/openshift-state-metrics/0.log" Jun 09 14:58:31.514079 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:31.514048 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d9744918-9bcb-401f-80de-5701adea4b73/prometheus/0.log" Jun 09 14:58:31.535752 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:31.535730 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d9744918-9bcb-401f-80de-5701adea4b73/config-reloader/0.log" Jun 09 14:58:31.561590 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:31.561570 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d9744918-9bcb-401f-80de-5701adea4b73/thanos-sidecar/0.log" Jun 09 14:58:31.590916 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:31.586028 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d9744918-9bcb-401f-80de-5701adea4b73/kube-rbac-proxy-web/0.log" Jun 09 14:58:31.615703 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:31.615675 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d9744918-9bcb-401f-80de-5701adea4b73/kube-rbac-proxy/0.log" Jun 09 14:58:31.634672 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:31.634642 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d9744918-9bcb-401f-80de-5701adea4b73/kube-rbac-proxy-thanos/0.log" Jun 09 14:58:31.659192 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:31.659166 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d9744918-9bcb-401f-80de-5701adea4b73/init-config-reloader/0.log" Jun 09 14:58:31.746849 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:31.746820 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-gldbb_125c19c4-f673-4012-91bd-0a904247d816/prometheus-operator-admission-webhook/0.log" Jun 09 14:58:31.919310 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:31.919232 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776984bcb-vjn4r_8a5c2516-be88-4273-a28e-5d107f7c471e/thanos-query/0.log" Jun 09 14:58:31.977805 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:31.977782 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776984bcb-vjn4r_8a5c2516-be88-4273-a28e-5d107f7c471e/kube-rbac-proxy-web/0.log" Jun 09 14:58:32.014860 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:32.014836 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776984bcb-vjn4r_8a5c2516-be88-4273-a28e-5d107f7c471e/kube-rbac-proxy/0.log" Jun 09 14:58:32.055007 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:32.054966 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776984bcb-vjn4r_8a5c2516-be88-4273-a28e-5d107f7c471e/prom-label-proxy/0.log" Jun 09 14:58:32.090607 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:32.090573 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776984bcb-vjn4r_8a5c2516-be88-4273-a28e-5d107f7c471e/kube-rbac-proxy-rules/0.log" Jun 09 14:58:32.115068 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:32.115040 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776984bcb-vjn4r_8a5c2516-be88-4273-a28e-5d107f7c471e/kube-rbac-proxy-metrics/0.log" Jun 09 14:58:33.683998 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:33.683962 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-kkp7w_0ab77b52-1ec6-4db7-9452-26d0f6866afe/console-operator/1.log" Jun 09 14:58:33.688704 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:33.688686 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-kkp7w_0ab77b52-1ec6-4db7-9452-26d0f6866afe/console-operator/2.log" Jun 09 14:58:34.057536 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.057458 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f54f87476-gtdzq_7466957e-6ca1-4bfa-9d09-9b839e455739/console/0.log" Jun 09 14:58:34.086343 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.086310 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-v7xmv_a283f045-0274-4381-8226-bc3824379571/download-server/0.log" Jun 09 14:58:34.367122 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.367092 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm"] Jun 09 14:58:34.367421 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.367410 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2810f8d6-9488-4131-9bf9-a36c19ea86e6" containerName="console" Jun 09 14:58:34.367464 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.367422 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2810f8d6-9488-4131-9bf9-a36c19ea86e6" containerName="console" Jun 09 14:58:34.367523 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.367497 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2810f8d6-9488-4131-9bf9-a36c19ea86e6" containerName="console" Jun 09 14:58:34.372465 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.371948 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" Jun 09 14:58:34.375761 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.375734 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r24xc\"/\"openshift-service-ca.crt\"" Jun 09 14:58:34.377030 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.377015 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r24xc\"/\"default-dockercfg-trnrv\"" Jun 09 14:58:34.377090 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.377037 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r24xc\"/\"kube-root-ca.crt\"" Jun 09 14:58:34.387137 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.387110 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm"] Jun 09 14:58:34.456244 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.456210 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13721540-8bbd-4be2-8a26-414c4483230e-sys\") pod \"perf-node-gather-daemonset-hjcmm\" (UID: \"13721540-8bbd-4be2-8a26-414c4483230e\") " pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" Jun 09 14:58:34.456244 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.456247 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/13721540-8bbd-4be2-8a26-414c4483230e-podres\") pod \"perf-node-gather-daemonset-hjcmm\" (UID: \"13721540-8bbd-4be2-8a26-414c4483230e\") " pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" Jun 09 14:58:34.456506 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.456274 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89mrd\" (UniqueName: \"kubernetes.io/projected/13721540-8bbd-4be2-8a26-414c4483230e-kube-api-access-89mrd\") pod \"perf-node-gather-daemonset-hjcmm\" (UID: \"13721540-8bbd-4be2-8a26-414c4483230e\") " pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" Jun 09 14:58:34.456506 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.456362 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/13721540-8bbd-4be2-8a26-414c4483230e-proc\") pod \"perf-node-gather-daemonset-hjcmm\" (UID: \"13721540-8bbd-4be2-8a26-414c4483230e\") " pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" Jun 09 14:58:34.456506 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.456402 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13721540-8bbd-4be2-8a26-414c4483230e-lib-modules\") pod \"perf-node-gather-daemonset-hjcmm\" (UID: \"13721540-8bbd-4be2-8a26-414c4483230e\") " pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" Jun 09 14:58:34.556847 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.556813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13721540-8bbd-4be2-8a26-414c4483230e-sys\") pod \"perf-node-gather-daemonset-hjcmm\" (UID: \"13721540-8bbd-4be2-8a26-414c4483230e\") " pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" Jun 09 14:58:34.556847 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.556845 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/13721540-8bbd-4be2-8a26-414c4483230e-podres\") pod \"perf-node-gather-daemonset-hjcmm\" (UID: \"13721540-8bbd-4be2-8a26-414c4483230e\") " pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" Jun 09 14:58:34.557050 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.556866 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89mrd\" (UniqueName: \"kubernetes.io/projected/13721540-8bbd-4be2-8a26-414c4483230e-kube-api-access-89mrd\") pod \"perf-node-gather-daemonset-hjcmm\" (UID: \"13721540-8bbd-4be2-8a26-414c4483230e\") " pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" Jun 09 14:58:34.557050 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.556913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/13721540-8bbd-4be2-8a26-414c4483230e-proc\") pod \"perf-node-gather-daemonset-hjcmm\" (UID: \"13721540-8bbd-4be2-8a26-414c4483230e\") " pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" Jun 09 14:58:34.557050 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.556935 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13721540-8bbd-4be2-8a26-414c4483230e-lib-modules\") pod \"perf-node-gather-daemonset-hjcmm\" (UID: \"13721540-8bbd-4be2-8a26-414c4483230e\") " pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" Jun 09 14:58:34.557050 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.556944 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13721540-8bbd-4be2-8a26-414c4483230e-sys\") pod \"perf-node-gather-daemonset-hjcmm\" (UID: \"13721540-8bbd-4be2-8a26-414c4483230e\") " pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" Jun 09 14:58:34.557050 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.556982 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/13721540-8bbd-4be2-8a26-414c4483230e-podres\") pod \"perf-node-gather-daemonset-hjcmm\" (UID: \"13721540-8bbd-4be2-8a26-414c4483230e\") " pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" Jun 09 14:58:34.557050 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.557018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/13721540-8bbd-4be2-8a26-414c4483230e-proc\") pod \"perf-node-gather-daemonset-hjcmm\" (UID: \"13721540-8bbd-4be2-8a26-414c4483230e\") " pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" Jun 09 14:58:34.557236 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.557055 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13721540-8bbd-4be2-8a26-414c4483230e-lib-modules\") pod \"perf-node-gather-daemonset-hjcmm\" (UID: \"13721540-8bbd-4be2-8a26-414c4483230e\") " pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" Jun 09 14:58:34.567602 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.567574 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89mrd\" (UniqueName: \"kubernetes.io/projected/13721540-8bbd-4be2-8a26-414c4483230e-kube-api-access-89mrd\") pod \"perf-node-gather-daemonset-hjcmm\" (UID: \"13721540-8bbd-4be2-8a26-414c4483230e\") " pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" Jun 09 14:58:34.627043 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.626969 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-h8ngk_6e837d6a-f29b-4234-b2f3-6ba514e0d332/volume-data-source-validator/0.log" Jun 09 14:58:34.682545 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.682508 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" Jun 09 14:58:34.825640 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:34.825614 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm"] Jun 09 14:58:34.828816 ip-10-0-135-90 kubenswrapper[2578]: W0609 14:58:34.828788 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod13721540_8bbd_4be2_8a26_414c4483230e.slice/crio-17a379473347aa5fbc22e922fed74c04a865f88992d0aae40dddb216d4f911fa WatchSource:0}: Error finding container 17a379473347aa5fbc22e922fed74c04a865f88992d0aae40dddb216d4f911fa: Status 404 returned error can't find the container with id 17a379473347aa5fbc22e922fed74c04a865f88992d0aae40dddb216d4f911fa Jun 09 14:58:35.228024 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:35.227935 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" event={"ID":"13721540-8bbd-4be2-8a26-414c4483230e","Type":"ContainerStarted","Data":"1812fbc4e29c6d5c65e0a9dfdb83f45734f7c9b9b35036fdf9f682b39fb0b2c4"} Jun 09 14:58:35.228170 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:35.228028 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" event={"ID":"13721540-8bbd-4be2-8a26-414c4483230e","Type":"ContainerStarted","Data":"17a379473347aa5fbc22e922fed74c04a865f88992d0aae40dddb216d4f911fa"} Jun 09 14:58:35.228170 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:35.228061 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" Jun 09 14:58:35.244593 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:35.244533 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" podStartSLOduration=1.244512651 podStartE2EDuration="1.244512651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:58:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:58:35.24385857 +0000 UTC m=+463.388439568" watchObservedRunningTime="2026-06-09 14:58:35.244512651 +0000 UTC m=+463.389093642" Jun 09 14:58:35.371633 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:35.371606 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l98bt_0cfb1a71-c3ea-499d-8b91-db6188e1b952/dns/0.log" Jun 09 14:58:35.389205 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:35.389164 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l98bt_0cfb1a71-c3ea-499d-8b91-db6188e1b952/kube-rbac-proxy/0.log" Jun 09 14:58:35.497440 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:35.497363 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xmr49_a0b8851c-1232-44c1-bd3d-7755e87421ee/dns-node-resolver/0.log" Jun 09 14:58:36.025744 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:36.025718 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cvjp4_40cc8edc-ca98-45ed-ac67-8ccdd0698b5e/node-ca/0.log" Jun 09 14:58:36.686923 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:36.686899 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-575b9d94b7-5jjqp_7a9edcb9-728c-4eba-9cdf-cc677ec92497/router/0.log" Jun 09 14:58:37.002896 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:37.002824 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gcxj7_99263755-4406-4d24-a336-6ece74ce3e0f/serve-healthcheck-canary/0.log" Jun 09 14:58:37.529107 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:37.529081 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g6tvn_a2ea92f8-20bf-42bd-a300-b23e6997f3b0/kube-rbac-proxy/0.log" Jun 09 14:58:37.547465 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:37.547441 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g6tvn_a2ea92f8-20bf-42bd-a300-b23e6997f3b0/exporter/0.log" Jun 09 14:58:37.568553 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:37.568528 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g6tvn_a2ea92f8-20bf-42bd-a300-b23e6997f3b0/extractor/0.log" Jun 09 14:58:41.241839 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:41.241808 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-r24xc/perf-node-gather-daemonset-hjcmm" Jun 09 14:58:43.157401 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:43.157375 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbdtd_ffe38d93-a450-48ed-812a-7a2f8ce02e3d/kube-multus-additional-cni-plugins/0.log" Jun 09 14:58:43.180095 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:43.180067 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbdtd_ffe38d93-a450-48ed-812a-7a2f8ce02e3d/egress-router-binary-copy/0.log" Jun 09 14:58:43.202492 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:43.202378 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbdtd_ffe38d93-a450-48ed-812a-7a2f8ce02e3d/cni-plugins/0.log" Jun 09 14:58:43.221529 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:43.221506 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbdtd_ffe38d93-a450-48ed-812a-7a2f8ce02e3d/bond-cni-plugin/0.log" Jun 09 14:58:43.242753 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:43.242728 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbdtd_ffe38d93-a450-48ed-812a-7a2f8ce02e3d/routeoverride-cni/0.log" Jun 09 14:58:43.262127 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:43.262104 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbdtd_ffe38d93-a450-48ed-812a-7a2f8ce02e3d/whereabouts-cni-bincopy/0.log" Jun 09 14:58:43.282431 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:43.282406 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vbdtd_ffe38d93-a450-48ed-812a-7a2f8ce02e3d/whereabouts-cni/0.log" Jun 09 14:58:43.315700 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:43.315674 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jbbj6_bc15d523-28ae-492f-b614-f82680cd7610/kube-multus/0.log" Jun 09 14:58:43.362157 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:43.362134 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6pz99_e78820c0-87e6-4a86-a8b3-efbe056c96b7/network-metrics-daemon/0.log" Jun 09 14:58:43.433663 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:43.433640 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6pz99_e78820c0-87e6-4a86-a8b3-efbe056c96b7/kube-rbac-proxy/0.log" Jun 09 14:58:44.668176 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:44.668147 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nc4z6_6e268462-1c4d-45ec-ae83-ac7fb55f6e6b/ovn-controller/0.log" Jun 09 14:58:44.689438 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:44.689395 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nc4z6_6e268462-1c4d-45ec-ae83-ac7fb55f6e6b/ovn-acl-logging/0.log" Jun 09 14:58:44.689641 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:44.689497 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nc4z6_6e268462-1c4d-45ec-ae83-ac7fb55f6e6b/ovn-acl-logging/1.log" Jun 09 14:58:44.710807 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:44.710774 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nc4z6_6e268462-1c4d-45ec-ae83-ac7fb55f6e6b/kube-rbac-proxy-node/0.log" Jun 09 14:58:44.735190 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:44.735164 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nc4z6_6e268462-1c4d-45ec-ae83-ac7fb55f6e6b/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 14:58:44.753215 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:44.753186 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nc4z6_6e268462-1c4d-45ec-ae83-ac7fb55f6e6b/northd/0.log" Jun 09 14:58:44.771625 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:44.771602 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nc4z6_6e268462-1c4d-45ec-ae83-ac7fb55f6e6b/nbdb/0.log" Jun 09 14:58:44.793900 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:44.793876 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nc4z6_6e268462-1c4d-45ec-ae83-ac7fb55f6e6b/sbdb/0.log" Jun 09 14:58:44.853736 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:44.853706 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nc4z6_6e268462-1c4d-45ec-ae83-ac7fb55f6e6b/ovnkube-controller/0.log" Jun 09 14:58:46.028738 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:46.028705 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-72v7w_dea690ee-0ba8-44a4-a025-863f659225af/network-check-target-container/0.log" Jun 09 14:58:47.058346 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:47.058318 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-d7tm2_be13e6d2-7f68-454e-a813-629c7bf920ae/iptables-alerter/0.log" Jun 09 14:58:47.827199 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:47.827171 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-q422g_fffccc4b-c1a2-44c9-b2e2-58939246915d/tuned/0.log" Jun 09 14:58:50.483669 ip-10-0-135-90 kubenswrapper[2578]: I0609 14:58:50.483633 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-7d74d578b8-t25gc_baeacbfc-88bf-4761-842b-17e711163e85/service-ca-controller/0.log"