Jul 23 16:52:32.360783 ip-10-0-138-250 systemd[1]: Starting Kubernetes Kubelet... Jul 23 16:52:32.870954 ip-10-0-138-250 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 16:52:32.870954 ip-10-0-138-250 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 16:52:32.870954 ip-10-0-138-250 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 16:52:32.870954 ip-10-0-138-250 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 16:52:32.870954 ip-10-0-138-250 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 16:52:32.870954 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.827532 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 16:52:32.870954 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831282 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 16:52:32.870954 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831295 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 16:52:32.870954 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831299 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 16:52:32.870954 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831304 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 16:52:32.870954 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831309 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 16:52:32.870954 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831313 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 16:52:32.870954 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831316 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 16:52:32.870954 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831319 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 16:52:32.876924 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831321 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 16:52:32.876924 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831324 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 16:52:32.876924 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831327 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 16:52:32.876924 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831330 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 16:52:32.876924 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831332 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 16:52:32.876924 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831335 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 16:52:32.876924 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831338 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 16:52:32.876924 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831340 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 16:52:32.876924 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831343 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 16:52:32.876924 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831346 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 16:52:32.876924 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831348 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 16:52:32.876924 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831351 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 16:52:32.876924 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831354 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 16:52:32.876924 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831357 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 16:52:32.876924 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831359 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 16:52:32.876924 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831362 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 16:52:32.876924 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831365 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 16:52:32.876924 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831368 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 16:52:32.876924 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831371 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 16:52:32.876924 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831374 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 16:52:32.877990 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831377 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 16:52:32.877990 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831379 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 16:52:32.877990 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831382 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 16:52:32.877990 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831385 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 16:52:32.877990 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831387 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 16:52:32.877990 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831390 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 16:52:32.877990 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831394 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 16:52:32.877990 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831398 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 16:52:32.877990 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831401 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 16:52:32.877990 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831403 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 16:52:32.877990 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831406 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 16:52:32.877990 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831408 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 16:52:32.877990 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831411 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 16:52:32.877990 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831435 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 16:52:32.877990 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831439 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 16:52:32.877990 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831443 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 16:52:32.877990 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831446 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 16:52:32.877990 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831448 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 16:52:32.877990 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831451 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831453 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831456 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831458 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831461 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831464 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831466 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831469 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831471 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831474 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831477 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831479 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831483 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831485 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831488 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831491 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831494 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831497 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831499 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831502 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831505 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 16:52:32.878679 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831508 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 16:52:32.879919 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831510 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 16:52:32.879919 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831514 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 16:52:32.879919 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831516 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 16:52:32.879919 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831519 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 16:52:32.879919 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831521 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 16:52:32.879919 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831524 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 16:52:32.879919 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831527 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 16:52:32.879919 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831530 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 16:52:32.879919 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831533 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 16:52:32.879919 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831536 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 16:52:32.879919 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831538 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 16:52:32.879919 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831540 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 16:52:32.879919 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831543 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 16:52:32.879919 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831545 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 16:52:32.879919 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831548 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 16:52:32.879919 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831551 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 16:52:32.879919 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831553 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 16:52:32.879919 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831556 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 16:52:32.879919 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831558 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 16:52:32.879919 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831561 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 16:52:32.880573 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831565 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 16:52:32.880573 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831568 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 16:52:32.880573 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831571 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 16:52:32.880573 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831574 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 16:52:32.880573 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831577 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 16:52:32.880573 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831580 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 16:52:32.880573 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831583 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 16:52:32.880573 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831586 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 16:52:32.880573 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831588 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 16:52:32.880573 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831591 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 16:52:32.880573 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.831594 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 16:52:32.880573 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833209 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 16:52:32.880573 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833217 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 16:52:32.880573 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833220 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 16:52:32.880573 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833224 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 16:52:32.880573 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833227 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 16:52:32.880573 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833229 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 16:52:32.880573 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833232 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 16:52:32.880573 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833235 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 16:52:32.881409 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833237 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 16:52:32.881409 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833241 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 16:52:32.881409 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833243 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 16:52:32.881409 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833246 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 16:52:32.881409 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833249 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 16:52:32.881409 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833252 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 16:52:32.881409 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833254 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 16:52:32.881409 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833257 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 16:52:32.881409 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833259 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 16:52:32.881409 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833262 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 16:52:32.881409 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833265 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 16:52:32.881409 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833268 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 16:52:32.881409 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833274 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 16:52:32.881409 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833277 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 16:52:32.881409 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833281 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 16:52:32.881409 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833284 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 16:52:32.881409 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833287 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 16:52:32.881409 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833290 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 16:52:32.881409 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833293 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 16:52:32.882048 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833295 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 16:52:32.882048 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833298 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 16:52:32.882048 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833301 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 16:52:32.882048 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833303 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 16:52:32.882048 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833306 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 16:52:32.882048 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833308 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 16:52:32.882048 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833311 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 16:52:32.882048 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833313 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 16:52:32.882048 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833316 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 16:52:32.882048 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833319 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 16:52:32.882048 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833322 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 16:52:32.882048 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833324 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 16:52:32.882048 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833328 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 16:52:32.882048 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833330 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 16:52:32.882048 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833334 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 16:52:32.882048 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833339 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 16:52:32.882048 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833343 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 16:52:32.882048 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833345 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 16:52:32.882048 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833349 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 16:52:32.882048 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833352 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 16:52:32.882905 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833354 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 16:52:32.882905 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833357 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 16:52:32.882905 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833359 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 16:52:32.882905 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833362 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 16:52:32.882905 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833365 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 16:52:32.882905 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833367 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 16:52:32.882905 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833370 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 16:52:32.882905 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833373 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 16:52:32.882905 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833375 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 16:52:32.882905 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833378 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 16:52:32.882905 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833380 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 16:52:32.882905 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833383 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 16:52:32.882905 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833386 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 16:52:32.882905 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833388 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 16:52:32.882905 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833391 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 16:52:32.882905 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833394 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 16:52:32.882905 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833396 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 16:52:32.882905 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833399 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 16:52:32.882905 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833401 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 23 16:52:32.882905 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833404 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 16:52:32.884208 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833407 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 16:52:32.884208 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833409 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 16:52:32.884208 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833412 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 16:52:32.884208 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833433 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 16:52:32.884208 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833437 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 16:52:32.884208 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833440 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 16:52:32.884208 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833444 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 16:52:32.884208 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833447 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 16:52:32.884208 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833451 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 16:52:32.884208 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833453 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 16:52:32.884208 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833456 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 16:52:32.884208 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833458 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 16:52:32.884208 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833461 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 16:52:32.884208 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833463 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 16:52:32.884208 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833466 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 16:52:32.884208 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833469 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 16:52:32.884208 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833471 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 16:52:32.884208 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833474 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 16:52:32.884208 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833477 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 16:52:32.884737 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833480 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 16:52:32.884737 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833485 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 16:52:32.884737 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833489 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 16:52:32.884737 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833492 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 16:52:32.884737 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833495 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 16:52:32.884737 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833497 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 16:52:32.884737 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833501 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 16:52:32.884737 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833504 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 16:52:32.884737 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833506 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 16:52:32.884737 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833509 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 16:52:32.884737 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833512 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 16:52:32.884737 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833515 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 16:52:32.884737 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833517 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 16:52:32.884737 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833900 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 16:52:32.884737 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833904 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 16:52:32.884737 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833907 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 16:52:32.884737 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833910 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 16:52:32.884737 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833913 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 16:52:32.884737 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833916 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 16:52:32.884737 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833918 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 16:52:32.885215 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833921 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 16:52:32.885215 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833924 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 16:52:32.885215 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833927 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 16:52:32.885215 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833930 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 16:52:32.885215 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833932 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 16:52:32.885215 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833935 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 16:52:32.885215 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833937 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 16:52:32.885215 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833940 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 16:52:32.885215 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833942 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 16:52:32.885215 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833945 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 16:52:32.885215 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833948 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 16:52:32.885215 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833950 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 16:52:32.885215 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833953 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 16:52:32.885215 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833956 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 16:52:32.885215 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833958 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 16:52:32.885215 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833961 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 16:52:32.885215 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833963 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 16:52:32.885215 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833966 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 16:52:32.885215 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833968 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 16:52:32.885215 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833971 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 16:52:32.885758 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833973 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 16:52:32.885758 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833976 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 16:52:32.885758 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833978 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 16:52:32.885758 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833981 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 16:52:32.885758 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833984 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 16:52:32.885758 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833989 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 16:52:32.885758 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833992 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 16:52:32.885758 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833994 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 16:52:32.885758 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833997 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 16:52:32.885758 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.833999 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 16:52:32.885758 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834002 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 16:52:32.885758 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834004 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 16:52:32.885758 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834007 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 16:52:32.885758 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834010 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 16:52:32.885758 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834013 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 16:52:32.885758 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834016 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 16:52:32.885758 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834018 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 16:52:32.885758 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834020 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 16:52:32.885758 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834026 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 16:52:32.885758 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834030 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 16:52:32.886224 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834034 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 16:52:32.886224 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834036 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 16:52:32.886224 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834039 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 16:52:32.886224 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834043 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 16:52:32.886224 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834045 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 16:52:32.886224 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834048 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 16:52:32.886224 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834050 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 16:52:32.886224 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834053 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 16:52:32.886224 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834055 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 16:52:32.886224 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834058 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 16:52:32.886224 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834061 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 16:52:32.886224 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834063 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 16:52:32.886224 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834066 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 16:52:32.886224 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834069 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 16:52:32.886224 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834071 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 16:52:32.886224 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834074 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 16:52:32.886224 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834076 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 16:52:32.886224 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834084 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 16:52:32.886224 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834086 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 23 16:52:32.886224 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834089 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 16:52:32.886713 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834091 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 16:52:32.886713 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834094 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 16:52:32.886713 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834096 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 16:52:32.886713 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834099 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 16:52:32.886713 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834101 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 16:52:32.886713 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834104 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 16:52:32.886713 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834106 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 16:52:32.886713 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834111 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 16:52:32.886713 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834115 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 16:52:32.886713 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834118 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 16:52:32.886713 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834122 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 16:52:32.886713 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834125 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 16:52:32.886713 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834128 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 16:52:32.886713 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834131 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 16:52:32.886713 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834133 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 16:52:32.886713 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834136 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 16:52:32.886713 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834139 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 16:52:32.886713 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834141 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 16:52:32.886713 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834144 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 16:52:32.887168 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834148 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 16:52:32.887168 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834151 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 16:52:32.887168 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834154 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 16:52:32.887168 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834157 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 16:52:32.887168 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834159 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 16:52:32.887168 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834162 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 16:52:32.887168 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834164 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 16:52:32.887168 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834167 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 16:52:32.887168 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834170 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 16:52:32.887168 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834172 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 16:52:32.887168 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834176 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 16:52:32.887168 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834179 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 16:52:32.887168 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834181 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 16:52:32.887168 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834265 2574 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 16:52:32.887168 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834276 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 16:52:32.887168 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834286 2574 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 16:52:32.887168 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834292 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 16:52:32.887168 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834298 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 16:52:32.887168 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834303 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 16:52:32.887168 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834309 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834313 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834317 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834322 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834325 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834328 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834331 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834334 2574 flags.go:64] FLAG: --cgroup-root="" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834337 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834341 2574 flags.go:64] FLAG: --client-ca-file="" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834343 2574 flags.go:64] FLAG: --cloud-provider="external" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834346 2574 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834351 2574 flags.go:64] FLAG: --cluster-domain="" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834353 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834357 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834361 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834364 2574 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834368 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834371 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834374 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834377 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834380 2574 flags.go:64] FLAG: --contention-profiling="false" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834383 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834388 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 16:52:32.887650 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834391 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834394 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834399 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834402 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834405 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834408 2574 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834411 2574 flags.go:64] FLAG: --enable-server="true" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834426 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834431 2574 flags.go:64] FLAG: --event-burst="100" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834434 2574 flags.go:64] FLAG: --event-qps="50" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834437 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834442 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834445 2574 flags.go:64] FLAG: --eviction-hard="" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834449 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834452 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834455 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834458 2574 flags.go:64] FLAG: --eviction-soft="" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834461 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834464 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834467 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834470 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834473 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834476 2574 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834479 2574 flags.go:64] FLAG: --feature-gates="" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834482 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 16:52:32.888230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834485 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834488 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834492 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834495 2574 flags.go:64] FLAG: --healthz-port="10248" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834498 2574 flags.go:64] FLAG: --help="false" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834501 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-138-250.ec2.internal" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834505 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834508 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834511 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834514 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834517 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834520 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834523 2574 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834525 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834528 2574 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834531 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834534 2574 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834537 2574 flags.go:64] FLAG: --kube-reserved="" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834542 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834545 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834548 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834551 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834554 2574 flags.go:64] FLAG: --lock-file="" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834557 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 16:52:32.888868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834560 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834563 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834569 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834571 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834574 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834577 2574 flags.go:64] FLAG: --logging-format="text" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834580 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834583 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834586 2574 flags.go:64] FLAG: --manifest-url="" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834589 2574 flags.go:64] FLAG: --manifest-url-header="" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834593 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834596 2574 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834600 2574 flags.go:64] FLAG: --max-pods="110" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834603 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834607 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834610 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834613 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834616 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834619 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834622 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834630 2574 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834632 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834635 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 16:52:32.889439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834638 2574 flags.go:64] FLAG: --pod-cidr="" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834641 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834648 2574 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834650 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834655 2574 flags.go:64] FLAG: --pods-per-core="0" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834659 2574 flags.go:64] FLAG: --port="10250" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834662 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834665 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f3c6be49d74c1c29" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834669 2574 flags.go:64] FLAG: --qos-reserved="" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834672 2574 flags.go:64] FLAG: --read-only-port="10255" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834675 2574 flags.go:64] FLAG: --register-node="true" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834678 2574 flags.go:64] FLAG: --register-with-taints="" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834682 2574 flags.go:64] FLAG: --registry-burst="10" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834685 2574 flags.go:64] FLAG: --registry-qps="5" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834687 2574 flags.go:64] FLAG: --reserved-cpus="" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834690 2574 flags.go:64] FLAG: --reserved-memory="" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834694 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834697 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834700 2574 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834703 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834706 2574 flags.go:64] FLAG: --runonce="false" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834709 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834712 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834716 2574 flags.go:64] FLAG: --seccomp-default="false" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834719 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 16:52:32.890029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834722 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834724 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834728 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834731 2574 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834734 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834737 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834739 2574 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834742 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834745 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834748 2574 flags.go:64] FLAG: --system-cgroups="" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834751 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834758 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834761 2574 flags.go:64] FLAG: --tls-cert-file="" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834764 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834768 2574 flags.go:64] FLAG: --tls-min-version="" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834771 2574 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834773 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834776 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834779 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834782 2574 flags.go:64] FLAG: --v="2" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834786 2574 flags.go:64] FLAG: --version="false" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834790 2574 flags.go:64] FLAG: --vmodule="" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834800 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.834803 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834922 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 16:52:32.890630 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834926 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 16:52:32.891229 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834929 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 16:52:32.891229 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834932 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 16:52:32.891229 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834934 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 16:52:32.891229 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834937 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 16:52:32.891229 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834941 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 16:52:32.891229 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834944 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 23 16:52:32.891229 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834947 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 16:52:32.891229 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834951 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 16:52:32.891229 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834955 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 16:52:32.891229 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834958 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 16:52:32.891229 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834961 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 16:52:32.891229 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834964 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 16:52:32.891229 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834966 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 16:52:32.891229 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834969 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 16:52:32.891229 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834972 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 16:52:32.891229 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834975 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 16:52:32.891229 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834978 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 16:52:32.891229 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834982 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 16:52:32.891229 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834985 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 16:52:32.891229 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834988 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 16:52:32.891728 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834991 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 16:52:32.891728 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834993 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 16:52:32.891728 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834996 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 16:52:32.891728 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.834998 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 16:52:32.891728 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835001 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 16:52:32.891728 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835004 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 16:52:32.891728 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835007 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 16:52:32.891728 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835009 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 16:52:32.891728 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835012 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 16:52:32.891728 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835014 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 16:52:32.891728 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835017 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 16:52:32.891728 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835019 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 16:52:32.891728 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835022 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 16:52:32.891728 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835024 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 16:52:32.891728 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835027 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 16:52:32.891728 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835030 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 16:52:32.891728 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835034 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 16:52:32.891728 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835037 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 16:52:32.891728 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835039 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 16:52:32.891728 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835042 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 16:52:32.892217 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835046 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 16:52:32.892217 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835049 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 16:52:32.892217 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835052 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 16:52:32.892217 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835056 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 16:52:32.892217 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835060 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 16:52:32.892217 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835063 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 16:52:32.892217 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835066 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 16:52:32.892217 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835069 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 16:52:32.892217 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835072 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 16:52:32.892217 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835077 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 16:52:32.892217 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835081 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 16:52:32.892217 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835084 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 16:52:32.892217 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835086 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 16:52:32.892217 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835090 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 16:52:32.892217 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835092 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 16:52:32.892217 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835095 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 16:52:32.892217 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835097 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 16:52:32.892217 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835100 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 16:52:32.892217 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835102 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 16:52:32.892717 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835105 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 16:52:32.892717 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835108 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 16:52:32.892717 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835110 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 16:52:32.892717 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835113 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 16:52:32.892717 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835115 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 16:52:32.892717 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835118 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 16:52:32.892717 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835120 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 16:52:32.892717 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835123 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 16:52:32.892717 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835125 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 16:52:32.892717 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835129 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 16:52:32.892717 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835132 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 16:52:32.892717 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835135 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 16:52:32.892717 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835138 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 16:52:32.892717 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835140 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 16:52:32.892717 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835143 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 16:52:32.892717 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835145 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 16:52:32.892717 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835148 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 16:52:32.892717 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835151 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 16:52:32.892717 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835153 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 16:52:32.892717 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835155 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 16:52:32.893192 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835158 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 16:52:32.893192 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835160 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 16:52:32.893192 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835164 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 16:52:32.893192 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835167 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 16:52:32.893192 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835170 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 16:52:32.893192 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835172 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 16:52:32.893192 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835175 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 16:52:32.893192 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835178 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 16:52:32.893192 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835181 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 16:52:32.893192 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835183 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 16:52:32.893192 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835186 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 16:52:32.893192 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835189 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 16:52:32.893192 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835191 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 16:52:32.893192 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835194 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 16:52:32.893192 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835196 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 16:52:32.893192 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835199 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 16:52:32.893192 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835201 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 16:52:32.893192 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.835204 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 16:52:32.893644 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.835209 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 16:52:32.893644 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.842405 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 16:52:32.893644 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.842435 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 16:52:32.893644 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.842455 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 16:52:32.893644 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.842464 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 16:52:32.893644 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842521 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 16:52:32.893644 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842526 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 16:52:32.893644 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842530 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 16:52:32.893644 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842533 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 16:52:32.893644 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842536 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 16:52:32.893644 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842539 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 16:52:32.893644 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842541 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 16:52:32.893644 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842544 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 16:52:32.893644 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842547 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 16:52:32.893644 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842549 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 16:52:32.894005 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842567 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 16:52:32.894005 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842571 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 16:52:32.894005 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842574 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 16:52:32.894005 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842578 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 16:52:32.894005 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842581 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 16:52:32.894005 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842584 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 16:52:32.894005 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842586 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 16:52:32.894005 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842590 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 16:52:32.894005 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842592 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 16:52:32.894005 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842595 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 16:52:32.894005 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842598 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 16:52:32.894005 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842601 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 16:52:32.894005 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842603 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 16:52:32.894005 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842605 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 16:52:32.894005 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842608 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 16:52:32.894005 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842611 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 16:52:32.894005 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842614 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 16:52:32.894005 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842617 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 16:52:32.894005 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842619 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 16:52:32.894005 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842623 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 16:52:32.894497 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842626 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 16:52:32.894497 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842628 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 16:52:32.894497 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842631 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 16:52:32.894497 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842634 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 16:52:32.894497 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842636 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 16:52:32.894497 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842639 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 16:52:32.894497 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842641 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 16:52:32.894497 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842644 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 16:52:32.894497 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842647 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 16:52:32.894497 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842649 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 16:52:32.894497 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842652 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 16:52:32.894497 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842654 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 16:52:32.894497 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842657 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 16:52:32.894497 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842659 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 16:52:32.894497 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842662 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 16:52:32.894497 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842665 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 16:52:32.894497 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842667 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 16:52:32.894497 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842670 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 16:52:32.894497 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842672 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 16:52:32.894497 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842675 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 16:52:32.894974 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842677 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 16:52:32.894974 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842680 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 16:52:32.894974 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842683 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 16:52:32.894974 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842685 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 16:52:32.894974 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842688 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 16:52:32.894974 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842690 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 16:52:32.894974 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842694 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 16:52:32.894974 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842697 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 16:52:32.894974 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842702 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 16:52:32.894974 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842705 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 16:52:32.894974 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842708 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 16:52:32.894974 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842711 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 16:52:32.894974 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842714 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 16:52:32.894974 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842717 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 16:52:32.894974 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842720 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 23 16:52:32.894974 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842723 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 16:52:32.894974 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842725 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 16:52:32.894974 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842728 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 16:52:32.894974 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842730 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 16:52:32.894974 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842733 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 16:52:32.895564 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842735 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 16:52:32.895564 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842738 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 16:52:32.895564 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842741 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 16:52:32.895564 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842743 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 16:52:32.895564 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842746 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 16:52:32.895564 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842748 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 16:52:32.895564 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842751 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 16:52:32.895564 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842754 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 16:52:32.895564 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842756 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 16:52:32.895564 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842758 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 16:52:32.895564 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842761 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 16:52:32.895564 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842763 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 16:52:32.895564 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842766 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 16:52:32.895564 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842768 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 16:52:32.895564 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842772 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 16:52:32.895564 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842776 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 16:52:32.895564 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842779 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 16:52:32.895564 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842782 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 16:52:32.895564 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842785 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 16:52:32.896101 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842787 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 16:52:32.896101 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842791 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 16:52:32.896101 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842796 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 16:52:32.896101 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842799 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 16:52:32.896101 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842803 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 16:52:32.896101 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842806 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 16:52:32.896101 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842809 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 16:52:32.896101 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842812 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 16:52:32.896101 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842814 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 16:52:32.896101 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842817 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 16:52:32.896101 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.842822 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 16:52:32.896101 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842960 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 16:52:32.896101 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842966 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 16:52:32.896101 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842970 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 16:52:32.896471 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842974 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 16:52:32.896471 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842977 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 16:52:32.896471 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842979 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 16:52:32.896471 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842982 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 16:52:32.896471 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842985 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 16:52:32.896471 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842987 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 16:52:32.896471 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842990 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 16:52:32.896471 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842993 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 16:52:32.896471 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842996 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 16:52:32.896471 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.842998 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 16:52:32.896471 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843001 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 16:52:32.896471 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843003 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 16:52:32.896471 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843006 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 16:52:32.896471 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843009 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 16:52:32.896471 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843011 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 16:52:32.896471 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843014 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 16:52:32.896471 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843016 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 16:52:32.896471 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843019 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 16:52:32.896471 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843021 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 16:52:32.896935 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843024 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 16:52:32.896935 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843028 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 16:52:32.896935 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843030 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 16:52:32.896935 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843033 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 16:52:32.896935 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843036 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 16:52:32.896935 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843039 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 16:52:32.896935 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843042 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 16:52:32.896935 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843045 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 16:52:32.896935 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843048 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 16:52:32.896935 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843050 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 16:52:32.896935 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843053 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 16:52:32.896935 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843055 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 16:52:32.896935 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843058 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 16:52:32.896935 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843062 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 16:52:32.896935 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843065 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 16:52:32.896935 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843068 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 16:52:32.896935 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843071 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 16:52:32.896935 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843074 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 16:52:32.896935 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843077 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 16:52:32.897443 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843079 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 16:52:32.897443 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843082 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 16:52:32.897443 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843084 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 16:52:32.897443 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843087 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 16:52:32.897443 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843090 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 16:52:32.897443 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843092 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 16:52:32.897443 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843095 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 16:52:32.897443 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843097 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 16:52:32.897443 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843100 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 16:52:32.897443 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843102 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 16:52:32.897443 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843105 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 16:52:32.897443 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843107 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 16:52:32.897443 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843110 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 16:52:32.897443 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843112 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 16:52:32.897443 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843116 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 16:52:32.897443 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843119 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 16:52:32.897443 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843123 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 16:52:32.897443 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843126 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 16:52:32.897443 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843128 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 16:52:32.897443 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843130 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 16:52:32.897985 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843134 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 16:52:32.897985 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843136 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 16:52:32.897985 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843139 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 16:52:32.897985 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843141 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 16:52:32.897985 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843144 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 16:52:32.897985 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843146 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 16:52:32.897985 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843149 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 16:52:32.897985 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843151 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 16:52:32.897985 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843154 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 16:52:32.897985 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843156 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 16:52:32.897985 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843159 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 16:52:32.897985 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843161 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 16:52:32.897985 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843164 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 16:52:32.897985 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843166 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 16:52:32.897985 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843169 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 16:52:32.897985 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843171 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 16:52:32.897985 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843174 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 16:52:32.897985 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843177 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 16:52:32.897985 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843180 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 23 16:52:32.897985 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843182 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 16:52:32.898487 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843184 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 16:52:32.898487 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843187 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 16:52:32.898487 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843189 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 16:52:32.898487 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843192 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 16:52:32.898487 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843195 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 16:52:32.898487 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843197 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 16:52:32.898487 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843202 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 16:52:32.898487 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843206 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 16:52:32.898487 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843210 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 16:52:32.898487 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843213 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 16:52:32.898487 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843215 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 16:52:32.898487 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843218 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 16:52:32.898487 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843221 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 16:52:32.898487 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843224 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 16:52:32.898487 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843227 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 16:52:32.898487 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843229 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 16:52:32.898487 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843232 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 16:52:32.898487 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:32.843234 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 16:52:32.898916 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.843239 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 16:52:32.898916 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.843354 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 16:52:32.898916 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.851304 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 16:52:32.898916 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.852678 2574 server.go:1019] "Starting client certificate rotation" Jul 23 16:52:32.898916 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.852777 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 16:52:32.898916 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.852811 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 16:52:32.898916 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.855147 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 16:52:32.898916 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.858303 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 16:52:32.898916 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.870742 2574 log.go:25] "Validated CRI v1 runtime API" Jul 23 16:52:32.898916 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.873040 2574 log.go:25] "Validated CRI v1 image API" Jul 23 16:52:32.898916 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.895816 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 16:52:32.898916 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.898131 2574 fs.go:135] Filesystem UUIDs: map[06c91f2b-8fe1-4102-89c1-2b58d23d68d7:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8159dcaa-8b38-4268-bfa7-c8324b0cebdf:/dev/nvme0n1p3] Jul 23 16:52:32.899213 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.898148 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 16:52:32.902828 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.902700 2574 manager.go:216] Machine: {Timestamp:2026-07-23 16:52:32.902120482 +0000 UTC m=+0.408519470 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103537 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e9d1f006e53fca414700d010c5532 SystemUUID:ec2e9d1f-006e-53fc-a414-700d010c5532 BootID:7dccfcf2-e0e6-4517-bfde-b416bd0f1bb1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3a:61:9c:1d:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3a:61:9c:1d:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:e4:30:46:38:85 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 16:52:32.902828 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.902824 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 16:52:32.902935 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.902922 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 16:52:32.905499 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.905454 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 16:52:32.905689 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.905504 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-250.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 16:52:32.907134 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.907123 2574 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 16:52:32.907167 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.907139 2574 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 16:52:32.907167 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.907151 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 16:52:32.907726 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.907714 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 16:52:32.908988 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.908977 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 16:52:32.911833 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.911816 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 23 16:52:32.911975 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.911965 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 16:52:32.912004 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.912000 2574 kubelet.go:486] "Attempting to sync node with API server" Jul 23 16:52:32.912037 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.912017 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 16:52:32.912065 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.912036 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 16:52:32.912065 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.912051 2574 kubelet.go:398] "Adding apiserver pod source" Jul 23 16:52:32.912065 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.912062 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 16:52:32.913213 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.913184 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 16:52:32.913213 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.913214 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 16:52:32.914308 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.914279 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 16:52:32.922708 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.922687 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 16:52:32.922797 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.922787 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fx4dw" Jul 23 16:52:32.924693 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.924678 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 16:52:32.924754 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.924708 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 16:52:32.926169 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.926124 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 16:52:32.926169 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.926141 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 16:52:32.926169 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.926147 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 16:52:32.926169 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.926153 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 16:52:32.926169 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.926165 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 16:52:32.926169 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.926172 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 16:52:32.926381 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.926181 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 16:52:32.926381 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.926187 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 16:52:32.926381 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.926194 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 16:52:32.926381 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.926200 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 16:52:32.926381 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.926209 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 16:52:32.926381 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.926214 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 16:52:32.927605 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.927593 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 16:52:32.927646 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.927607 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 16:52:32.928220 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.928205 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fx4dw" Jul 23 16:52:32.928769 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:32.928733 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 16:52:32.928935 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:32.928911 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-250.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 16:52:32.930944 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.930929 2574 server.go:1268] "Started kubelet" Jul 23 16:52:32.931041 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.931012 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 16:52:32.931093 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.931013 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 16:52:32.931093 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.931075 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 16:52:32.931893 ip-10-0-138-250 systemd[1]: Started Kubernetes Kubelet. Jul 23 16:52:32.934225 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.933230 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 16:52:32.941502 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.941482 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 16:52:32.941600 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.941505 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 16:52:32.941821 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:32.941575 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found" Jul 23 16:52:32.942140 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.942120 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 16:52:32.942203 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.942145 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 16:52:32.942203 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.942119 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 16:52:32.942280 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.942273 2574 reconstruct.go:97] "Volume reconstruction finished" Jul 23 16:52:32.942328 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.942283 2574 reconciler.go:29] "Reconciler: start to sync state" Jul 23 16:52:32.944071 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.944052 2574 server.go:310] "Adding debug handlers to kubelet server" Jul 23 16:52:32.944519 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.944454 2574 factory.go:55] Registering systemd factory Jul 23 16:52:32.944519 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.944476 2574 factory.go:223] Registration of the systemd container factory successfully Jul 23 16:52:32.944658 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:32.944561 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 16:52:32.944803 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.944792 2574 factory.go:153] Registering CRI-O factory Jul 23 16:52:32.944861 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.944810 2574 factory.go:223] Registration of the crio container factory successfully Jul 23 16:52:32.944918 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.944863 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 16:52:32.944918 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.944890 2574 factory.go:103] Registering Raw factory Jul 23 16:52:32.944918 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.944905 2574 manager.go:1196] Started watching for new ooms in manager Jul 23 16:52:32.945380 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.945367 2574 manager.go:349] Starting recovery of all containers Jul 23 16:52:32.958743 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:32.958700 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 16:52:34.000108 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:34.000079 2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-250.ec2.internal\" not found" node="ip-10-0-138-250.ec2.internal" Jul 23 16:52:34.000210 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.000120 2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-250.ec2.internal" not found Jul 23 16:52:34.000624 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.000535 2574 manager.go:354] Recovery completed Jul 23 16:52:34.004892 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.004878 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 16:52:34.006795 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.006779 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientMemory" Jul 23 16:52:34.006852 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.006808 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 16:52:34.006852 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.006825 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientPID" Jul 23 16:52:34.007395 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.007379 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 16:52:34.007395 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.007393 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 16:52:34.007526 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.007412 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 23 16:52:34.007526 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.007382 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 16:52:34.008252 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.008238 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientMemory" Jul 23 16:52:34.008316 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.008266 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 16:52:34.008316 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.008281 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientPID" Jul 23 16:52:34.009055 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.009044 2574 policy_none.go:49] "None policy: Start" Jul 23 16:52:34.009126 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.009061 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 16:52:34.009126 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.009077 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 16:52:34.010181 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.010169 2574 policy_none.go:47] "Start" Jul 23 16:52:34.016532 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.016518 2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-250.ec2.internal" not found Jul 23 16:52:34.043584 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.043566 2574 manager.go:337] "Starting Device Plugin manager" Jul 23 16:52:34.043677 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:34.043600 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 16:52:34.043677 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.043614 2574 server.go:87] "Starting device plugin registration server" Jul 23 16:52:34.043879 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.043868 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 16:52:34.043949 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.043881 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 16:52:34.044013 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.043987 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 16:52:34.044132 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.044097 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 16:52:34.044132 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.044110 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 16:52:34.044814 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:34.044671 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 16:52:34.044919 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:34.044840 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-250.ec2.internal\" not found" Jul 23 16:52:34.075376 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.075357 2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-250.ec2.internal" not found Jul 23 16:52:34.103734 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.103649 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 16:52:34.104922 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.104901 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 16:52:34.105028 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.104967 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 16:52:34.105028 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.104992 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 16:52:34.105118 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:34.105096 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 16:52:34.107616 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.107596 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 16:52:34.144920 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.144891 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 16:52:34.145827 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.145809 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientMemory" Jul 23 16:52:34.145910 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.145837 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 16:52:34.145910 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.145848 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientPID" Jul 23 16:52:34.145910 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.145871 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-250.ec2.internal" Jul 23 16:52:34.154706 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.154693 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-250.ec2.internal" Jul 23 16:52:34.154765 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:34.154715 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-250.ec2.internal\": node \"ip-10-0-138-250.ec2.internal\" not found" Jul 23 16:52:34.171772 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:34.171753 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found" Jul 23 16:52:34.205364 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.205336 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal"] Jul 23 16:52:34.205425 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.205400 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 16:52:34.206834 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.206817 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientMemory" Jul 23 16:52:34.206936 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.206846 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 16:52:34.206936 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.206855 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientPID" Jul 23 16:52:34.208155 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.208142 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 16:52:34.208279 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.208264 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal" Jul 23 16:52:34.208337 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.208301 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 16:52:34.208832 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.208819 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientMemory" Jul 23 16:52:34.208881 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.208841 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 16:52:34.208881 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.208842 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientMemory" Jul 23 16:52:34.208881 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.208866 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 16:52:34.208881 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.208875 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientPID" Jul 23 16:52:34.209019 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.208852 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientPID" Jul 23 16:52:34.210179 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.210162 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal" Jul 23 16:52:34.210256 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.210190 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 16:52:34.210861 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.210850 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientMemory" Jul 23 16:52:34.210936 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.210874 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 16:52:34.210936 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.210883 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeHasSufficientPID" Jul 23 16:52:34.232637 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:34.232609 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-250.ec2.internal\" not found" node="ip-10-0-138-250.ec2.internal" Jul 23 16:52:34.236932 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:34.236915 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-250.ec2.internal\" not found" node="ip-10-0-138-250.ec2.internal" Jul 23 16:52:34.272093 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:34.272070 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found" Jul 23 16:52:34.276370 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.276350 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8e16ffff7bbb948ff4e7be6a140cd4b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal\" (UID: \"8e16ffff7bbb948ff4e7be6a140cd4b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal" Jul 23 16:52:34.276469 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.276379 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e16ffff7bbb948ff4e7be6a140cd4b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal\" (UID: \"8e16ffff7bbb948ff4e7be6a140cd4b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal" Jul 23 16:52:34.276469 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.276395 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05ea4021fcfb88e582ecfb9097a979df-config\") pod \"kube-apiserver-proxy-ip-10-0-138-250.ec2.internal\" (UID: \"05ea4021fcfb88e582ecfb9097a979df\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal" Jul 23 16:52:34.372243 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:34.372180 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found" Jul 23 16:52:34.377079 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.377062 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8e16ffff7bbb948ff4e7be6a140cd4b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal\" (UID: \"8e16ffff7bbb948ff4e7be6a140cd4b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal" Jul 23 16:52:34.377127 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.377087 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e16ffff7bbb948ff4e7be6a140cd4b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal\" (UID: \"8e16ffff7bbb948ff4e7be6a140cd4b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal" Jul 23 16:52:34.377127 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.377104 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05ea4021fcfb88e582ecfb9097a979df-config\") pod \"kube-apiserver-proxy-ip-10-0-138-250.ec2.internal\" (UID: \"05ea4021fcfb88e582ecfb9097a979df\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal" Jul 23 16:52:34.377190 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.377166 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8e16ffff7bbb948ff4e7be6a140cd4b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal\" (UID: \"8e16ffff7bbb948ff4e7be6a140cd4b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal" Jul 23 16:52:34.377224 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.377145 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05ea4021fcfb88e582ecfb9097a979df-config\") pod \"kube-apiserver-proxy-ip-10-0-138-250.ec2.internal\" (UID: \"05ea4021fcfb88e582ecfb9097a979df\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal" Jul 23 16:52:34.377224 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.377168 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e16ffff7bbb948ff4e7be6a140cd4b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal\" (UID: \"8e16ffff7bbb948ff4e7be6a140cd4b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal" Jul 23 16:52:34.472869 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:34.472826 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found" Jul 23 16:52:34.535267 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.535226 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal" Jul 23 16:52:34.539746 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.539585 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal" Jul 23 16:52:34.573246 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:34.573217 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found" Jul 23 16:52:34.673816 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:34.673719 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found" Jul 23 16:52:34.774206 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:34.774169 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found" Jul 23 16:52:34.874650 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:34.874613 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found" Jul 23 16:52:34.885049 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.884987 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 16:52:34.885190 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.885171 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 16:52:34.885235 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.885198 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 16:52:34.909286 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.909260 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 16:52:34.965742 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.965666 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 16:47:33 +0000 UTC" deadline="2027-12-31 04:44:29.12752851 +0000 UTC" Jul 23 16:52:34.965742 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:34.965698 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12611h51m54.161833491s" Jul 23 16:52:34.974848 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:34.974823 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found" Jul 23 16:52:35.075264 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:35.075231 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found" Jul 23 16:52:35.175638 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:35.175593 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-250.ec2.internal\" not found" Jul 23 16:52:35.268525 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.268459 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 16:52:35.275318 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.275297 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal" Jul 23 16:52:35.294638 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.294616 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 16:52:35.295482 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.295468 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal" Jul 23 16:52:35.296957 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:35.296924 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ea4021fcfb88e582ecfb9097a979df.slice/crio-4b39306e1cdd8860db8d93fcfcd7f5992288da51909a643b275fa8f8cd905213 WatchSource:0}: Error finding container 4b39306e1cdd8860db8d93fcfcd7f5992288da51909a643b275fa8f8cd905213: Status 404 returned error can't find the container with id 4b39306e1cdd8860db8d93fcfcd7f5992288da51909a643b275fa8f8cd905213 Jul 23 16:52:35.297466 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:35.297446 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e16ffff7bbb948ff4e7be6a140cd4b4.slice/crio-42a83a1298b6babe6f414dd531e75ec6fdd5c913ecf9335270013b8262237eb8 WatchSource:0}: Error finding container 42a83a1298b6babe6f414dd531e75ec6fdd5c913ecf9335270013b8262237eb8: Status 404 returned error can't find the container with id 42a83a1298b6babe6f414dd531e75ec6fdd5c913ecf9335270013b8262237eb8 Jul 23 16:52:35.303721 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.303707 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 16:52:35.315368 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.315352 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 16:52:35.946236 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.946194 2574 apiserver.go:52] "Watching apiserver" Jul 23 16:52:35.954660 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.954635 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 16:52:35.955056 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.955026 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-dk5w9","openshift-multus/multus-qmnnk","openshift-multus/network-metrics-daemon-qzqbk","kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal","openshift-cluster-node-tuning-operator/tuned-kkcbd","openshift-image-registry/node-ca-fqrgt","openshift-network-diagnostics/network-check-target-4sbpm","openshift-network-operator/iptables-alerter-jsbxp","openshift-ovn-kubernetes/ovnkube-node-p4xsg","kube-system/global-pull-secret-syncer-kwpqc","kube-system/konnectivity-agent-nmkrm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk","openshift-dns/node-resolver-f9bh2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal"] Jul 23 16:52:35.956597 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.956550 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:35.956688 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:35.956657 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:52:35.958537 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.958512 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f9bh2" Jul 23 16:52:35.960388 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.960369 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:35.960493 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:35.960447 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:52:35.961112 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.961089 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 16:52:35.961202 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.961139 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d5467\"" Jul 23 16:52:35.961261 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.961089 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 16:52:35.961915 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.961898 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jsbxp" Jul 23 16:52:35.963093 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.963073 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:35.964146 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.964127 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 16:52:35.964256 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.964242 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 16:52:35.964397 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.964378 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 16:52:35.964504 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.964480 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fqrgt" Jul 23 16:52:35.966261 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.966237 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bhqsp\"" Jul 23 16:52:35.966763 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.966743 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.968425 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.967821 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 16:52:35.968425 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.968170 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 16:52:35.968819 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.968494 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 16:52:35.968819 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.968593 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:52:35.968819 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:35.968668 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:52:35.969240 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.969221 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fgk4t\"" Jul 23 16:52:35.970201 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.970180 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 16:52:35.970511 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.970481 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 16:52:35.970582 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.970553 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sdpk4\"" Jul 23 16:52:35.970656 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.970483 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9x7cz\"" Jul 23 16:52:35.970732 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.970709 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 16:52:35.970732 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.970724 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 16:52:35.970890 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.970800 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 16:52:35.970989 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.970971 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qmnnk" Jul 23 16:52:35.971137 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.970974 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 16:52:35.971610 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.971591 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:35.974247 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.972834 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 16:52:35.974247 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.972910 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 16:52:35.974247 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.973574 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 16:52:35.974247 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.973717 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 16:52:35.974533 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.974318 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 16:52:35.974533 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.974343 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qbt2g\"" Jul 23 16:52:35.976636 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.974701 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 16:52:35.976636 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.974817 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 16:52:35.976636 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.974960 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 16:52:35.976636 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.975082 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 16:52:35.976636 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.975170 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 16:52:35.976636 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.976294 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4z2xk\"" Jul 23 16:52:35.978564 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.978544 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nmkrm" Jul 23 16:52:35.979935 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.979909 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:35.982012 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.981982 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 16:52:35.982121 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.982103 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cx2jw\"" Jul 23 16:52:35.982276 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.982257 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 16:52:35.983431 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.983408 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-run-openvswitch\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.983539 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.983444 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/109e3c98-c98e-494b-ad16-f6a7caffa6ea-ovnkube-config\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.983539 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.983479 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn7zj\" (UniqueName: \"kubernetes.io/projected/109e3c98-c98e-494b-ad16-f6a7caffa6ea-kube-api-access-tn7zj\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.983539 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.983505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/631c6c0a-d55a-45ba-9153-a84ed84db311-multus-daemon-config\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:35.983539 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.983534 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-etc-kubernetes\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:35.983722 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.983557 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-systemd-units\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.983722 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.983579 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/109e3c98-c98e-494b-ad16-f6a7caffa6ea-ovn-node-metrics-cert\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.983722 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.983600 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25e64bf5-928d-4675-a1de-cd03bae729c3-host\") pod \"node-ca-fqrgt\" (UID: \"25e64bf5-928d-4675-a1de-cd03bae729c3\") " pod="openshift-image-registry/node-ca-fqrgt" Jul 23 16:52:35.983722 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.983638 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/533e4c7f-7865-43c9-a5d7-8e1426ab19ad-konnectivity-ca\") pod \"konnectivity-agent-nmkrm\" (UID: \"533e4c7f-7865-43c9-a5d7-8e1426ab19ad\") " pod="kube-system/konnectivity-agent-nmkrm" Jul 23 16:52:35.983722 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.983661 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/631c6c0a-d55a-45ba-9153-a84ed84db311-cni-binary-copy\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:35.983722 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.983684 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-host-run-multus-certs\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:35.983960 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.983745 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e494496-9aa7-476c-8bba-1711f19517b3-tmp-dir\") pod \"node-resolver-f9bh2\" (UID: \"9e494496-9aa7-476c-8bba-1711f19517b3\") " pod="openshift-dns/node-resolver-f9bh2" Jul 23 16:52:35.983960 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.983773 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvw7c\" (UniqueName: \"kubernetes.io/projected/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-kube-api-access-xvw7c\") pod \"network-metrics-daemon-qzqbk\" (UID: \"e6fdffd3-cc88-4a7e-91d1-a2e45102fc88\") " pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:35.983960 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.983797 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-etc-sysconfig\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:35.983960 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.983834 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-etc-systemd\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:35.983960 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.983861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8n95\" (UniqueName: \"kubernetes.io/projected/b6696092-1dab-4d36-ae83-856549abf7a2-kube-api-access-b8n95\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:35.983960 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.983888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.983960 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.983919 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25e64bf5-928d-4675-a1de-cd03bae729c3-serviceca\") pod \"node-ca-fqrgt\" (UID: \"25e64bf5-928d-4675-a1de-cd03bae729c3\") " pod="openshift-image-registry/node-ca-fqrgt" Jul 23 16:52:35.983960 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.983955 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e9af723-4871-490b-8739-6f07536c313d-kubelet-config\") pod \"global-pull-secret-syncer-kwpqc\" (UID: \"7e9af723-4871-490b-8739-6f07536c313d\") " pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:35.984368 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984063 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e9af723-4871-490b-8739-6f07536c313d-dbus\") pod \"global-pull-secret-syncer-kwpqc\" (UID: \"7e9af723-4871-490b-8739-6f07536c313d\") " pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:35.984368 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984092 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8hqw\" (UniqueName: \"kubernetes.io/projected/9e494496-9aa7-476c-8bba-1711f19517b3-kube-api-access-h8hqw\") pod \"node-resolver-f9bh2\" (UID: \"9e494496-9aa7-476c-8bba-1711f19517b3\") " pod="openshift-dns/node-resolver-f9bh2" Jul 23 16:52:35.984368 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984115 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs\") pod \"network-metrics-daemon-qzqbk\" (UID: \"e6fdffd3-cc88-4a7e-91d1-a2e45102fc88\") " pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:35.984368 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984137 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-lib-modules\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:35.984368 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984160 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ac875d6-c91e-446a-b99f-a676d029da0f-system-cni-dir\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:35.984368 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984183 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ac875d6-c91e-446a-b99f-a676d029da0f-os-release\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:35.984368 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984207 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-system-cni-dir\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:35.984368 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984231 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e494496-9aa7-476c-8bba-1711f19517b3-hosts-file\") pod \"node-resolver-f9bh2\" (UID: \"9e494496-9aa7-476c-8bba-1711f19517b3\") " pod="openshift-dns/node-resolver-f9bh2" Jul 23 16:52:35.984368 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984252 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-kubelet\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.984368 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984274 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-host-var-lib-cni-bin\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:35.984368 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984312 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-host-var-lib-kubelet\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:35.984368 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984353 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfhfl\" (UniqueName: \"kubernetes.io/projected/631c6c0a-d55a-45ba-9153-a84ed84db311-kube-api-access-nfhfl\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:35.984926 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984396 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-sys\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:35.984926 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984434 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-var-lib-openvswitch\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.984926 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984462 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.984926 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984491 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-cnibin\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:35.984926 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984513 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-hostroot\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:35.984926 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984534 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-host\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:35.984926 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984564 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6696092-1dab-4d36-ae83-856549abf7a2-tmp\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:35.984926 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984595 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ac875d6-c91e-446a-b99f-a676d029da0f-cni-binary-copy\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:35.984926 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984621 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41d0aca9-8760-4a31-8035-4170984c2577-iptables-alerter-script\") pod \"iptables-alerter-jsbxp\" (UID: \"41d0aca9-8760-4a31-8035-4170984c2577\") " pod="openshift-network-operator/iptables-alerter-jsbxp" Jul 23 16:52:35.984926 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984655 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-run-systemd\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.984926 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984697 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-etc-openvswitch\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.984926 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984818 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ac875d6-c91e-446a-b99f-a676d029da0f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:35.984926 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984843 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-host-run-k8s-cni-cncf-io\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:35.984926 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984867 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret\") pod \"global-pull-secret-syncer-kwpqc\" (UID: \"7e9af723-4871-490b-8739-6f07536c313d\") " pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:35.984926 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984919 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-etc-sysctl-conf\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:35.985624 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984965 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-run\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:35.985624 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.984988 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-slash\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.985624 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985049 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-node-log\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.985624 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985071 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-log-socket\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.985624 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985138 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-cni-netd\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.985624 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985174 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mzn2\" (UniqueName: \"kubernetes.io/projected/41d0aca9-8760-4a31-8035-4170984c2577-kube-api-access-5mzn2\") pod \"iptables-alerter-jsbxp\" (UID: \"41d0aca9-8760-4a31-8035-4170984c2577\") " pod="openshift-network-operator/iptables-alerter-jsbxp" Jul 23 16:52:35.985624 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985197 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-etc-sysctl-d\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:35.985624 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985219 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/109e3c98-c98e-494b-ad16-f6a7caffa6ea-ovnkube-script-lib\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.985624 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985241 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jfs6\" (UniqueName: \"kubernetes.io/projected/25e64bf5-928d-4675-a1de-cd03bae729c3-kube-api-access-9jfs6\") pod \"node-ca-fqrgt\" (UID: \"25e64bf5-928d-4675-a1de-cd03bae729c3\") " pod="openshift-image-registry/node-ca-fqrgt" Jul 23 16:52:35.985624 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985264 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvtjw\" (UniqueName: \"kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw\") pod \"network-check-target-4sbpm\" (UID: \"beb54da2-dd72-41f4-a716-4235f9a3559f\") " pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:52:35.985624 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985285 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-etc-kubernetes\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:35.985624 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985401 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ac875d6-c91e-446a-b99f-a676d029da0f-cnibin\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:35.985624 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985433 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-os-release\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:35.985624 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985456 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41d0aca9-8760-4a31-8035-4170984c2577-host-slash\") pod \"iptables-alerter-jsbxp\" (UID: \"41d0aca9-8760-4a31-8035-4170984c2577\") " pod="openshift-network-operator/iptables-alerter-jsbxp" Jul 23 16:52:35.985624 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985478 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-var-lib-kubelet\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:35.985624 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985515 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-run-netns\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.986472 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985537 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-run-ovn\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.986472 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985561 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ac875d6-c91e-446a-b99f-a676d029da0f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:35.986472 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985584 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ac875d6-c91e-446a-b99f-a676d029da0f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:35.986472 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985606 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-multus-cni-dir\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:35.986472 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985630 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-host-run-netns\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:35.986472 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985656 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b6696092-1dab-4d36-ae83-856549abf7a2-etc-tuned\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:35.986472 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985679 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-host-var-lib-cni-multus\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:35.986472 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985703 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-multus-conf-dir\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:35.986472 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985725 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-etc-modprobe-d\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:35.986472 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985764 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-cni-bin\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.986472 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.985798 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/109e3c98-c98e-494b-ad16-f6a7caffa6ea-env-overrides\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:35.986472 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.986037 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbv99\" (UniqueName: \"kubernetes.io/projected/5ac875d6-c91e-446a-b99f-a676d029da0f-kube-api-access-nbv99\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:35.986472 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.986080 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-multus-socket-dir-parent\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:35.986472 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.986106 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/533e4c7f-7865-43c9-a5d7-8e1426ab19ad-agent-certs\") pod \"konnectivity-agent-nmkrm\" (UID: \"533e4c7f-7865-43c9-a5d7-8e1426ab19ad\") " pod="kube-system/konnectivity-agent-nmkrm" Jul 23 16:52:35.986472 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.986124 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 16:52:35.986472 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.986387 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 16:52:35.987200 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.986638 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7f7lj\"" Jul 23 16:52:35.987811 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.987792 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 16:52:35.992200 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:35.992179 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 16:52:36.012571 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.012548 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zdnkx" Jul 23 16:52:36.024163 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.024138 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zdnkx" Jul 23 16:52:36.075768 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.075736 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 16:52:36.086444 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086415 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/109e3c98-c98e-494b-ad16-f6a7caffa6ea-ovn-node-metrics-cert\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.086595 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086453 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25e64bf5-928d-4675-a1de-cd03bae729c3-host\") pod \"node-ca-fqrgt\" (UID: \"25e64bf5-928d-4675-a1de-cd03bae729c3\") " pod="openshift-image-registry/node-ca-fqrgt" Jul 23 16:52:36.086595 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086477 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/533e4c7f-7865-43c9-a5d7-8e1426ab19ad-konnectivity-ca\") pod \"konnectivity-agent-nmkrm\" (UID: \"533e4c7f-7865-43c9-a5d7-8e1426ab19ad\") " pod="kube-system/konnectivity-agent-nmkrm" Jul 23 16:52:36.086595 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086502 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-socket-dir\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.086595 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086524 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/631c6c0a-d55a-45ba-9153-a84ed84db311-cni-binary-copy\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.086595 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086546 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-host-run-multus-certs\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.086595 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086570 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e494496-9aa7-476c-8bba-1711f19517b3-tmp-dir\") pod \"node-resolver-f9bh2\" (UID: \"9e494496-9aa7-476c-8bba-1711f19517b3\") " pod="openshift-dns/node-resolver-f9bh2" Jul 23 16:52:36.086887 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086592 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvw7c\" (UniqueName: \"kubernetes.io/projected/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-kube-api-access-xvw7c\") pod \"network-metrics-daemon-qzqbk\" (UID: \"e6fdffd3-cc88-4a7e-91d1-a2e45102fc88\") " pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:36.086887 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086622 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-etc-sysconfig\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.086887 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086645 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-etc-systemd\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.086887 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086668 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8n95\" (UniqueName: \"kubernetes.io/projected/b6696092-1dab-4d36-ae83-856549abf7a2-kube-api-access-b8n95\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.086887 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086691 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.086887 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086714 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25e64bf5-928d-4675-a1de-cd03bae729c3-serviceca\") pod \"node-ca-fqrgt\" (UID: \"25e64bf5-928d-4675-a1de-cd03bae729c3\") " pod="openshift-image-registry/node-ca-fqrgt" Jul 23 16:52:36.086887 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086739 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e9af723-4871-490b-8739-6f07536c313d-kubelet-config\") pod \"global-pull-secret-syncer-kwpqc\" (UID: \"7e9af723-4871-490b-8739-6f07536c313d\") " pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:36.086887 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086762 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e9af723-4871-490b-8739-6f07536c313d-dbus\") pod \"global-pull-secret-syncer-kwpqc\" (UID: \"7e9af723-4871-490b-8739-6f07536c313d\") " pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:36.086887 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086787 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8hqw\" (UniqueName: \"kubernetes.io/projected/9e494496-9aa7-476c-8bba-1711f19517b3-kube-api-access-h8hqw\") pod \"node-resolver-f9bh2\" (UID: \"9e494496-9aa7-476c-8bba-1711f19517b3\") " pod="openshift-dns/node-resolver-f9bh2" Jul 23 16:52:36.086887 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086811 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs\") pod \"network-metrics-daemon-qzqbk\" (UID: \"e6fdffd3-cc88-4a7e-91d1-a2e45102fc88\") " pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:36.086887 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086837 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-lib-modules\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.086887 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086862 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ac875d6-c91e-446a-b99f-a676d029da0f-system-cni-dir\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:36.086887 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086887 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ac875d6-c91e-446a-b99f-a676d029da0f-os-release\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:36.088768 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086910 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-system-cni-dir\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.088768 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086935 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e494496-9aa7-476c-8bba-1711f19517b3-hosts-file\") pod \"node-resolver-f9bh2\" (UID: \"9e494496-9aa7-476c-8bba-1711f19517b3\") " pod="openshift-dns/node-resolver-f9bh2" Jul 23 16:52:36.088768 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086959 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-kubelet\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.088768 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.086982 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-host-var-lib-cni-bin\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.088768 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087025 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-host-var-lib-kubelet\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.088768 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087049 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfhfl\" (UniqueName: \"kubernetes.io/projected/631c6c0a-d55a-45ba-9153-a84ed84db311-kube-api-access-nfhfl\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.088768 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087075 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-etc-selinux\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.088768 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087106 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-sys\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.088768 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087130 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-var-lib-openvswitch\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.088768 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087158 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.088768 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087187 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-cnibin\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.088768 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087214 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-hostroot\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.088768 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087239 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-device-dir\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.088768 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbc7d\" (UniqueName: \"kubernetes.io/projected/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-kube-api-access-qbc7d\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.088768 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087304 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-host\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.088768 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087327 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6696092-1dab-4d36-ae83-856549abf7a2-tmp\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.088768 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087351 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ac875d6-c91e-446a-b99f-a676d029da0f-cni-binary-copy\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:36.089643 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087375 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41d0aca9-8760-4a31-8035-4170984c2577-iptables-alerter-script\") pod \"iptables-alerter-jsbxp\" (UID: \"41d0aca9-8760-4a31-8035-4170984c2577\") " pod="openshift-network-operator/iptables-alerter-jsbxp" Jul 23 16:52:36.089643 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087398 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-run-systemd\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.089643 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087423 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-etc-openvswitch\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.089643 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087446 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ac875d6-c91e-446a-b99f-a676d029da0f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:36.089643 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087469 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-host-run-k8s-cni-cncf-io\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.089643 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087495 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret\") pod \"global-pull-secret-syncer-kwpqc\" (UID: \"7e9af723-4871-490b-8739-6f07536c313d\") " pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:36.089643 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087518 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-etc-sysctl-conf\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.089643 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087540 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-run\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.089643 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087568 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-slash\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.089643 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087592 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-node-log\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.089643 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-log-socket\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.089643 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087640 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-cni-netd\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.089643 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087667 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mzn2\" (UniqueName: \"kubernetes.io/projected/41d0aca9-8760-4a31-8035-4170984c2577-kube-api-access-5mzn2\") pod \"iptables-alerter-jsbxp\" (UID: \"41d0aca9-8760-4a31-8035-4170984c2577\") " pod="openshift-network-operator/iptables-alerter-jsbxp" Jul 23 16:52:36.089643 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087691 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-etc-sysctl-d\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.089643 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087714 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/109e3c98-c98e-494b-ad16-f6a7caffa6ea-ovnkube-script-lib\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.089643 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087738 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jfs6\" (UniqueName: \"kubernetes.io/projected/25e64bf5-928d-4675-a1de-cd03bae729c3-kube-api-access-9jfs6\") pod \"node-ca-fqrgt\" (UID: \"25e64bf5-928d-4675-a1de-cd03bae729c3\") " pod="openshift-image-registry/node-ca-fqrgt" Jul 23 16:52:36.089643 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087766 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvtjw\" (UniqueName: \"kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw\") pod \"network-check-target-4sbpm\" (UID: \"beb54da2-dd72-41f4-a716-4235f9a3559f\") " pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:52:36.090460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087790 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-etc-kubernetes\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.090460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087814 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-registration-dir\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.090460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087840 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ac875d6-c91e-446a-b99f-a676d029da0f-cnibin\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:36.090460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087864 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-sys-fs\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.090460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087889 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-os-release\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.090460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087911 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41d0aca9-8760-4a31-8035-4170984c2577-host-slash\") pod \"iptables-alerter-jsbxp\" (UID: \"41d0aca9-8760-4a31-8035-4170984c2577\") " pod="openshift-network-operator/iptables-alerter-jsbxp" Jul 23 16:52:36.090460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087934 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-var-lib-kubelet\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.090460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087956 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-run-netns\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.090460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.087980 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-run-ovn\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.090460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088019 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.090460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088023 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ac875d6-c91e-446a-b99f-a676d029da0f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:36.090460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088071 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ac875d6-c91e-446a-b99f-a676d029da0f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:36.090460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088098 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-multus-cni-dir\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.090460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088121 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-host-run-netns\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.090460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088146 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b6696092-1dab-4d36-ae83-856549abf7a2-etc-tuned\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.090460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088170 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-host-var-lib-cni-multus\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.090460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088204 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-multus-conf-dir\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.091299 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088231 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-etc-modprobe-d\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.091299 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088253 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-cnibin\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.091299 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088266 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-cni-bin\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.091299 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088291 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/109e3c98-c98e-494b-ad16-f6a7caffa6ea-env-overrides\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.091299 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088318 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbv99\" (UniqueName: \"kubernetes.io/projected/5ac875d6-c91e-446a-b99f-a676d029da0f-kube-api-access-nbv99\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:36.091299 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088346 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-host\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.091299 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088367 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-multus-socket-dir-parent\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.091299 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088392 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/533e4c7f-7865-43c9-a5d7-8e1426ab19ad-agent-certs\") pod \"konnectivity-agent-nmkrm\" (UID: \"533e4c7f-7865-43c9-a5d7-8e1426ab19ad\") " pod="kube-system/konnectivity-agent-nmkrm" Jul 23 16:52:36.091299 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088425 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.091299 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088454 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-run-openvswitch\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.091299 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088480 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/109e3c98-c98e-494b-ad16-f6a7caffa6ea-ovnkube-config\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.091299 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088507 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn7zj\" (UniqueName: \"kubernetes.io/projected/109e3c98-c98e-494b-ad16-f6a7caffa6ea-kube-api-access-tn7zj\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.091299 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088534 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/631c6c0a-d55a-45ba-9153-a84ed84db311-multus-daemon-config\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.091299 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088560 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-etc-kubernetes\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.091299 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088585 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-systemd-units\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.091299 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088682 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-systemd-units\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.091299 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088679 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 16:52:36.091299 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.089221 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ac875d6-c91e-446a-b99f-a676d029da0f-cni-binary-copy\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:36.092157 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.089532 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-etc-kubernetes\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.092157 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.089586 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ac875d6-c91e-446a-b99f-a676d029da0f-cnibin\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:36.092157 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.089648 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-os-release\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.092157 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.089680 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41d0aca9-8760-4a31-8035-4170984c2577-host-slash\") pod \"iptables-alerter-jsbxp\" (UID: \"41d0aca9-8760-4a31-8035-4170984c2577\") " pod="openshift-network-operator/iptables-alerter-jsbxp" Jul 23 16:52:36.092157 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.089697 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-etc-sysctl-conf\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.092157 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.089720 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-var-lib-kubelet\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.092157 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.089704 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25e64bf5-928d-4675-a1de-cd03bae729c3-host\") pod \"node-ca-fqrgt\" (UID: \"25e64bf5-928d-4675-a1de-cd03bae729c3\") " pod="openshift-image-registry/node-ca-fqrgt" Jul 23 16:52:36.092157 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.089823 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-run\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.092157 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.089868 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-slash\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.092157 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.089902 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-node-log\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.092157 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.089936 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-log-socket\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.092157 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.089954 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/109e3c98-c98e-494b-ad16-f6a7caffa6ea-ovnkube-script-lib\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.092157 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.089969 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-cni-netd\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.092157 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.090067 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-etc-sysctl-d\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.092157 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:36.090139 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 16:52:36.092157 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:36.090243 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret podName:7e9af723-4871-490b-8739-6f07536c313d nodeName:}" failed. No retries permitted until 2026-07-23 16:52:36.590199537 +0000 UTC m=+3.064014924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret") pod "global-pull-secret-syncer-kwpqc" (UID: "7e9af723-4871-490b-8739-6f07536c313d") : object "kube-system"/"original-pull-secret" not registered Jul 23 16:52:36.092157 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.090261 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/533e4c7f-7865-43c9-a5d7-8e1426ab19ad-konnectivity-ca\") pod \"konnectivity-agent-nmkrm\" (UID: \"533e4c7f-7865-43c9-a5d7-8e1426ab19ad\") " pod="kube-system/konnectivity-agent-nmkrm" Jul 23 16:52:36.092157 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.090298 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/631c6c0a-d55a-45ba-9153-a84ed84db311-cni-binary-copy\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.093034 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.090328 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-run-netns\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.093034 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.090358 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-host-run-multus-certs\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.093034 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.090372 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-run-ovn\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.093034 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.090492 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-sys\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.093034 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.090566 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41d0aca9-8760-4a31-8035-4170984c2577-iptables-alerter-script\") pod \"iptables-alerter-jsbxp\" (UID: \"41d0aca9-8760-4a31-8035-4170984c2577\") " pod="openshift-network-operator/iptables-alerter-jsbxp" Jul 23 16:52:36.093034 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.090944 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-var-lib-openvswitch\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.093034 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.091070 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-etc-sysconfig\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.093034 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.091257 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-run-systemd\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.093034 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.091321 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-etc-openvswitch\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.093034 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.091545 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ac875d6-c91e-446a-b99f-a676d029da0f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:36.093034 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.091667 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-multus-cni-dir\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.093034 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.091724 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-host-run-netns\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.093034 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.091961 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e494496-9aa7-476c-8bba-1711f19517b3-tmp-dir\") pod \"node-resolver-f9bh2\" (UID: \"9e494496-9aa7-476c-8bba-1711f19517b3\") " pod="openshift-dns/node-resolver-f9bh2" Jul 23 16:52:36.093034 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.092082 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-host-run-k8s-cni-cncf-io\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.093034 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.092193 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-lib-modules\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.093034 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.092270 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-etc-systemd\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.093034 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.092374 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-host-var-lib-cni-multus\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.093034 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.092442 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-multus-conf-dir\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.093897 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.088205 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ac875d6-c91e-446a-b99f-a676d029da0f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:36.093897 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.092527 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.093897 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.092551 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-etc-modprobe-d\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.093897 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:36.092654 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 16:52:36.093897 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:36.092709 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs podName:e6fdffd3-cc88-4a7e-91d1-a2e45102fc88 nodeName:}" failed. No retries permitted until 2026-07-23 16:52:36.592692713 +0000 UTC m=+3.066508078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs") pod "network-metrics-daemon-qzqbk" (UID: "e6fdffd3-cc88-4a7e-91d1-a2e45102fc88") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 16:52:36.093897 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.092744 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6696092-1dab-4d36-ae83-856549abf7a2-tmp\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.093897 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.092763 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-kubelet\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.093897 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.092820 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-hostroot\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.093897 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.092843 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ac875d6-c91e-446a-b99f-a676d029da0f-os-release\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:36.093897 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.092884 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e9af723-4871-490b-8739-6f07536c313d-dbus\") pod \"global-pull-secret-syncer-kwpqc\" (UID: \"7e9af723-4871-490b-8739-6f07536c313d\") " pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:36.093897 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.092909 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-system-cni-dir\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.093897 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.092966 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e494496-9aa7-476c-8bba-1711f19517b3-hosts-file\") pod \"node-resolver-f9bh2\" (UID: \"9e494496-9aa7-476c-8bba-1711f19517b3\") " pod="openshift-dns/node-resolver-f9bh2" Jul 23 16:52:36.093897 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.093024 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ac875d6-c91e-446a-b99f-a676d029da0f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:36.093897 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.093034 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-host-var-lib-kubelet\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.093897 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.093110 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-host-var-lib-cni-bin\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.093897 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.093185 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-run-openvswitch\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.093897 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.093276 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/631c6c0a-d55a-45ba-9153-a84ed84db311-multus-socket-dir-parent\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.094734 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.093323 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/109e3c98-c98e-494b-ad16-f6a7caffa6ea-host-cni-bin\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.094734 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.093369 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ac875d6-c91e-446a-b99f-a676d029da0f-system-cni-dir\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:36.094734 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.093443 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/109e3c98-c98e-494b-ad16-f6a7caffa6ea-env-overrides\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.094734 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.093721 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e9af723-4871-490b-8739-6f07536c313d-kubelet-config\") pod \"global-pull-secret-syncer-kwpqc\" (UID: \"7e9af723-4871-490b-8739-6f07536c313d\") " pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:36.094734 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.093817 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b6696092-1dab-4d36-ae83-856549abf7a2-etc-tuned\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.094734 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.093901 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6696092-1dab-4d36-ae83-856549abf7a2-etc-kubernetes\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.094734 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.094131 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/109e3c98-c98e-494b-ad16-f6a7caffa6ea-ovnkube-config\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.094734 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.094289 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/631c6c0a-d55a-45ba-9153-a84ed84db311-multus-daemon-config\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.095698 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.095671 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/109e3c98-c98e-494b-ad16-f6a7caffa6ea-ovn-node-metrics-cert\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.096766 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.096745 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25e64bf5-928d-4675-a1de-cd03bae729c3-serviceca\") pod \"node-ca-fqrgt\" (UID: \"25e64bf5-928d-4675-a1de-cd03bae729c3\") " pod="openshift-image-registry/node-ca-fqrgt" Jul 23 16:52:36.097558 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.097538 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/533e4c7f-7865-43c9-a5d7-8e1426ab19ad-agent-certs\") pod \"konnectivity-agent-nmkrm\" (UID: \"533e4c7f-7865-43c9-a5d7-8e1426ab19ad\") " pod="kube-system/konnectivity-agent-nmkrm" Jul 23 16:52:36.101917 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.101895 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mzn2\" (UniqueName: \"kubernetes.io/projected/41d0aca9-8760-4a31-8035-4170984c2577-kube-api-access-5mzn2\") pod \"iptables-alerter-jsbxp\" (UID: \"41d0aca9-8760-4a31-8035-4170984c2577\") " pod="openshift-network-operator/iptables-alerter-jsbxp" Jul 23 16:52:36.106390 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:36.105462 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 16:52:36.106390 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:36.105485 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 16:52:36.106390 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:36.105500 2574 projected.go:196] Error preparing data for projected volume kube-api-access-jvtjw for pod openshift-network-diagnostics/network-check-target-4sbpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 16:52:36.106390 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:36.105559 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw podName:beb54da2-dd72-41f4-a716-4235f9a3559f nodeName:}" failed. No retries permitted until 2026-07-23 16:52:36.605540987 +0000 UTC m=+3.079356365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jvtjw" (UniqueName: "kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw") pod "network-check-target-4sbpm" (UID: "beb54da2-dd72-41f4-a716-4235f9a3559f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 16:52:36.108822 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.107447 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn7zj\" (UniqueName: \"kubernetes.io/projected/109e3c98-c98e-494b-ad16-f6a7caffa6ea-kube-api-access-tn7zj\") pod \"ovnkube-node-p4xsg\" (UID: \"109e3c98-c98e-494b-ad16-f6a7caffa6ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.108822 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.107625 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfhfl\" (UniqueName: \"kubernetes.io/projected/631c6c0a-d55a-45ba-9153-a84ed84db311-kube-api-access-nfhfl\") pod \"multus-qmnnk\" (UID: \"631c6c0a-d55a-45ba-9153-a84ed84db311\") " pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.108822 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.108014 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8n95\" (UniqueName: \"kubernetes.io/projected/b6696092-1dab-4d36-ae83-856549abf7a2-kube-api-access-b8n95\") pod \"tuned-kkcbd\" (UID: \"b6696092-1dab-4d36-ae83-856549abf7a2\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.108822 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.108671 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvw7c\" (UniqueName: \"kubernetes.io/projected/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-kube-api-access-xvw7c\") pod \"network-metrics-daemon-qzqbk\" (UID: \"e6fdffd3-cc88-4a7e-91d1-a2e45102fc88\") " pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:36.109341 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.109292 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbv99\" (UniqueName: \"kubernetes.io/projected/5ac875d6-c91e-446a-b99f-a676d029da0f-kube-api-access-nbv99\") pod \"multus-additional-cni-plugins-dk5w9\" (UID: \"5ac875d6-c91e-446a-b99f-a676d029da0f\") " pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:36.109749 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.109621 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jfs6\" (UniqueName: \"kubernetes.io/projected/25e64bf5-928d-4675-a1de-cd03bae729c3-kube-api-access-9jfs6\") pod \"node-ca-fqrgt\" (UID: \"25e64bf5-928d-4675-a1de-cd03bae729c3\") " pod="openshift-image-registry/node-ca-fqrgt" Jul 23 16:52:36.110387 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.110222 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8hqw\" (UniqueName: \"kubernetes.io/projected/9e494496-9aa7-476c-8bba-1711f19517b3-kube-api-access-h8hqw\") pod \"node-resolver-f9bh2\" (UID: \"9e494496-9aa7-476c-8bba-1711f19517b3\") " pod="openshift-dns/node-resolver-f9bh2" Jul 23 16:52:36.111213 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.111151 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal" event={"ID":"05ea4021fcfb88e582ecfb9097a979df","Type":"ContainerStarted","Data":"4b39306e1cdd8860db8d93fcfcd7f5992288da51909a643b275fa8f8cd905213"} Jul 23 16:52:36.112450 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.112425 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal" event={"ID":"8e16ffff7bbb948ff4e7be6a140cd4b4","Type":"ContainerStarted","Data":"42a83a1298b6babe6f414dd531e75ec6fdd5c913ecf9335270013b8262237eb8"} Jul 23 16:52:36.189488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.189454 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.189488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.189491 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-socket-dir\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.189716 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.189543 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-etc-selinux\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.189716 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.189573 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-device-dir\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.189716 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.189598 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbc7d\" (UniqueName: \"kubernetes.io/projected/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-kube-api-access-qbc7d\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.189716 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.189655 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-registration-dir\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.189716 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.189680 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-sys-fs\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.189967 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.189777 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-sys-fs\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.189967 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.189819 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.189967 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.189920 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-socket-dir\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.190131 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.189956 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-device-dir\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.190131 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.190108 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-etc-selinux\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.190131 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.190121 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-registration-dir\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.199365 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.199294 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbc7d\" (UniqueName: \"kubernetes.io/projected/6d82d07e-b8fa-43b0-bf51-674e841b1d1c-kube-api-access-qbc7d\") pod \"aws-ebs-csi-driver-node-m4spk\" (UID: \"6d82d07e-b8fa-43b0-bf51-674e841b1d1c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.273423 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.273391 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f9bh2" Jul 23 16:52:36.281701 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.281676 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jsbxp" Jul 23 16:52:36.284287 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:36.284257 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e494496_9aa7_476c_8bba_1711f19517b3.slice/crio-b9980a3273d1315739f3d8b426a95525bc93af47186119ec7cbe0545a63ca475 WatchSource:0}: Error finding container b9980a3273d1315739f3d8b426a95525bc93af47186119ec7cbe0545a63ca475: Status 404 returned error can't find the container with id b9980a3273d1315739f3d8b426a95525bc93af47186119ec7cbe0545a63ca475 Jul 23 16:52:36.291039 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:36.290860 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41d0aca9_8760_4a31_8035_4170984c2577.slice/crio-e36f907a55d87b4178e1d60e436bad3b4c8d9f6046c908f34d5adb87ff9f1f7d WatchSource:0}: Error finding container e36f907a55d87b4178e1d60e436bad3b4c8d9f6046c908f34d5adb87ff9f1f7d: Status 404 returned error can't find the container with id e36f907a55d87b4178e1d60e436bad3b4c8d9f6046c908f34d5adb87ff9f1f7d Jul 23 16:52:36.292203 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.291970 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" Jul 23 16:52:36.297697 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.297675 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fqrgt" Jul 23 16:52:36.300537 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:36.300502 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6696092_1dab_4d36_ae83_856549abf7a2.slice/crio-444b444b4ce1beb6ce0035127b640b8083d27c5776bd1723a5c0db9b6d38ab7d WatchSource:0}: Error finding container 444b444b4ce1beb6ce0035127b640b8083d27c5776bd1723a5c0db9b6d38ab7d: Status 404 returned error can't find the container with id 444b444b4ce1beb6ce0035127b640b8083d27c5776bd1723a5c0db9b6d38ab7d Jul 23 16:52:36.305808 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.305785 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:52:36.306109 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:36.306080 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25e64bf5_928d_4675_a1de_cd03bae729c3.slice/crio-2d70467b77f148deef3d6de08ae1bb4e9ebf3f9c380f6832e43fbf407c1f4a93 WatchSource:0}: Error finding container 2d70467b77f148deef3d6de08ae1bb4e9ebf3f9c380f6832e43fbf407c1f4a93: Status 404 returned error can't find the container with id 2d70467b77f148deef3d6de08ae1bb4e9ebf3f9c380f6832e43fbf407c1f4a93 Jul 23 16:52:36.315094 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.315073 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qmnnk" Jul 23 16:52:36.315531 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:36.315375 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod109e3c98_c98e_494b_ad16_f6a7caffa6ea.slice/crio-f902e5ad1614679e82075225c276ffa9df28e8410ec134ce1ea9145a3165cbef WatchSource:0}: Error finding container f902e5ad1614679e82075225c276ffa9df28e8410ec134ce1ea9145a3165cbef: Status 404 returned error can't find the container with id f902e5ad1614679e82075225c276ffa9df28e8410ec134ce1ea9145a3165cbef Jul 23 16:52:36.321244 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.321167 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dk5w9" Jul 23 16:52:36.324883 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:36.324843 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod631c6c0a_d55a_45ba_9153_a84ed84db311.slice/crio-c3c64d7d256766b086338eb2e434ee61830a73a6f70915424f57fc6b246b2c81 WatchSource:0}: Error finding container c3c64d7d256766b086338eb2e434ee61830a73a6f70915424f57fc6b246b2c81: Status 404 returned error can't find the container with id c3c64d7d256766b086338eb2e434ee61830a73a6f70915424f57fc6b246b2c81 Jul 23 16:52:36.328926 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.328821 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nmkrm" Jul 23 16:52:36.330980 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:36.330955 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac875d6_c91e_446a_b99f_a676d029da0f.slice/crio-49f91706cbe86eff733e96a4ff533721e9bfddaade83e3b927a475caadd45a00 WatchSource:0}: Error finding container 49f91706cbe86eff733e96a4ff533721e9bfddaade83e3b927a475caadd45a00: Status 404 returned error can't find the container with id 49f91706cbe86eff733e96a4ff533721e9bfddaade83e3b927a475caadd45a00 Jul 23 16:52:36.336632 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.336608 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" Jul 23 16:52:36.339569 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:36.339539 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod533e4c7f_7865_43c9_a5d7_8e1426ab19ad.slice/crio-eb3b3391d4bfeb562ccab67b440c25edf86eea9151b7b0f4804d498410de9a2c WatchSource:0}: Error finding container eb3b3391d4bfeb562ccab67b440c25edf86eea9151b7b0f4804d498410de9a2c: Status 404 returned error can't find the container with id eb3b3391d4bfeb562ccab67b440c25edf86eea9151b7b0f4804d498410de9a2c Jul 23 16:52:36.346378 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:52:36.346350 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d82d07e_b8fa_43b0_bf51_674e841b1d1c.slice/crio-36df8e6a6eb4e956e6e0fe6c9b7b37ae6e49293f06def945d6f7ac0ec2345223 WatchSource:0}: Error finding container 36df8e6a6eb4e956e6e0fe6c9b7b37ae6e49293f06def945d6f7ac0ec2345223: Status 404 returned error can't find the container with id 36df8e6a6eb4e956e6e0fe6c9b7b37ae6e49293f06def945d6f7ac0ec2345223 Jul 23 16:52:36.382039 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.381982 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 16:52:36.592640 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.592516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret\") pod \"global-pull-secret-syncer-kwpqc\" (UID: \"7e9af723-4871-490b-8739-6f07536c313d\") " pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:36.592787 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:36.592674 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 16:52:36.592787 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:36.592751 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret podName:7e9af723-4871-490b-8739-6f07536c313d nodeName:}" failed. No retries permitted until 2026-07-23 16:52:37.592730225 +0000 UTC m=+4.066545608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret") pod "global-pull-secret-syncer-kwpqc" (UID: "7e9af723-4871-490b-8739-6f07536c313d") : object "kube-system"/"original-pull-secret" not registered Jul 23 16:52:36.693240 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.693202 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvtjw\" (UniqueName: \"kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw\") pod \"network-check-target-4sbpm\" (UID: \"beb54da2-dd72-41f4-a716-4235f9a3559f\") " pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:52:36.693402 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:36.693273 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs\") pod \"network-metrics-daemon-qzqbk\" (UID: \"e6fdffd3-cc88-4a7e-91d1-a2e45102fc88\") " pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:36.693402 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:36.693379 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 16:52:36.693488 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:36.693396 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 16:52:36.693488 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:36.693419 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 16:52:36.693488 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:36.693430 2574 projected.go:196] Error preparing data for projected volume kube-api-access-jvtjw for pod openshift-network-diagnostics/network-check-target-4sbpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 16:52:36.693488 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:36.693440 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs podName:e6fdffd3-cc88-4a7e-91d1-a2e45102fc88 nodeName:}" failed. No retries permitted until 2026-07-23 16:52:37.693423333 +0000 UTC m=+4.167238715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs") pod "network-metrics-daemon-qzqbk" (UID: "e6fdffd3-cc88-4a7e-91d1-a2e45102fc88") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 16:52:36.693488 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:36.693481 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw podName:beb54da2-dd72-41f4-a716-4235f9a3559f nodeName:}" failed. No retries permitted until 2026-07-23 16:52:37.693468682 +0000 UTC m=+4.167284042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jvtjw" (UniqueName: "kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw") pod "network-check-target-4sbpm" (UID: "beb54da2-dd72-41f4-a716-4235f9a3559f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 16:52:37.027072 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:37.026887 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 16:47:36 +0000 UTC" deadline="2027-12-28 18:31:29.774801551 +0000 UTC" Jul 23 16:52:37.027072 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:37.026951 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12553h38m52.74785571s" Jul 23 16:52:37.106469 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:37.105957 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:37.106469 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:37.106111 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:52:37.116891 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:37.116856 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fqrgt" event={"ID":"25e64bf5-928d-4675-a1de-cd03bae729c3","Type":"ContainerStarted","Data":"2d70467b77f148deef3d6de08ae1bb4e9ebf3f9c380f6832e43fbf407c1f4a93"} Jul 23 16:52:37.119020 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:37.118981 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jsbxp" event={"ID":"41d0aca9-8760-4a31-8035-4170984c2577","Type":"ContainerStarted","Data":"e36f907a55d87b4178e1d60e436bad3b4c8d9f6046c908f34d5adb87ff9f1f7d"} Jul 23 16:52:37.121824 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:37.121799 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" event={"ID":"6d82d07e-b8fa-43b0-bf51-674e841b1d1c","Type":"ContainerStarted","Data":"36df8e6a6eb4e956e6e0fe6c9b7b37ae6e49293f06def945d6f7ac0ec2345223"} Jul 23 16:52:37.124268 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:37.124243 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dk5w9" event={"ID":"5ac875d6-c91e-446a-b99f-a676d029da0f","Type":"ContainerStarted","Data":"49f91706cbe86eff733e96a4ff533721e9bfddaade83e3b927a475caadd45a00"} Jul 23 16:52:37.125543 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:37.125518 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" event={"ID":"b6696092-1dab-4d36-ae83-856549abf7a2","Type":"ContainerStarted","Data":"444b444b4ce1beb6ce0035127b640b8083d27c5776bd1723a5c0db9b6d38ab7d"} Jul 23 16:52:37.126941 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:37.126915 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f9bh2" event={"ID":"9e494496-9aa7-476c-8bba-1711f19517b3","Type":"ContainerStarted","Data":"b9980a3273d1315739f3d8b426a95525bc93af47186119ec7cbe0545a63ca475"} Jul 23 16:52:37.128585 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:37.128563 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nmkrm" event={"ID":"533e4c7f-7865-43c9-a5d7-8e1426ab19ad","Type":"ContainerStarted","Data":"eb3b3391d4bfeb562ccab67b440c25edf86eea9151b7b0f4804d498410de9a2c"} Jul 23 16:52:37.130129 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:37.130103 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qmnnk" event={"ID":"631c6c0a-d55a-45ba-9153-a84ed84db311","Type":"ContainerStarted","Data":"c3c64d7d256766b086338eb2e434ee61830a73a6f70915424f57fc6b246b2c81"} Jul 23 16:52:37.131978 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:37.131955 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" event={"ID":"109e3c98-c98e-494b-ad16-f6a7caffa6ea","Type":"ContainerStarted","Data":"f902e5ad1614679e82075225c276ffa9df28e8410ec134ce1ea9145a3165cbef"} Jul 23 16:52:37.600703 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:37.600627 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret\") pod \"global-pull-secret-syncer-kwpqc\" (UID: \"7e9af723-4871-490b-8739-6f07536c313d\") " pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:37.600886 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:37.600798 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 16:52:37.600886 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:37.600868 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret podName:7e9af723-4871-490b-8739-6f07536c313d nodeName:}" failed. No retries permitted until 2026-07-23 16:52:39.600847796 +0000 UTC m=+6.074663156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret") pod "global-pull-secret-syncer-kwpqc" (UID: "7e9af723-4871-490b-8739-6f07536c313d") : object "kube-system"/"original-pull-secret" not registered Jul 23 16:52:37.701981 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:37.701941 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvtjw\" (UniqueName: \"kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw\") pod \"network-check-target-4sbpm\" (UID: \"beb54da2-dd72-41f4-a716-4235f9a3559f\") " pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:52:37.702167 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:37.702030 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs\") pod \"network-metrics-daemon-qzqbk\" (UID: \"e6fdffd3-cc88-4a7e-91d1-a2e45102fc88\") " pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:37.702167 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:37.702153 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 16:52:37.702290 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:37.702240 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs podName:e6fdffd3-cc88-4a7e-91d1-a2e45102fc88 nodeName:}" failed. No retries permitted until 2026-07-23 16:52:39.702221245 +0000 UTC m=+6.176036607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs") pod "network-metrics-daemon-qzqbk" (UID: "e6fdffd3-cc88-4a7e-91d1-a2e45102fc88") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 16:52:37.702658 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:37.702636 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 16:52:37.702743 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:37.702666 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 16:52:37.702743 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:37.702678 2574 projected.go:196] Error preparing data for projected volume kube-api-access-jvtjw for pod openshift-network-diagnostics/network-check-target-4sbpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 16:52:37.702743 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:37.702724 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw podName:beb54da2-dd72-41f4-a716-4235f9a3559f nodeName:}" failed. No retries permitted until 2026-07-23 16:52:39.702707047 +0000 UTC m=+6.176522412 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jvtjw" (UniqueName: "kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw") pod "network-check-target-4sbpm" (UID: "beb54da2-dd72-41f4-a716-4235f9a3559f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 16:52:38.028930 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:38.028882 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 16:47:36 +0000 UTC" deadline="2028-04-12 01:05:44.987440722 +0000 UTC" Jul 23 16:52:38.028930 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:38.028926 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15080h13m6.958518958s" Jul 23 16:52:38.108822 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:38.108157 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:38.108822 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:38.108293 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:52:38.108822 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:38.108680 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:52:38.108822 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:38.108763 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:52:39.105817 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:39.105783 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:39.106324 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:39.105927 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:52:39.621451 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:39.621313 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret\") pod \"global-pull-secret-syncer-kwpqc\" (UID: \"7e9af723-4871-490b-8739-6f07536c313d\") " pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:39.621658 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:39.621482 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 16:52:39.621658 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:39.621565 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret podName:7e9af723-4871-490b-8739-6f07536c313d nodeName:}" failed. No retries permitted until 2026-07-23 16:52:43.621543867 +0000 UTC m=+10.095359230 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret") pod "global-pull-secret-syncer-kwpqc" (UID: "7e9af723-4871-490b-8739-6f07536c313d") : object "kube-system"/"original-pull-secret" not registered Jul 23 16:52:39.722155 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:39.722117 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs\") pod \"network-metrics-daemon-qzqbk\" (UID: \"e6fdffd3-cc88-4a7e-91d1-a2e45102fc88\") " pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:39.722316 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:39.722199 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvtjw\" (UniqueName: \"kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw\") pod \"network-check-target-4sbpm\" (UID: \"beb54da2-dd72-41f4-a716-4235f9a3559f\") " pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:52:39.722389 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:39.722348 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 16:52:39.722389 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:39.722369 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 16:52:39.722389 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:39.722381 2574 projected.go:196] Error preparing data for projected volume kube-api-access-jvtjw for pod openshift-network-diagnostics/network-check-target-4sbpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 16:52:39.722522 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:39.722436 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw podName:beb54da2-dd72-41f4-a716-4235f9a3559f nodeName:}" failed. No retries permitted until 2026-07-23 16:52:43.72241766 +0000 UTC m=+10.196233035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jvtjw" (UniqueName: "kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw") pod "network-check-target-4sbpm" (UID: "beb54da2-dd72-41f4-a716-4235f9a3559f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 16:52:39.722853 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:39.722831 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 16:52:39.722952 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:39.722888 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs podName:e6fdffd3-cc88-4a7e-91d1-a2e45102fc88 nodeName:}" failed. No retries permitted until 2026-07-23 16:52:43.722874542 +0000 UTC m=+10.196689915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs") pod "network-metrics-daemon-qzqbk" (UID: "e6fdffd3-cc88-4a7e-91d1-a2e45102fc88") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 16:52:40.105830 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:40.105748 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:40.106380 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:40.105884 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:52:40.106380 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:40.106257 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:52:40.106380 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:40.106342 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:52:41.106820 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:41.106308 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:41.106820 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:41.106446 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:52:42.106048 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:42.105954 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:52:42.106198 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:42.106093 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:52:42.106198 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:42.106124 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:42.106316 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:42.106241 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:52:43.106488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:43.105985 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:43.106488 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:43.106133 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:52:43.656702 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:43.656567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret\") pod \"global-pull-secret-syncer-kwpqc\" (UID: \"7e9af723-4871-490b-8739-6f07536c313d\") " pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:43.656891 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:43.656754 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 16:52:43.656891 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:43.656833 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret podName:7e9af723-4871-490b-8739-6f07536c313d nodeName:}" failed. No retries permitted until 2026-07-23 16:52:51.656811344 +0000 UTC m=+18.130626706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret") pod "global-pull-secret-syncer-kwpqc" (UID: "7e9af723-4871-490b-8739-6f07536c313d") : object "kube-system"/"original-pull-secret" not registered Jul 23 16:52:43.757293 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:43.757250 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs\") pod \"network-metrics-daemon-qzqbk\" (UID: \"e6fdffd3-cc88-4a7e-91d1-a2e45102fc88\") " pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:43.757477 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:43.757328 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvtjw\" (UniqueName: \"kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw\") pod \"network-check-target-4sbpm\" (UID: \"beb54da2-dd72-41f4-a716-4235f9a3559f\") " pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:52:43.757477 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:43.757369 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 16:52:43.757477 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:43.757449 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs podName:e6fdffd3-cc88-4a7e-91d1-a2e45102fc88 nodeName:}" failed. No retries permitted until 2026-07-23 16:52:51.757429081 +0000 UTC m=+18.231244455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs") pod "network-metrics-daemon-qzqbk" (UID: "e6fdffd3-cc88-4a7e-91d1-a2e45102fc88") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 16:52:43.757477 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:43.757456 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 16:52:43.757477 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:43.757473 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 16:52:43.757727 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:43.757487 2574 projected.go:196] Error preparing data for projected volume kube-api-access-jvtjw for pod openshift-network-diagnostics/network-check-target-4sbpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 16:52:43.757727 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:43.757535 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw podName:beb54da2-dd72-41f4-a716-4235f9a3559f nodeName:}" failed. No retries permitted until 2026-07-23 16:52:51.757520279 +0000 UTC m=+18.231335656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jvtjw" (UniqueName: "kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw") pod "network-check-target-4sbpm" (UID: "beb54da2-dd72-41f4-a716-4235f9a3559f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 16:52:44.107729 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:44.107065 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:44.107729 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:44.107186 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:52:44.107729 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:44.107540 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:52:44.107729 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:44.107633 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:52:45.105938 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:45.105896 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:45.106206 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:45.106046 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:52:46.106133 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:46.106095 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:46.106537 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:46.106095 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:52:46.106537 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:46.106240 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:52:46.106537 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:46.106263 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:52:47.106046 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:47.105957 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:47.106196 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:47.106094 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:52:48.106097 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:48.106061 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:48.106298 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:48.106107 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:52:48.106298 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:48.106207 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:52:48.106720 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:48.106342 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:52:49.105451 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:49.105406 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:49.105632 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:49.105548 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:52:50.105904 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:50.105871 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:52:50.106390 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:50.105872 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:50.106390 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:50.106016 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:52:50.106390 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:50.106108 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:52:51.105973 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:51.105932 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:51.106432 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:51.106088 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:52:51.717254 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:51.717219 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret\") pod \"global-pull-secret-syncer-kwpqc\" (UID: \"7e9af723-4871-490b-8739-6f07536c313d\") " pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:51.717417 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:51.717379 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 16:52:51.717480 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:51.717447 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret podName:7e9af723-4871-490b-8739-6f07536c313d nodeName:}" failed. No retries permitted until 2026-07-23 16:53:07.717431208 +0000 UTC m=+34.191246571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret") pod "global-pull-secret-syncer-kwpqc" (UID: "7e9af723-4871-490b-8739-6f07536c313d") : object "kube-system"/"original-pull-secret" not registered Jul 23 16:52:51.818029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:51.817981 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs\") pod \"network-metrics-daemon-qzqbk\" (UID: \"e6fdffd3-cc88-4a7e-91d1-a2e45102fc88\") " pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:51.818224 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:51.818071 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvtjw\" (UniqueName: \"kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw\") pod \"network-check-target-4sbpm\" (UID: \"beb54da2-dd72-41f4-a716-4235f9a3559f\") " pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:52:51.818224 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:51.818131 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 16:52:51.818224 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:51.818189 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 16:52:51.818224 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:51.818204 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs podName:e6fdffd3-cc88-4a7e-91d1-a2e45102fc88 nodeName:}" failed. No retries permitted until 2026-07-23 16:53:07.818187197 +0000 UTC m=+34.292002557 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs") pod "network-metrics-daemon-qzqbk" (UID: "e6fdffd3-cc88-4a7e-91d1-a2e45102fc88") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 16:52:51.818224 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:51.818209 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 16:52:51.818224 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:51.818222 2574 projected.go:196] Error preparing data for projected volume kube-api-access-jvtjw for pod openshift-network-diagnostics/network-check-target-4sbpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 16:52:51.818461 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:51.818279 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw podName:beb54da2-dd72-41f4-a716-4235f9a3559f nodeName:}" failed. No retries permitted until 2026-07-23 16:53:07.818262895 +0000 UTC m=+34.292078278 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jvtjw" (UniqueName: "kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw") pod "network-check-target-4sbpm" (UID: "beb54da2-dd72-41f4-a716-4235f9a3559f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 16:52:52.105833 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:52.105746 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:52:52.105833 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:52.105746 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:52.106416 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:52.105919 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:52:52.106416 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:52.106071 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:52:53.105450 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:53.105409 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:53.105612 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:53.105541 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:52:54.106796 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:54.106761 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:54.107254 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:54.106873 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:52:54.107254 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:54.106935 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:52:54.107254 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:54.107049 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:52:55.106040 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:55.105536 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:55.106040 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:55.105858 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:52:56.106123 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.106096 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:56.106770 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.106127 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:52:56.106770 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:56.106203 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:52:56.106770 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:56.106310 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:52:56.172120 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.172080 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f9bh2" event={"ID":"9e494496-9aa7-476c-8bba-1711f19517b3","Type":"ContainerStarted","Data":"c4686dbded469b2b12080084657f6808017c19f79f65371839a3e86ab2861bad"} Jul 23 16:52:56.173639 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.173609 2574 generic.go:356] "Generic (PLEG): container finished" podID="8e16ffff7bbb948ff4e7be6a140cd4b4" containerID="b21343e0af9ab8fdcb4f1e9bcfc2c6cd6889f19695356579083c870fed057370" exitCode=0 Jul 23 16:52:56.173760 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.173653 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal" event={"ID":"8e16ffff7bbb948ff4e7be6a140cd4b4","Type":"ContainerDied","Data":"b21343e0af9ab8fdcb4f1e9bcfc2c6cd6889f19695356579083c870fed057370"} Jul 23 16:52:56.175117 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.175095 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nmkrm" event={"ID":"533e4c7f-7865-43c9-a5d7-8e1426ab19ad","Type":"ContainerStarted","Data":"4c32c1f408170eb86309b656aa444ab6644d3f4f6c8a893ee03103e4b5de1e6c"} Jul 23 16:52:56.176978 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.176958 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qmnnk" event={"ID":"631c6c0a-d55a-45ba-9153-a84ed84db311","Type":"ContainerStarted","Data":"2513a5c32a5370a12ee908debcf9e6e1f762fbea42d34720020bf232951c970d"} Jul 23 16:52:56.179624 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.179609 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xsg_109e3c98-c98e-494b-ad16-f6a7caffa6ea/ovn-acl-logging/0.log" Jul 23 16:52:56.179950 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.179932 2574 generic.go:356] "Generic (PLEG): container finished" podID="109e3c98-c98e-494b-ad16-f6a7caffa6ea" containerID="44c8a0c4b0f9064d1c2ac4b3795534cfe9f13062d0ee2c88c760a63c89cb0e87" exitCode=1 Jul 23 16:52:56.180049 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.180015 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" event={"ID":"109e3c98-c98e-494b-ad16-f6a7caffa6ea","Type":"ContainerStarted","Data":"e2ccc687129f65377dda3db751871743367e68d7feacb1de8ccb4e0fbcf9b132"} Jul 23 16:52:56.180092 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.180068 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" event={"ID":"109e3c98-c98e-494b-ad16-f6a7caffa6ea","Type":"ContainerStarted","Data":"9d9670b5b8e816401af2024ad2397634ef6050b1bd4bb27e9b1b3d2e2bbe8889"} Jul 23 16:52:56.180126 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.180100 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" event={"ID":"109e3c98-c98e-494b-ad16-f6a7caffa6ea","Type":"ContainerStarted","Data":"2c5544595fa528c18c6bae120badc31b614bc17bce9bf687501f5b4d7b3dccb1"} Jul 23 16:52:56.180159 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.180135 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" event={"ID":"109e3c98-c98e-494b-ad16-f6a7caffa6ea","Type":"ContainerStarted","Data":"816f4dc6e3e4f77b12bf386c7d89f8d19dea704fc694dd48485d2ca9eaa445c7"} Jul 23 16:52:56.180187 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.180162 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" event={"ID":"109e3c98-c98e-494b-ad16-f6a7caffa6ea","Type":"ContainerDied","Data":"44c8a0c4b0f9064d1c2ac4b3795534cfe9f13062d0ee2c88c760a63c89cb0e87"} Jul 23 16:52:56.180224 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.180195 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" event={"ID":"109e3c98-c98e-494b-ad16-f6a7caffa6ea","Type":"ContainerStarted","Data":"5e53cfd74e4f42f083839b34f3a3564ba767390c6b64cef86f192f8f680ad943"} Jul 23 16:52:56.181334 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.181312 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fqrgt" event={"ID":"25e64bf5-928d-4675-a1de-cd03bae729c3","Type":"ContainerStarted","Data":"133fd8309dd1d2b2acf8a6695b007040184e3be708a60aebd41d7fa1ccc62914"} Jul 23 16:52:56.182691 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.182674 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal" event={"ID":"05ea4021fcfb88e582ecfb9097a979df","Type":"ContainerStarted","Data":"416b19294eb4efa4459b768d9cc0915bb169fc44da7b77d4c34f687d6abe9544"} Jul 23 16:52:56.184125 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.184102 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" event={"ID":"6d82d07e-b8fa-43b0-bf51-674e841b1d1c","Type":"ContainerStarted","Data":"941beebb07aac347b2fa192930313999e3235199a9968695a5c3d3c5fc4a6b50"} Jul 23 16:52:56.185449 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.185430 2574 generic.go:356] "Generic (PLEG): container finished" podID="5ac875d6-c91e-446a-b99f-a676d029da0f" containerID="d6ed8119a2392b69b650df493f71e0567feef01db06bd6fa2bb29561f0e424ab" exitCode=0 Jul 23 16:52:56.185529 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.185494 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dk5w9" event={"ID":"5ac875d6-c91e-446a-b99f-a676d029da0f","Type":"ContainerDied","Data":"d6ed8119a2392b69b650df493f71e0567feef01db06bd6fa2bb29561f0e424ab"} Jul 23 16:52:56.186939 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.186916 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" event={"ID":"b6696092-1dab-4d36-ae83-856549abf7a2","Type":"ContainerStarted","Data":"8bddf071638fee01869d41144aeeada0e1fbb5786c7a342d3285744f6e4395c8"} Jul 23 16:52:56.192646 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.192596 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f9bh2" podStartSLOduration=3.498288595 podStartE2EDuration="22.192580656s" totalImagesPullingTime="18.694292061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:52:56.190085471 +0000 UTC m=+22.663900852" watchObservedRunningTime="2026-07-23 16:52:56.192580656 +0000 UTC m=+22.666396037" Jul 23 16:52:56.237186 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.236933 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-250.ec2.internal" podStartSLOduration=21.236917379 podStartE2EDuration="21.236917379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:52:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:52:56.23662279 +0000 UTC m=+22.710438171" watchObservedRunningTime="2026-07-23 16:52:56.236917379 +0000 UTC m=+22.710732760" Jul 23 16:52:56.254718 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.254680 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fqrgt" podStartSLOduration=3.56011084 podStartE2EDuration="22.25465994s" totalImagesPullingTime="18.6945491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:52:56.25438268 +0000 UTC m=+22.728198060" watchObservedRunningTime="2026-07-23 16:52:56.25465994 +0000 UTC m=+22.728475321" Jul 23 16:52:56.273782 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.273733 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qmnnk" podStartSLOduration=3.143906604 podStartE2EDuration="22.273717815s" totalImagesPullingTime="19.129811211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:52:56.273243616 +0000 UTC m=+22.747058997" watchObservedRunningTime="2026-07-23 16:52:56.273717815 +0000 UTC m=+22.747533195" Jul 23 16:52:56.309500 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:56.309406 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nmkrm" podStartSLOduration=3.670818957 podStartE2EDuration="22.309390623s" totalImagesPullingTime="18.638571666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:52:56.291513057 +0000 UTC m=+22.765328439" watchObservedRunningTime="2026-07-23 16:52:56.309390623 +0000 UTC m=+22.783206003" Jul 23 16:52:57.106201 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:57.106175 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:57.106525 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:57.106267 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:52:57.190554 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:57.190526 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal" event={"ID":"8e16ffff7bbb948ff4e7be6a140cd4b4","Type":"ContainerStarted","Data":"fdf928161320fc775703fb2b87c31af845e062309908b4c3fb764245465d41b2"} Jul 23 16:52:57.192164 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:57.192139 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jsbxp" event={"ID":"41d0aca9-8760-4a31-8035-4170984c2577","Type":"ContainerStarted","Data":"956c7316449f249acbaf58c879488579b13fcd13e3a3907a838c1e70cdc2f299"} Jul 23 16:52:57.203568 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:57.203542 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 16:52:57.208483 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:57.208443 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-250.ec2.internal" podStartSLOduration=22.208430406 podStartE2EDuration="22.208430406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:52:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:52:57.208052491 +0000 UTC m=+23.681867872" watchObservedRunningTime="2026-07-23 16:52:57.208430406 +0000 UTC m=+23.682245786" Jul 23 16:52:57.208692 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:57.208667 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kkcbd" podStartSLOduration=4.508769183 podStartE2EDuration="23.208662311s" totalImagesPullingTime="18.699893128s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:52:56.343351037 +0000 UTC m=+22.817166418" watchObservedRunningTime="2026-07-23 16:52:57.208662311 +0000 UTC m=+23.682477746" Jul 23 16:52:57.390376 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:57.390299 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nmkrm" Jul 23 16:52:57.390973 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:57.390925 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nmkrm" Jul 23 16:52:57.413508 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:57.413455 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jsbxp" podStartSLOduration=4.7023220420000005 podStartE2EDuration="23.413440597s" totalImagesPullingTime="18.711118555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:52:57.230561975 +0000 UTC m=+23.704377367" watchObservedRunningTime="2026-07-23 16:52:57.413440597 +0000 UTC m=+23.887255976" Jul 23 16:52:58.061489 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:58.061373 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T16:52:57.203566425Z","UUID":"743a1328-6dea-474d-ac6a-a98208693643","Handler":null,"Name":"","Endpoint":""} Jul 23 16:52:58.063266 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:58.063232 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 16:52:58.063441 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:58.063279 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 16:52:58.105312 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:58.105273 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:52:58.105483 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:58.105390 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:52:58.105483 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:58.105449 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:52:58.105600 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:58.105535 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:52:58.197059 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:58.197020 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" event={"ID":"6d82d07e-b8fa-43b0-bf51-674e841b1d1c","Type":"ContainerStarted","Data":"e0424ec0186b401e6f44053d75c676b3e0b3624348966275c63ebd3985fbcbfd"} Jul 23 16:52:58.197684 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:58.197657 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nmkrm" Jul 23 16:52:58.197917 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:58.197892 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nmkrm" Jul 23 16:52:59.106098 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:59.106067 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:52:59.106323 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:52:59.106186 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:52:59.201615 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:59.201576 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" event={"ID":"6d82d07e-b8fa-43b0-bf51-674e841b1d1c","Type":"ContainerStarted","Data":"0f00615d03f9357c5e19c48fdbb8f26427b413ae7551cb7a405bc0b5325ba5a2"} Jul 23 16:52:59.205116 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:59.205093 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xsg_109e3c98-c98e-494b-ad16-f6a7caffa6ea/ovn-acl-logging/0.log" Jul 23 16:52:59.205664 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:59.205637 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" event={"ID":"109e3c98-c98e-494b-ad16-f6a7caffa6ea","Type":"ContainerStarted","Data":"b5b1347341d5e0950273df4b12f1c81e08dacf41e165b8de812e4bf3207b1b30"} Jul 23 16:52:59.231575 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:52:59.231523 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4spk" podStartSLOduration=3.986481047 podStartE2EDuration="25.231505524s" totalImagesPullingTime="21.245024477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:52:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:52:59.230952854 +0000 UTC m=+25.704768236" watchObservedRunningTime="2026-07-23 16:52:59.231505524 +0000 UTC m=+25.705320906" Jul 23 16:53:00.106256 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:00.106220 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:00.106439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:00.106220 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:00.106439 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:00.106368 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:53:00.106439 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:00.106428 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:53:01.105846 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:01.105823 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:01.106150 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:01.105913 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:53:01.214495 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:01.214292 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xsg_109e3c98-c98e-494b-ad16-f6a7caffa6ea/ovn-acl-logging/0.log" Jul 23 16:53:01.214940 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:01.214851 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" event={"ID":"109e3c98-c98e-494b-ad16-f6a7caffa6ea","Type":"ContainerStarted","Data":"c502e0025421b525e0f98ea9af3c453187627eeef2f37f27b5db085c0dfb94bc"} Jul 23 16:53:01.215303 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:01.215180 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:53:01.215461 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:01.215302 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:53:01.215461 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:01.215402 2574 scope.go:117] "RemoveContainer" containerID="44c8a0c4b0f9064d1c2ac4b3795534cfe9f13062d0ee2c88c760a63c89cb0e87" Jul 23 16:53:01.231463 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:01.231210 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:53:02.108312 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:02.108288 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:02.108904 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:02.108293 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:02.108904 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:02.108413 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:53:02.108904 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:02.108459 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:53:02.220321 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:02.220297 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xsg_109e3c98-c98e-494b-ad16-f6a7caffa6ea/ovn-acl-logging/0.log" Jul 23 16:53:02.220716 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:02.220684 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" event={"ID":"109e3c98-c98e-494b-ad16-f6a7caffa6ea","Type":"ContainerStarted","Data":"6e31554994ac193cc1914676e122a5001eac588761b86ffec09c6c532afa9394"} Jul 23 16:53:02.220820 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:02.220787 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:53:02.222488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:02.222462 2574 generic.go:356] "Generic (PLEG): container finished" podID="5ac875d6-c91e-446a-b99f-a676d029da0f" containerID="1f0342e342dfd4ecca868f380c8389282b96a5019a3f235158b30aa840e39754" exitCode=0 Jul 23 16:53:02.222604 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:02.222497 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dk5w9" event={"ID":"5ac875d6-c91e-446a-b99f-a676d029da0f","Type":"ContainerDied","Data":"1f0342e342dfd4ecca868f380c8389282b96a5019a3f235158b30aa840e39754"} Jul 23 16:53:02.236918 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:02.236898 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:53:02.282411 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:02.282367 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" podStartSLOduration=9.556934279 podStartE2EDuration="28.282352584s" totalImagesPullingTime="18.725418305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:53:02.281239463 +0000 UTC m=+28.755054856" watchObservedRunningTime="2026-07-23 16:53:02.282352584 +0000 UTC m=+28.756167965" Jul 23 16:53:03.105960 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:03.105934 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:03.106157 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:03.106060 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:53:03.337939 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:03.337762 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4sbpm"] Jul 23 16:53:03.338479 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:03.338067 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:03.338479 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:03.338152 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:53:03.341111 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:03.341081 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kwpqc"] Jul 23 16:53:03.341188 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:03.341173 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:03.341301 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:03.341269 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:53:03.358718 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:03.358638 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qzqbk"] Jul 23 16:53:03.358807 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:03.358747 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:03.358870 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:03.358853 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:53:04.123386 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:04.123357 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f9bh2_9e494496-9aa7-476c-8bba-1711f19517b3/dns-node-resolver/0.log" Jul 23 16:53:04.229684 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:04.229644 2574 generic.go:356] "Generic (PLEG): container finished" podID="5ac875d6-c91e-446a-b99f-a676d029da0f" containerID="8cdcec2c78e62d4cdd111d51fd597fdd09ce24ff9f7edda40f3734bdc3faf8c0" exitCode=0 Jul 23 16:53:04.229855 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:04.229716 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dk5w9" event={"ID":"5ac875d6-c91e-446a-b99f-a676d029da0f","Type":"ContainerDied","Data":"8cdcec2c78e62d4cdd111d51fd597fdd09ce24ff9f7edda40f3734bdc3faf8c0"} Jul 23 16:53:05.100036 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:05.099991 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fqrgt_25e64bf5-928d-4675-a1de-cd03bae729c3/node-ca/0.log" Jul 23 16:53:05.105174 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:05.105152 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:05.105292 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:05.105157 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:05.105292 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:05.105259 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:53:05.105398 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:05.105163 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:05.105398 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:05.105339 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:53:05.105461 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:05.105424 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:53:06.236812 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:06.236781 2574 generic.go:356] "Generic (PLEG): container finished" podID="5ac875d6-c91e-446a-b99f-a676d029da0f" containerID="c92703a76b2e7b3aa5616b41441e47c33aa134d7f16279b597a6b6afe3b983a5" exitCode=0 Jul 23 16:53:06.237192 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:06.236815 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dk5w9" event={"ID":"5ac875d6-c91e-446a-b99f-a676d029da0f","Type":"ContainerDied","Data":"c92703a76b2e7b3aa5616b41441e47c33aa134d7f16279b597a6b6afe3b983a5"} Jul 23 16:53:07.106184 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:07.106097 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:07.106356 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:07.106097 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:07.106356 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:07.106223 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:53:07.106356 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:07.106117 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:07.106356 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:07.106298 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:53:07.106541 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:07.106422 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:53:07.729177 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:07.729138 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret\") pod \"global-pull-secret-syncer-kwpqc\" (UID: \"7e9af723-4871-490b-8739-6f07536c313d\") " pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:07.729691 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:07.729282 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 16:53:07.729691 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:07.729360 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret podName:7e9af723-4871-490b-8739-6f07536c313d nodeName:}" failed. No retries permitted until 2026-07-23 16:53:39.729343928 +0000 UTC m=+66.203159287 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret") pod "global-pull-secret-syncer-kwpqc" (UID: "7e9af723-4871-490b-8739-6f07536c313d") : object "kube-system"/"original-pull-secret" not registered Jul 23 16:53:07.830133 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:07.830093 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvtjw\" (UniqueName: \"kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw\") pod \"network-check-target-4sbpm\" (UID: \"beb54da2-dd72-41f4-a716-4235f9a3559f\") " pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:07.830313 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:07.830157 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs\") pod \"network-metrics-daemon-qzqbk\" (UID: \"e6fdffd3-cc88-4a7e-91d1-a2e45102fc88\") " pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:07.830313 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:07.830258 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 16:53:07.830313 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:07.830296 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 16:53:07.830469 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:07.830322 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs podName:e6fdffd3-cc88-4a7e-91d1-a2e45102fc88 nodeName:}" failed. No retries permitted until 2026-07-23 16:53:39.830303256 +0000 UTC m=+66.304118637 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs") pod "network-metrics-daemon-qzqbk" (UID: "e6fdffd3-cc88-4a7e-91d1-a2e45102fc88") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 16:53:07.830469 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:07.830323 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 16:53:07.830469 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:07.830341 2574 projected.go:196] Error preparing data for projected volume kube-api-access-jvtjw for pod openshift-network-diagnostics/network-check-target-4sbpm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 16:53:07.830469 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:07.830408 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw podName:beb54da2-dd72-41f4-a716-4235f9a3559f nodeName:}" failed. No retries permitted until 2026-07-23 16:53:39.830390856 +0000 UTC m=+66.304206235 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jvtjw" (UniqueName: "kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw") pod "network-check-target-4sbpm" (UID: "beb54da2-dd72-41f4-a716-4235f9a3559f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 16:53:09.105328 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:09.105297 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:09.105779 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:09.105295 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:09.105779 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:09.105420 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:53:09.105779 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:09.105298 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:09.105779 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:09.105518 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:53:09.105779 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:09.105557 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:53:11.105891 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:11.105711 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:11.106289 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:11.105725 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:11.106289 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:11.105956 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:53:11.106289 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:11.106049 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:53:11.106289 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:11.105771 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:11.106289 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:11.106130 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:53:11.252030 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:11.251982 2574 generic.go:356] "Generic (PLEG): container finished" podID="5ac875d6-c91e-446a-b99f-a676d029da0f" containerID="edaf353ff2233407e31ceab73b1e284a867dc1d9ac6364a478d76b4557102798" exitCode=0 Jul 23 16:53:11.252183 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:11.252032 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dk5w9" event={"ID":"5ac875d6-c91e-446a-b99f-a676d029da0f","Type":"ContainerDied","Data":"edaf353ff2233407e31ceab73b1e284a867dc1d9ac6364a478d76b4557102798"} Jul 23 16:53:12.256897 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:12.256866 2574 generic.go:356] "Generic (PLEG): container finished" podID="5ac875d6-c91e-446a-b99f-a676d029da0f" containerID="ade7efd2089046ef3e4251530aa20c90de4b38865185d2fa54f9190fad3a954d" exitCode=0 Jul 23 16:53:12.257285 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:12.256933 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dk5w9" event={"ID":"5ac875d6-c91e-446a-b99f-a676d029da0f","Type":"ContainerDied","Data":"ade7efd2089046ef3e4251530aa20c90de4b38865185d2fa54f9190fad3a954d"} Jul 23 16:53:13.105355 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:13.105306 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:13.105355 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:13.105359 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:13.105576 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:13.105335 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:13.105576 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:13.105452 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:53:13.105576 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:13.105496 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:53:13.105670 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:13.105583 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:53:13.262413 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:13.262320 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dk5w9" event={"ID":"5ac875d6-c91e-446a-b99f-a676d029da0f","Type":"ContainerStarted","Data":"d8357a2908e6c910b6a228dd196550fbfd6c22bd5dd1d31be86f125bda7d73e9"} Jul 23 16:53:13.303705 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:13.301766 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dk5w9" podStartSLOduration=9.046135063 podStartE2EDuration="39.301746494s" totalImagesPullingTime="30.255611431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:52:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:53:13.299771838 +0000 UTC m=+39.773587219" watchObservedRunningTime="2026-07-23 16:53:13.301746494 +0000 UTC m=+39.775561876" Jul 23 16:53:15.105670 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:15.105630 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:15.105670 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:15.105676 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:15.106109 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:15.105726 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:15.106109 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:15.105741 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:53:15.106109 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:15.105801 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:53:15.106109 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:15.105844 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:53:17.105338 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:17.105304 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:17.105742 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:17.105411 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:17.105742 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:17.105422 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:53:17.105742 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:17.105438 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:17.105742 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:17.105511 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:53:17.105742 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:17.105605 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:53:19.105677 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:19.105649 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:19.106084 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:19.105653 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:19.106084 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:19.105751 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:53:19.106084 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:19.105653 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:19.106084 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:19.105819 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:53:19.106084 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:19.105921 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:53:21.105316 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:21.105284 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:21.105316 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:21.105309 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:21.105734 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:21.105382 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:53:21.105734 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:21.105422 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:21.105734 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:21.105487 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:53:21.105734 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:21.105550 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:53:23.105419 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:23.105382 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:23.105419 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:23.105425 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:23.105942 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:23.105425 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:23.105942 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:23.105489 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:53:23.105942 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:23.105629 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:53:23.105942 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:23.105662 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:53:25.105966 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:25.105932 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:25.105966 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:25.105969 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:25.106489 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:25.105969 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:25.106489 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:25.106054 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:53:25.106489 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:25.106136 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:53:25.106489 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:25.106196 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:53:27.105516 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:27.105481 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:27.105983 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:27.105480 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:27.105983 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:27.105593 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:53:27.105983 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:27.105613 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:27.105983 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:27.105690 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:53:27.105983 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:27.105768 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:53:29.105746 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:29.105714 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:29.106139 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:29.105799 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:29.106139 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:29.105808 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:53:29.106139 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:29.105885 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:29.106139 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:29.105882 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:53:29.106139 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:29.105957 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:53:31.106015 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.105978 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:31.106474 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.106099 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:31.106474 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:31.106107 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4sbpm" podUID="beb54da2-dd72-41f4-a716-4235f9a3559f" Jul 23 16:53:31.106474 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.106129 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:31.106474 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:31.106210 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qzqbk" podUID="e6fdffd3-cc88-4a7e-91d1-a2e45102fc88" Jul 23 16:53:31.106474 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:31.106278 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwpqc" podUID="7e9af723-4871-490b-8739-6f07536c313d" Jul 23 16:53:31.297301 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.297275 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-250.ec2.internal" event="NodeReady" Jul 23 16:53:31.297465 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.297381 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 16:53:31.440262 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.440230 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fln7z"] Jul 23 16:53:31.442104 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.442079 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fln7z" Jul 23 16:53:31.444625 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.444599 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bngwk"] Jul 23 16:53:31.445431 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.445405 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mxssw\"" Jul 23 16:53:31.445599 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.445583 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 16:53:31.446336 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.446318 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bngwk" Jul 23 16:53:31.446566 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.446387 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 16:53:31.452539 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.452522 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 16:53:31.454721 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.454704 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 16:53:31.455585 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.455569 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 16:53:31.459955 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.459941 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tf89r\"" Jul 23 16:53:31.463621 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.463592 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fln7z"] Jul 23 16:53:31.474070 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.474043 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bngwk"] Jul 23 16:53:31.495453 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.495421 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7c8j\" (UniqueName: \"kubernetes.io/projected/c8ee823c-f384-4c3d-844e-1a75f90b85de-kube-api-access-t7c8j\") pod \"ingress-canary-bngwk\" (UID: \"c8ee823c-f384-4c3d-844e-1a75f90b85de\") " pod="openshift-ingress-canary/ingress-canary-bngwk" Jul 23 16:53:31.495593 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.495471 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eb78804-a2f6-4124-b5ed-302ee5f7f0b9-tmp-dir\") pod \"dns-default-fln7z\" (UID: \"8eb78804-a2f6-4124-b5ed-302ee5f7f0b9\") " pod="openshift-dns/dns-default-fln7z" Jul 23 16:53:31.495593 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.495495 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh9wb\" (UniqueName: \"kubernetes.io/projected/8eb78804-a2f6-4124-b5ed-302ee5f7f0b9-kube-api-access-jh9wb\") pod \"dns-default-fln7z\" (UID: \"8eb78804-a2f6-4124-b5ed-302ee5f7f0b9\") " pod="openshift-dns/dns-default-fln7z" Jul 23 16:53:31.495593 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.495520 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8eb78804-a2f6-4124-b5ed-302ee5f7f0b9-config-volume\") pod \"dns-default-fln7z\" (UID: \"8eb78804-a2f6-4124-b5ed-302ee5f7f0b9\") " pod="openshift-dns/dns-default-fln7z" Jul 23 16:53:31.495593 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.495539 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8eb78804-a2f6-4124-b5ed-302ee5f7f0b9-metrics-tls\") pod \"dns-default-fln7z\" (UID: \"8eb78804-a2f6-4124-b5ed-302ee5f7f0b9\") " pod="openshift-dns/dns-default-fln7z" Jul 23 16:53:31.495593 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.495584 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8ee823c-f384-4c3d-844e-1a75f90b85de-cert\") pod \"ingress-canary-bngwk\" (UID: \"c8ee823c-f384-4c3d-844e-1a75f90b85de\") " pod="openshift-ingress-canary/ingress-canary-bngwk" Jul 23 16:53:31.515568 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.515537 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fbvld"] Jul 23 16:53:31.517540 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.517526 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fbvld" Jul 23 16:53:31.521108 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.521084 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 16:53:31.522034 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.522017 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 16:53:31.522034 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.522027 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 16:53:31.522583 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.522558 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gq2jk\"" Jul 23 16:53:31.522681 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.522627 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 16:53:31.537840 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.537814 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fbvld"] Jul 23 16:53:31.596117 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.596027 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/785920fb-be6e-4554-866a-f2a721504715-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbvld\" (UID: \"785920fb-be6e-4554-866a-f2a721504715\") " pod="openshift-insights/insights-runtime-extractor-fbvld" Jul 23 16:53:31.596117 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.596069 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8ee823c-f384-4c3d-844e-1a75f90b85de-cert\") pod \"ingress-canary-bngwk\" (UID: \"c8ee823c-f384-4c3d-844e-1a75f90b85de\") " pod="openshift-ingress-canary/ingress-canary-bngwk" Jul 23 16:53:31.596117 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.596093 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7c8j\" (UniqueName: \"kubernetes.io/projected/c8ee823c-f384-4c3d-844e-1a75f90b85de-kube-api-access-t7c8j\") pod \"ingress-canary-bngwk\" (UID: \"c8ee823c-f384-4c3d-844e-1a75f90b85de\") " pod="openshift-ingress-canary/ingress-canary-bngwk" Jul 23 16:53:31.596117 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.596115 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/785920fb-be6e-4554-866a-f2a721504715-crio-socket\") pod \"insights-runtime-extractor-fbvld\" (UID: \"785920fb-be6e-4554-866a-f2a721504715\") " pod="openshift-insights/insights-runtime-extractor-fbvld" Jul 23 16:53:31.596415 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.596253 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eb78804-a2f6-4124-b5ed-302ee5f7f0b9-tmp-dir\") pod \"dns-default-fln7z\" (UID: \"8eb78804-a2f6-4124-b5ed-302ee5f7f0b9\") " pod="openshift-dns/dns-default-fln7z" Jul 23 16:53:31.596415 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.596281 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh9wb\" (UniqueName: \"kubernetes.io/projected/8eb78804-a2f6-4124-b5ed-302ee5f7f0b9-kube-api-access-jh9wb\") pod \"dns-default-fln7z\" (UID: \"8eb78804-a2f6-4124-b5ed-302ee5f7f0b9\") " pod="openshift-dns/dns-default-fln7z" Jul 23 16:53:31.596415 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.596301 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/785920fb-be6e-4554-866a-f2a721504715-data-volume\") pod \"insights-runtime-extractor-fbvld\" (UID: \"785920fb-be6e-4554-866a-f2a721504715\") " pod="openshift-insights/insights-runtime-extractor-fbvld" Jul 23 16:53:31.596415 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.596395 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8eb78804-a2f6-4124-b5ed-302ee5f7f0b9-config-volume\") pod \"dns-default-fln7z\" (UID: \"8eb78804-a2f6-4124-b5ed-302ee5f7f0b9\") " pod="openshift-dns/dns-default-fln7z" Jul 23 16:53:31.596606 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.596511 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8eb78804-a2f6-4124-b5ed-302ee5f7f0b9-metrics-tls\") pod \"dns-default-fln7z\" (UID: \"8eb78804-a2f6-4124-b5ed-302ee5f7f0b9\") " pod="openshift-dns/dns-default-fln7z" Jul 23 16:53:31.596606 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.596537 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/785920fb-be6e-4554-866a-f2a721504715-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbvld\" (UID: \"785920fb-be6e-4554-866a-f2a721504715\") " pod="openshift-insights/insights-runtime-extractor-fbvld" Jul 23 16:53:31.596606 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.596568 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnl4x\" (UniqueName: \"kubernetes.io/projected/785920fb-be6e-4554-866a-f2a721504715-kube-api-access-xnl4x\") pod \"insights-runtime-extractor-fbvld\" (UID: \"785920fb-be6e-4554-866a-f2a721504715\") " pod="openshift-insights/insights-runtime-extractor-fbvld" Jul 23 16:53:31.596725 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.596607 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eb78804-a2f6-4124-b5ed-302ee5f7f0b9-tmp-dir\") pod \"dns-default-fln7z\" (UID: \"8eb78804-a2f6-4124-b5ed-302ee5f7f0b9\") " pod="openshift-dns/dns-default-fln7z" Jul 23 16:53:31.597189 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.597163 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8eb78804-a2f6-4124-b5ed-302ee5f7f0b9-config-volume\") pod \"dns-default-fln7z\" (UID: \"8eb78804-a2f6-4124-b5ed-302ee5f7f0b9\") " pod="openshift-dns/dns-default-fln7z" Jul 23 16:53:31.600233 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.600211 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8eb78804-a2f6-4124-b5ed-302ee5f7f0b9-metrics-tls\") pod \"dns-default-fln7z\" (UID: \"8eb78804-a2f6-4124-b5ed-302ee5f7f0b9\") " pod="openshift-dns/dns-default-fln7z" Jul 23 16:53:31.600233 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.600229 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8ee823c-f384-4c3d-844e-1a75f90b85de-cert\") pod \"ingress-canary-bngwk\" (UID: \"c8ee823c-f384-4c3d-844e-1a75f90b85de\") " pod="openshift-ingress-canary/ingress-canary-bngwk" Jul 23 16:53:31.620434 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.620347 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh9wb\" (UniqueName: \"kubernetes.io/projected/8eb78804-a2f6-4124-b5ed-302ee5f7f0b9-kube-api-access-jh9wb\") pod \"dns-default-fln7z\" (UID: \"8eb78804-a2f6-4124-b5ed-302ee5f7f0b9\") " pod="openshift-dns/dns-default-fln7z" Jul 23 16:53:31.627665 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.627599 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7c8j\" (UniqueName: \"kubernetes.io/projected/c8ee823c-f384-4c3d-844e-1a75f90b85de-kube-api-access-t7c8j\") pod \"ingress-canary-bngwk\" (UID: \"c8ee823c-f384-4c3d-844e-1a75f90b85de\") " pod="openshift-ingress-canary/ingress-canary-bngwk" Jul 23 16:53:31.697873 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.697836 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/785920fb-be6e-4554-866a-f2a721504715-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbvld\" (UID: \"785920fb-be6e-4554-866a-f2a721504715\") " pod="openshift-insights/insights-runtime-extractor-fbvld" Jul 23 16:53:31.697873 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.697873 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnl4x\" (UniqueName: \"kubernetes.io/projected/785920fb-be6e-4554-866a-f2a721504715-kube-api-access-xnl4x\") pod \"insights-runtime-extractor-fbvld\" (UID: \"785920fb-be6e-4554-866a-f2a721504715\") " pod="openshift-insights/insights-runtime-extractor-fbvld" Jul 23 16:53:31.698220 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.697916 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/785920fb-be6e-4554-866a-f2a721504715-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbvld\" (UID: \"785920fb-be6e-4554-866a-f2a721504715\") " pod="openshift-insights/insights-runtime-extractor-fbvld" Jul 23 16:53:31.698220 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.697937 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/785920fb-be6e-4554-866a-f2a721504715-crio-socket\") pod \"insights-runtime-extractor-fbvld\" (UID: \"785920fb-be6e-4554-866a-f2a721504715\") " pod="openshift-insights/insights-runtime-extractor-fbvld" Jul 23 16:53:31.698220 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.697972 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/785920fb-be6e-4554-866a-f2a721504715-data-volume\") pod \"insights-runtime-extractor-fbvld\" (UID: \"785920fb-be6e-4554-866a-f2a721504715\") " pod="openshift-insights/insights-runtime-extractor-fbvld" Jul 23 16:53:31.698220 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.698077 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/785920fb-be6e-4554-866a-f2a721504715-crio-socket\") pod \"insights-runtime-extractor-fbvld\" (UID: \"785920fb-be6e-4554-866a-f2a721504715\") " pod="openshift-insights/insights-runtime-extractor-fbvld" Jul 23 16:53:31.698412 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.698312 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/785920fb-be6e-4554-866a-f2a721504715-data-volume\") pod \"insights-runtime-extractor-fbvld\" (UID: \"785920fb-be6e-4554-866a-f2a721504715\") " pod="openshift-insights/insights-runtime-extractor-fbvld" Jul 23 16:53:31.698412 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.698391 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/785920fb-be6e-4554-866a-f2a721504715-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbvld\" (UID: \"785920fb-be6e-4554-866a-f2a721504715\") " pod="openshift-insights/insights-runtime-extractor-fbvld" Jul 23 16:53:31.700287 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.700271 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/785920fb-be6e-4554-866a-f2a721504715-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbvld\" (UID: \"785920fb-be6e-4554-866a-f2a721504715\") " pod="openshift-insights/insights-runtime-extractor-fbvld" Jul 23 16:53:31.709265 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.709244 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnl4x\" (UniqueName: \"kubernetes.io/projected/785920fb-be6e-4554-866a-f2a721504715-kube-api-access-xnl4x\") pod \"insights-runtime-extractor-fbvld\" (UID: \"785920fb-be6e-4554-866a-f2a721504715\") " pod="openshift-insights/insights-runtime-extractor-fbvld" Jul 23 16:53:31.753236 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.753209 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fln7z" Jul 23 16:53:31.757008 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.756987 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bngwk" Jul 23 16:53:31.825698 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.825613 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fbvld" Jul 23 16:53:31.916354 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.916014 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bngwk"] Jul 23 16:53:31.919296 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:53:31.919263 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ee823c_f384_4c3d_844e_1a75f90b85de.slice/crio-7b9860b9ef08bc32ee54cc8686da22f94d1d7f4fa1c2baead5e77bd61298adde WatchSource:0}: Error finding container 7b9860b9ef08bc32ee54cc8686da22f94d1d7f4fa1c2baead5e77bd61298adde: Status 404 returned error can't find the container with id 7b9860b9ef08bc32ee54cc8686da22f94d1d7f4fa1c2baead5e77bd61298adde Jul 23 16:53:31.942416 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.942397 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fln7z"] Jul 23 16:53:31.944631 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:53:31.944604 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb78804_a2f6_4124_b5ed_302ee5f7f0b9.slice/crio-68a8701c4d10f6fe83a1d1e4843350d51a862b8b2f505e152e95efb0869581ec WatchSource:0}: Error finding container 68a8701c4d10f6fe83a1d1e4843350d51a862b8b2f505e152e95efb0869581ec: Status 404 returned error can't find the container with id 68a8701c4d10f6fe83a1d1e4843350d51a862b8b2f505e152e95efb0869581ec Jul 23 16:53:31.969150 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:31.969123 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fbvld"] Jul 23 16:53:31.974199 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:53:31.974175 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod785920fb_be6e_4554_866a_f2a721504715.slice/crio-86e809df9392ed9f70ae2d44108696a731cb9eef3804078f3f29d0fe20fe0088 WatchSource:0}: Error finding container 86e809df9392ed9f70ae2d44108696a731cb9eef3804078f3f29d0fe20fe0088: Status 404 returned error can't find the container with id 86e809df9392ed9f70ae2d44108696a731cb9eef3804078f3f29d0fe20fe0088 Jul 23 16:53:32.304354 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:32.304317 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fln7z" event={"ID":"8eb78804-a2f6-4124-b5ed-302ee5f7f0b9","Type":"ContainerStarted","Data":"68a8701c4d10f6fe83a1d1e4843350d51a862b8b2f505e152e95efb0869581ec"} Jul 23 16:53:32.305497 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:32.305461 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbvld" event={"ID":"785920fb-be6e-4554-866a-f2a721504715","Type":"ContainerStarted","Data":"86e809df9392ed9f70ae2d44108696a731cb9eef3804078f3f29d0fe20fe0088"} Jul 23 16:53:32.306449 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:32.306424 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bngwk" event={"ID":"c8ee823c-f384-4c3d-844e-1a75f90b85de","Type":"ContainerStarted","Data":"7b9860b9ef08bc32ee54cc8686da22f94d1d7f4fa1c2baead5e77bd61298adde"} Jul 23 16:53:32.790804 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:32.789577 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lzgtw"] Jul 23 16:53:32.812591 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:32.812540 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lzgtw"] Jul 23 16:53:32.812747 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:32.812666 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lzgtw" Jul 23 16:53:32.815563 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:32.815539 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-slxcj\"" Jul 23 16:53:32.815799 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:32.815781 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 23 16:53:32.908375 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:32.908317 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7d5df5db-c89e-47ab-a46b-4a8ec748f4c9-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-lzgtw\" (UID: \"7d5df5db-c89e-47ab-a46b-4a8ec748f4c9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lzgtw" Jul 23 16:53:33.008954 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.008909 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7d5df5db-c89e-47ab-a46b-4a8ec748f4c9-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-lzgtw\" (UID: \"7d5df5db-c89e-47ab-a46b-4a8ec748f4c9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lzgtw" Jul 23 16:53:33.009148 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:33.009074 2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 23 16:53:33.009148 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:33.009143 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d5df5db-c89e-47ab-a46b-4a8ec748f4c9-tls-certificates podName:7d5df5db-c89e-47ab-a46b-4a8ec748f4c9 nodeName:}" failed. No retries permitted until 2026-07-23 16:53:33.50912087 +0000 UTC m=+59.982936230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/7d5df5db-c89e-47ab-a46b-4a8ec748f4c9-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-lzgtw" (UID: "7d5df5db-c89e-47ab-a46b-4a8ec748f4c9") : secret "prometheus-operator-admission-webhook-tls" not found Jul 23 16:53:33.106131 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.106040 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:33.108675 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.106362 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:33.108675 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.106450 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:33.116438 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.114023 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 16:53:33.116438 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.114261 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 16:53:33.116438 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.114487 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-khft9\"" Jul 23 16:53:33.117816 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.117257 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 16:53:33.117816 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.117480 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-csh47\"" Jul 23 16:53:33.118615 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.118316 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 16:53:33.513303 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.513268 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7d5df5db-c89e-47ab-a46b-4a8ec748f4c9-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-lzgtw\" (UID: \"7d5df5db-c89e-47ab-a46b-4a8ec748f4c9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lzgtw" Jul 23 16:53:33.513752 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:33.513427 2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 23 16:53:33.513752 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:33.513491 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d5df5db-c89e-47ab-a46b-4a8ec748f4c9-tls-certificates podName:7d5df5db-c89e-47ab-a46b-4a8ec748f4c9 nodeName:}" failed. No retries permitted until 2026-07-23 16:53:34.513471317 +0000 UTC m=+60.987286679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/7d5df5db-c89e-47ab-a46b-4a8ec748f4c9-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-lzgtw" (UID: "7d5df5db-c89e-47ab-a46b-4a8ec748f4c9") : secret "prometheus-operator-admission-webhook-tls" not found Jul 23 16:53:33.890824 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.890749 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-566694b65c-64cjg"] Jul 23 16:53:33.904967 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.904934 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:33.907905 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.907846 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566694b65c-64cjg"] Jul 23 16:53:33.908619 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.908596 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 23 16:53:33.909530 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.909507 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 23 16:53:33.909761 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.909744 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 16:53:33.909958 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.909943 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 16:53:33.910151 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.910135 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 23 16:53:33.910935 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.910353 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q6gwn\"" Jul 23 16:53:33.910935 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.910534 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 23 16:53:33.910935 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.910715 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 23 16:53:33.916800 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.916776 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08ebdcca-a950-49f5-aa27-5676082fecd6-console-serving-cert\") pod \"console-566694b65c-64cjg\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:33.916907 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.916846 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08ebdcca-a950-49f5-aa27-5676082fecd6-console-config\") pod \"console-566694b65c-64cjg\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:33.916907 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.916873 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08ebdcca-a950-49f5-aa27-5676082fecd6-service-ca\") pod \"console-566694b65c-64cjg\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:33.917044 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.916942 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08ebdcca-a950-49f5-aa27-5676082fecd6-oauth-serving-cert\") pod \"console-566694b65c-64cjg\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:33.917044 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.916969 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kxqz\" (UniqueName: \"kubernetes.io/projected/08ebdcca-a950-49f5-aa27-5676082fecd6-kube-api-access-5kxqz\") pod \"console-566694b65c-64cjg\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:33.917044 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:33.917032 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08ebdcca-a950-49f5-aa27-5676082fecd6-console-oauth-config\") pod \"console-566694b65c-64cjg\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:34.017376 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.017342 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08ebdcca-a950-49f5-aa27-5676082fecd6-console-oauth-config\") pod \"console-566694b65c-64cjg\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:34.017643 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.017624 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08ebdcca-a950-49f5-aa27-5676082fecd6-console-serving-cert\") pod \"console-566694b65c-64cjg\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:34.017786 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.017771 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08ebdcca-a950-49f5-aa27-5676082fecd6-console-config\") pod \"console-566694b65c-64cjg\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:34.017891 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.017878 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08ebdcca-a950-49f5-aa27-5676082fecd6-service-ca\") pod \"console-566694b65c-64cjg\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:34.018053 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.018036 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08ebdcca-a950-49f5-aa27-5676082fecd6-oauth-serving-cert\") pod \"console-566694b65c-64cjg\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:34.018178 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.018162 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kxqz\" (UniqueName: \"kubernetes.io/projected/08ebdcca-a950-49f5-aa27-5676082fecd6-kube-api-access-5kxqz\") pod \"console-566694b65c-64cjg\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:34.021042 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.021020 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 23 16:53:34.024868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.024845 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 23 16:53:34.025054 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.025035 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 23 16:53:34.025407 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.025389 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 23 16:53:34.025647 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.025630 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 23 16:53:34.029527 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.029502 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08ebdcca-a950-49f5-aa27-5676082fecd6-oauth-serving-cert\") pod \"console-566694b65c-64cjg\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:34.029626 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.029536 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08ebdcca-a950-49f5-aa27-5676082fecd6-service-ca\") pod \"console-566694b65c-64cjg\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:34.029857 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.029799 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08ebdcca-a950-49f5-aa27-5676082fecd6-console-config\") pod \"console-566694b65c-64cjg\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:34.033014 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.032088 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08ebdcca-a950-49f5-aa27-5676082fecd6-console-serving-cert\") pod \"console-566694b65c-64cjg\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:34.033174 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.033154 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 16:53:34.033816 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.033730 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08ebdcca-a950-49f5-aa27-5676082fecd6-console-oauth-config\") pod \"console-566694b65c-64cjg\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:34.043981 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.043959 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 16:53:34.061577 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.061518 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kxqz\" (UniqueName: \"kubernetes.io/projected/08ebdcca-a950-49f5-aa27-5676082fecd6-kube-api-access-5kxqz\") pod \"console-566694b65c-64cjg\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:34.220541 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.220510 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q6gwn\"" Jul 23 16:53:34.228712 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.228663 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:34.242982 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.242952 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4xsg" Jul 23 16:53:34.523582 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.523493 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7d5df5db-c89e-47ab-a46b-4a8ec748f4c9-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-lzgtw\" (UID: \"7d5df5db-c89e-47ab-a46b-4a8ec748f4c9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lzgtw" Jul 23 16:53:34.527521 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.527488 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7d5df5db-c89e-47ab-a46b-4a8ec748f4c9-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-lzgtw\" (UID: \"7d5df5db-c89e-47ab-a46b-4a8ec748f4c9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lzgtw" Jul 23 16:53:34.629290 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.629259 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-slxcj\"" Jul 23 16:53:34.636655 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:34.636626 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lzgtw" Jul 23 16:53:36.259074 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.259036 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fbf9f6595-mb7sl"] Jul 23 16:53:36.273257 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.273226 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.283983 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.283955 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 23 16:53:36.287327 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.287305 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fbf9f6595-mb7sl"] Jul 23 16:53:36.337968 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.337937 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35198a44-9207-44e0-92b1-d155399cd44b-console-serving-cert\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.337968 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.337971 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35198a44-9207-44e0-92b1-d155399cd44b-console-oauth-config\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.338197 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.337993 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-oauth-serving-cert\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.338197 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.338134 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-service-ca\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.338197 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.338159 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-trusted-ca-bundle\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.338197 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.338188 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p2cp\" (UniqueName: \"kubernetes.io/projected/35198a44-9207-44e0-92b1-d155399cd44b-kube-api-access-5p2cp\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.338351 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.338252 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-console-config\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.438726 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.438688 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-console-config\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.438914 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.438755 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35198a44-9207-44e0-92b1-d155399cd44b-console-serving-cert\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.438914 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.438781 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35198a44-9207-44e0-92b1-d155399cd44b-console-oauth-config\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.438914 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.438799 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-oauth-serving-cert\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.438914 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.438855 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-service-ca\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.438914 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.438876 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-trusted-ca-bundle\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.438914 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.438901 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p2cp\" (UniqueName: \"kubernetes.io/projected/35198a44-9207-44e0-92b1-d155399cd44b-kube-api-access-5p2cp\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.439603 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.439579 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-console-config\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.439704 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.439685 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-oauth-serving-cert\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.439769 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.439742 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-service-ca\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.440331 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.440118 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-trusted-ca-bundle\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.442466 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.442438 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35198a44-9207-44e0-92b1-d155399cd44b-console-serving-cert\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.444434 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.444410 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35198a44-9207-44e0-92b1-d155399cd44b-console-oauth-config\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.449103 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.449084 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p2cp\" (UniqueName: \"kubernetes.io/projected/35198a44-9207-44e0-92b1-d155399cd44b-kube-api-access-5p2cp\") pod \"console-5fbf9f6595-mb7sl\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:36.584868 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:36.584777 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:37.522458 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:37.522426 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lzgtw"] Jul 23 16:53:37.750068 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:53:37.750033 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5df5db_c89e_47ab_a46b_4a8ec748f4c9.slice/crio-7d79201a92f4f9c7a2ea4f5d65de006ac09f3410bdcdfb93b3cfcfd8cf7c8bbe WatchSource:0}: Error finding container 7d79201a92f4f9c7a2ea4f5d65de006ac09f3410bdcdfb93b3cfcfd8cf7c8bbe: Status 404 returned error can't find the container with id 7d79201a92f4f9c7a2ea4f5d65de006ac09f3410bdcdfb93b3cfcfd8cf7c8bbe Jul 23 16:53:37.919145 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:37.918871 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fbf9f6595-mb7sl"] Jul 23 16:53:37.923567 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:53:37.923540 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35198a44_9207_44e0_92b1_d155399cd44b.slice/crio-7268a94758e7ef4c080d07778ca94fe25c380766d1fdf38191dcb71c55fa5839 WatchSource:0}: Error finding container 7268a94758e7ef4c080d07778ca94fe25c380766d1fdf38191dcb71c55fa5839: Status 404 returned error can't find the container with id 7268a94758e7ef4c080d07778ca94fe25c380766d1fdf38191dcb71c55fa5839 Jul 23 16:53:37.944793 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:37.944494 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566694b65c-64cjg"] Jul 23 16:53:37.950201 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:53:37.950177 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08ebdcca_a950_49f5_aa27_5676082fecd6.slice/crio-354c920be42119d7226c107c54822bb487272fdccd56afc7b2a11f37e5e7f232 WatchSource:0}: Error finding container 354c920be42119d7226c107c54822bb487272fdccd56afc7b2a11f37e5e7f232: Status 404 returned error can't find the container with id 354c920be42119d7226c107c54822bb487272fdccd56afc7b2a11f37e5e7f232 Jul 23 16:53:38.324769 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:38.324730 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bngwk" event={"ID":"c8ee823c-f384-4c3d-844e-1a75f90b85de","Type":"ContainerStarted","Data":"5fc9f1860f5ff12ff31bc757393936daf71c0f0f602a30eee51a0afb6f776ba8"} Jul 23 16:53:38.325973 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:38.325942 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lzgtw" event={"ID":"7d5df5db-c89e-47ab-a46b-4a8ec748f4c9","Type":"ContainerStarted","Data":"7d79201a92f4f9c7a2ea4f5d65de006ac09f3410bdcdfb93b3cfcfd8cf7c8bbe"} Jul 23 16:53:38.326974 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:38.326951 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fbf9f6595-mb7sl" event={"ID":"35198a44-9207-44e0-92b1-d155399cd44b","Type":"ContainerStarted","Data":"7268a94758e7ef4c080d07778ca94fe25c380766d1fdf38191dcb71c55fa5839"} Jul 23 16:53:38.328280 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:38.328255 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbvld" event={"ID":"785920fb-be6e-4554-866a-f2a721504715","Type":"ContainerStarted","Data":"eb0c8128a437973610b9efad75eea51c669ebd073ece47c303c3904e54e87217"} Jul 23 16:53:38.329317 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:38.329295 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566694b65c-64cjg" event={"ID":"08ebdcca-a950-49f5-aa27-5676082fecd6","Type":"ContainerStarted","Data":"354c920be42119d7226c107c54822bb487272fdccd56afc7b2a11f37e5e7f232"} Jul 23 16:53:38.330944 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:38.330911 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fln7z" event={"ID":"8eb78804-a2f6-4124-b5ed-302ee5f7f0b9","Type":"ContainerStarted","Data":"be26a95c28ba4df25fc03f952ab2bee1ee4f9c9e9363819454effb89c59557d4"} Jul 23 16:53:38.331051 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:38.330958 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fln7z" event={"ID":"8eb78804-a2f6-4124-b5ed-302ee5f7f0b9","Type":"ContainerStarted","Data":"8aac830acbe4eec2f91d7f12435abf63267c5113df89672c867f69a59291732f"} Jul 23 16:53:38.331051 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:38.331044 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fln7z" Jul 23 16:53:38.357347 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:38.357303 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bngwk" podStartSLOduration=1.530687782 podStartE2EDuration="7.357289149s" totalImagesPullingTime="5.826601367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:53:38.355834543 +0000 UTC m=+64.829649924" watchObservedRunningTime="2026-07-23 16:53:38.357289149 +0000 UTC m=+64.831104508" Jul 23 16:53:38.396070 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:38.396019 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fln7z" podStartSLOduration=1.943290147 podStartE2EDuration="7.395979964s" totalImagesPullingTime="5.452689817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:53:38.395243655 +0000 UTC m=+64.869059037" watchObservedRunningTime="2026-07-23 16:53:38.395979964 +0000 UTC m=+64.869795381" Jul 23 16:53:39.766552 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:39.766512 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret\") pod \"global-pull-secret-syncer-kwpqc\" (UID: \"7e9af723-4871-490b-8739-6f07536c313d\") " pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:39.769534 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:39.769509 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 16:53:39.779982 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:39.779931 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e9af723-4871-490b-8739-6f07536c313d-original-pull-secret\") pod \"global-pull-secret-syncer-kwpqc\" (UID: \"7e9af723-4871-490b-8739-6f07536c313d\") " pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:39.868492 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:39.868141 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvtjw\" (UniqueName: \"kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw\") pod \"network-check-target-4sbpm\" (UID: \"beb54da2-dd72-41f4-a716-4235f9a3559f\") " pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:39.868492 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:39.868228 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs\") pod \"network-metrics-daemon-qzqbk\" (UID: \"e6fdffd3-cc88-4a7e-91d1-a2e45102fc88\") " pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:39.871511 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:39.871326 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 16:53:39.872200 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:39.872106 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 16:53:39.882593 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:39.882573 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 16:53:39.882815 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:39.882772 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6fdffd3-cc88-4a7e-91d1-a2e45102fc88-metrics-certs\") pod \"network-metrics-daemon-qzqbk\" (UID: \"e6fdffd3-cc88-4a7e-91d1-a2e45102fc88\") " pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:39.893380 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:39.893355 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvtjw\" (UniqueName: \"kubernetes.io/projected/beb54da2-dd72-41f4-a716-4235f9a3559f-kube-api-access-jvtjw\") pod \"network-check-target-4sbpm\" (UID: \"beb54da2-dd72-41f4-a716-4235f9a3559f\") " pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:40.025862 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:40.025598 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-khft9\"" Jul 23 16:53:40.033217 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:40.033190 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qzqbk" Jul 23 16:53:40.040196 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:40.040170 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-csh47\"" Jul 23 16:53:40.046532 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:40.045278 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwpqc" Jul 23 16:53:40.047614 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:40.047487 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:40.341857 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:40.341779 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lzgtw" event={"ID":"7d5df5db-c89e-47ab-a46b-4a8ec748f4c9","Type":"ContainerStarted","Data":"26fcd1d7474d8891af5cb235b1dbd419ca3654796056e66961a648ab15dc93fa"} Jul 23 16:53:40.342077 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:40.342050 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lzgtw" Jul 23 16:53:40.347094 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:40.347068 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lzgtw" Jul 23 16:53:40.387073 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:40.387014 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-lzgtw" podStartSLOduration=6.803748298 podStartE2EDuration="8.386975741s" totalImagesPullingTime="1.583227443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:53:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:53:40.366868172 +0000 UTC m=+66.840683552" watchObservedRunningTime="2026-07-23 16:53:40.386975741 +0000 UTC m=+66.860791124" Jul 23 16:53:40.894462 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:40.894432 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq"] Jul 23 16:53:40.970609 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:40.970576 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq"] Jul 23 16:53:40.970783 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:40.970704 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq" Jul 23 16:53:40.977866 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:40.977791 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 23 16:53:40.977866 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:40.977825 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 16:53:40.978903 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:40.978881 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 16:53:40.979072 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:40.978935 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 23 16:53:40.979072 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:40.978968 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9b87r\"" Jul 23 16:53:40.979752 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:40.979729 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 16:53:41.078750 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:41.078702 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/288fde13-044f-442e-905b-55424842c6cf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-z7mrq\" (UID: \"288fde13-044f-442e-905b-55424842c6cf\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq" Jul 23 16:53:41.078750 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:41.078743 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/288fde13-044f-442e-905b-55424842c6cf-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-z7mrq\" (UID: \"288fde13-044f-442e-905b-55424842c6cf\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq" Jul 23 16:53:41.079041 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:41.078777 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r46z8\" (UniqueName: \"kubernetes.io/projected/288fde13-044f-442e-905b-55424842c6cf-kube-api-access-r46z8\") pod \"prometheus-operator-5945b5cfd-z7mrq\" (UID: \"288fde13-044f-442e-905b-55424842c6cf\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq" Jul 23 16:53:41.079041 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:41.078903 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/288fde13-044f-442e-905b-55424842c6cf-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-z7mrq\" (UID: \"288fde13-044f-442e-905b-55424842c6cf\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq" Jul 23 16:53:41.179329 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:41.179240 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/288fde13-044f-442e-905b-55424842c6cf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-z7mrq\" (UID: \"288fde13-044f-442e-905b-55424842c6cf\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq" Jul 23 16:53:41.179329 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:41.179292 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/288fde13-044f-442e-905b-55424842c6cf-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-z7mrq\" (UID: \"288fde13-044f-442e-905b-55424842c6cf\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq" Jul 23 16:53:41.179329 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:41.179323 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r46z8\" (UniqueName: \"kubernetes.io/projected/288fde13-044f-442e-905b-55424842c6cf-kube-api-access-r46z8\") pod \"prometheus-operator-5945b5cfd-z7mrq\" (UID: \"288fde13-044f-442e-905b-55424842c6cf\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq" Jul 23 16:53:41.179599 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:41.179355 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/288fde13-044f-442e-905b-55424842c6cf-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-z7mrq\" (UID: \"288fde13-044f-442e-905b-55424842c6cf\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq" Jul 23 16:53:41.180016 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:41.179976 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/288fde13-044f-442e-905b-55424842c6cf-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-z7mrq\" (UID: \"288fde13-044f-442e-905b-55424842c6cf\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq" Jul 23 16:53:41.182370 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:41.182341 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/288fde13-044f-442e-905b-55424842c6cf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-z7mrq\" (UID: \"288fde13-044f-442e-905b-55424842c6cf\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq" Jul 23 16:53:41.182503 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:41.182430 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/288fde13-044f-442e-905b-55424842c6cf-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-z7mrq\" (UID: \"288fde13-044f-442e-905b-55424842c6cf\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq" Jul 23 16:53:41.192048 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:41.192023 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r46z8\" (UniqueName: \"kubernetes.io/projected/288fde13-044f-442e-905b-55424842c6cf-kube-api-access-r46z8\") pod \"prometheus-operator-5945b5cfd-z7mrq\" (UID: \"288fde13-044f-442e-905b-55424842c6cf\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq" Jul 23 16:53:41.281535 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:41.281500 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq" Jul 23 16:53:43.296108 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:43.295992 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4sbpm"] Jul 23 16:53:43.299387 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:53:43.299366 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb54da2_dd72_41f4_a716_4235f9a3559f.slice/crio-24df43f28ecb33fd652eafa01fba5a041e598ce143d69ed21aa6421baaeee4f2 WatchSource:0}: Error finding container 24df43f28ecb33fd652eafa01fba5a041e598ce143d69ed21aa6421baaeee4f2: Status 404 returned error can't find the container with id 24df43f28ecb33fd652eafa01fba5a041e598ce143d69ed21aa6421baaeee4f2 Jul 23 16:53:43.321293 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:43.321265 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq"] Jul 23 16:53:43.325472 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:53:43.325440 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod288fde13_044f_442e_905b_55424842c6cf.slice/crio-31f2b9b6d95b91e6b83f06b70fc5d4011a4bce4a8102d67e737bc1bbc24a0874 WatchSource:0}: Error finding container 31f2b9b6d95b91e6b83f06b70fc5d4011a4bce4a8102d67e737bc1bbc24a0874: Status 404 returned error can't find the container with id 31f2b9b6d95b91e6b83f06b70fc5d4011a4bce4a8102d67e737bc1bbc24a0874 Jul 23 16:53:43.353653 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:43.353581 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fbf9f6595-mb7sl" event={"ID":"35198a44-9207-44e0-92b1-d155399cd44b","Type":"ContainerStarted","Data":"19ef85595649c74016277b5add4371807f21870dc55480cf86ac4de2b18a0e19"} Jul 23 16:53:43.354836 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:43.354814 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq" event={"ID":"288fde13-044f-442e-905b-55424842c6cf","Type":"ContainerStarted","Data":"31f2b9b6d95b91e6b83f06b70fc5d4011a4bce4a8102d67e737bc1bbc24a0874"} Jul 23 16:53:43.356428 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:43.356407 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbvld" event={"ID":"785920fb-be6e-4554-866a-f2a721504715","Type":"ContainerStarted","Data":"d004e0fd8293a68a13eb86f9900f71fb4fa6f244146e22ee1d75007af5eb2ed4"} Jul 23 16:53:43.357884 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:43.357862 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566694b65c-64cjg" event={"ID":"08ebdcca-a950-49f5-aa27-5676082fecd6","Type":"ContainerStarted","Data":"767a5ae214f914b1377af6d5e20236b2555d086421c74d88e87c48c7eb19ce45"} Jul 23 16:53:43.358871 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:43.358855 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4sbpm" event={"ID":"beb54da2-dd72-41f4-a716-4235f9a3559f","Type":"ContainerStarted","Data":"24df43f28ecb33fd652eafa01fba5a041e598ce143d69ed21aa6421baaeee4f2"} Jul 23 16:53:43.377754 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:43.377701 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fbf9f6595-mb7sl" podStartSLOduration=2.197755518 podStartE2EDuration="7.377684798s" totalImagesPullingTime="5.17992928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:53:43.377181329 +0000 UTC m=+69.850996710" watchObservedRunningTime="2026-07-23 16:53:43.377684798 +0000 UTC m=+69.851500248" Jul 23 16:53:43.413573 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:43.413521 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-566694b65c-64cjg" podStartSLOduration=5.263224449 podStartE2EDuration="10.413505877s" totalImagesPullingTime="5.150281428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:53:43.411983422 +0000 UTC m=+69.885798802" watchObservedRunningTime="2026-07-23 16:53:43.413505877 +0000 UTC m=+69.887321236" Jul 23 16:53:43.521680 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:43.521649 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kwpqc"] Jul 23 16:53:43.524979 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:53:43.524953 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e9af723_4871_490b_8739_6f07536c313d.slice/crio-4d70667f99072abca368c0ff724ee7e3807273c5f24c6fc88f311eb23cdc9797 WatchSource:0}: Error finding container 4d70667f99072abca368c0ff724ee7e3807273c5f24c6fc88f311eb23cdc9797: Status 404 returned error can't find the container with id 4d70667f99072abca368c0ff724ee7e3807273c5f24c6fc88f311eb23cdc9797 Jul 23 16:53:43.529164 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:43.529143 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qzqbk"] Jul 23 16:53:43.531852 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:53:43.531827 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6fdffd3_cc88_4a7e_91d1_a2e45102fc88.slice/crio-c758e4576b05dfacd64b76758151d5eae202e8c907ed9cb0cfaeaf8a7cbd5ff1 WatchSource:0}: Error finding container c758e4576b05dfacd64b76758151d5eae202e8c907ed9cb0cfaeaf8a7cbd5ff1: Status 404 returned error can't find the container with id c758e4576b05dfacd64b76758151d5eae202e8c907ed9cb0cfaeaf8a7cbd5ff1 Jul 23 16:53:44.229553 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:44.229458 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:44.229553 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:44.229524 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:44.236262 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:44.236234 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:44.365882 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:44.365784 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qzqbk" event={"ID":"e6fdffd3-cc88-4a7e-91d1-a2e45102fc88","Type":"ContainerStarted","Data":"c758e4576b05dfacd64b76758151d5eae202e8c907ed9cb0cfaeaf8a7cbd5ff1"} Jul 23 16:53:44.367845 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:44.367763 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kwpqc" event={"ID":"7e9af723-4871-490b-8739-6f07536c313d","Type":"ContainerStarted","Data":"4d70667f99072abca368c0ff724ee7e3807273c5f24c6fc88f311eb23cdc9797"} Jul 23 16:53:44.373956 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:44.373936 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:53:45.376032 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:45.375586 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qzqbk" event={"ID":"e6fdffd3-cc88-4a7e-91d1-a2e45102fc88","Type":"ContainerStarted","Data":"37d6708ec672314378f889e1029765a5bd56c6d743054a47855efcdde1689c25"} Jul 23 16:53:45.376032 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:45.375657 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qzqbk" event={"ID":"e6fdffd3-cc88-4a7e-91d1-a2e45102fc88","Type":"ContainerStarted","Data":"4e9ee92f55c74129c7a678ae04b540f224f2d48a9a0a0a3a9a609bfe9d36a2b5"} Jul 23 16:53:45.397199 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:45.397142 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qzqbk" podStartSLOduration=69.995667927 podStartE2EDuration="1m11.397118429s" totalImagesPullingTime="1.401450502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:53:45.396315092 +0000 UTC m=+71.870130474" watchObservedRunningTime="2026-07-23 16:53:45.397118429 +0000 UTC m=+71.870933793" Jul 23 16:53:46.585912 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:46.585871 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:46.586407 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:46.585951 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:46.592141 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:46.591900 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:47.386510 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:47.386480 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:53:47.445438 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:47.445391 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566694b65c-64cjg"] Jul 23 16:53:48.337720 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:48.337695 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fln7z" Jul 23 16:53:50.394604 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:50.394516 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kwpqc" event={"ID":"7e9af723-4871-490b-8739-6f07536c313d","Type":"ContainerStarted","Data":"ec944331b83a22a0b1381a6de4c02fed7c5ab421dbbe9dd97d0753f1dd07aae5"} Jul 23 16:53:50.396435 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:50.396407 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq" event={"ID":"288fde13-044f-442e-905b-55424842c6cf","Type":"ContainerStarted","Data":"0a7746b6dfca7a2923e78d59ec4186fb8c80f7d131d28c1b7260434f3778bc16"} Jul 23 16:53:50.396542 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:50.396449 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq" event={"ID":"288fde13-044f-442e-905b-55424842c6cf","Type":"ContainerStarted","Data":"616a2fe6f4b31f7be42f28de5f5a5100036223d5cc90d717c2ccc59870bb9972"} Jul 23 16:53:50.398332 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:50.398313 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbvld" event={"ID":"785920fb-be6e-4554-866a-f2a721504715","Type":"ContainerStarted","Data":"25e3a1b9981aa2c757674da25ca01f23effca7b4f441aa8b8e4fb17aeb1d26e3"} Jul 23 16:53:50.399741 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:50.399720 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4sbpm" event={"ID":"beb54da2-dd72-41f4-a716-4235f9a3559f","Type":"ContainerStarted","Data":"6c2464fdb42bed820d4a495e6ddf2bf557f95fd00c4cd30bdf0ade6a7ca6209d"} Jul 23 16:53:50.399847 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:50.399838 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:53:50.416871 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:50.416828 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kwpqc" podStartSLOduration=69.911982375 podStartE2EDuration="1m16.416816259s" totalImagesPullingTime="6.504833884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:53:50.41645371 +0000 UTC m=+76.890269091" watchObservedRunningTime="2026-07-23 16:53:50.416816259 +0000 UTC m=+76.890631640" Jul 23 16:53:50.437656 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:50.437612 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4sbpm" podStartSLOduration=69.751940259 podStartE2EDuration="1m16.437599978s" totalImagesPullingTime="6.685659719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:53:50.436453316 +0000 UTC m=+76.910268697" watchObservedRunningTime="2026-07-23 16:53:50.437599978 +0000 UTC m=+76.911415338" Jul 23 16:53:50.463981 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:50.463935 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fbvld" podStartSLOduration=1.6350764610000001 podStartE2EDuration="19.46392123s" totalImagesPullingTime="17.828844769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:53:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:53:50.463275434 +0000 UTC m=+76.937090821" watchObservedRunningTime="2026-07-23 16:53:50.46392123 +0000 UTC m=+76.937736636" Jul 23 16:53:50.485153 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:50.485105 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-z7mrq" podStartSLOduration=3.832880346 podStartE2EDuration="10.485091275s" totalImagesPullingTime="6.652210929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:53:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:53:50.484653366 +0000 UTC m=+76.958468782" watchObservedRunningTime="2026-07-23 16:53:50.485091275 +0000 UTC m=+76.958906655" Jul 23 16:53:52.297478 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.297444 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms"] Jul 23 16:53:52.300742 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.300721 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms" Jul 23 16:53:52.306574 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.306555 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 23 16:53:52.309602 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.309584 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pvngc\"" Jul 23 16:53:52.310290 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.310274 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 23 16:53:52.316783 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.316762 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms"] Jul 23 16:53:52.357441 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.357417 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-pr4rx"] Jul 23 16:53:52.360424 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.360409 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:52.363958 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.363929 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 23 16:53:52.364329 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.364308 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 23 16:53:52.364433 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.364309 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ktjbr\"" Jul 23 16:53:52.365026 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.364983 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 23 16:53:52.370841 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.370823 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4958e8fa-0500-46f4-8c4c-fa74cf93bc72-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-n85ms\" (UID: \"4958e8fa-0500-46f4-8c4c-fa74cf93bc72\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms" Jul 23 16:53:52.370946 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.370855 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4958e8fa-0500-46f4-8c4c-fa74cf93bc72-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-n85ms\" (UID: \"4958e8fa-0500-46f4-8c4c-fa74cf93bc72\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms" Jul 23 16:53:52.370946 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.370883 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn465\" (UniqueName: \"kubernetes.io/projected/4958e8fa-0500-46f4-8c4c-fa74cf93bc72-kube-api-access-mn465\") pod \"openshift-state-metrics-79f6958cdf-n85ms\" (UID: \"4958e8fa-0500-46f4-8c4c-fa74cf93bc72\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms" Jul 23 16:53:52.371062 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.370962 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4958e8fa-0500-46f4-8c4c-fa74cf93bc72-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-n85ms\" (UID: \"4958e8fa-0500-46f4-8c4c-fa74cf93bc72\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms" Jul 23 16:53:52.387767 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.387745 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-pr4rx"] Jul 23 16:53:52.391040 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.391020 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kshk6"] Jul 23 16:53:52.394259 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.394243 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.396983 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.396968 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-n9bx6\"" Jul 23 16:53:52.397584 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.397570 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 16:53:52.397664 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.397646 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 16:53:52.397887 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.397870 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 16:53:52.471510 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.471475 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4958e8fa-0500-46f4-8c4c-fa74cf93bc72-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-n85ms\" (UID: \"4958e8fa-0500-46f4-8c4c-fa74cf93bc72\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms" Jul 23 16:53:52.471510 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.471509 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzxjl\" (UniqueName: \"kubernetes.io/projected/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-kube-api-access-pzxjl\") pod \"kube-state-metrics-56c5594674-pr4rx\" (UID: \"8e3c1c31-dc00-4a43-b5cc-bec880c905ea\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:52.471734 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.471527 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-node-exporter-wtmp\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.471734 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.471633 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-pr4rx\" (UID: \"8e3c1c31-dc00-4a43-b5cc-bec880c905ea\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:52.471734 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.471678 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-metrics-client-ca\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.471734 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.471698 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-pr4rx\" (UID: \"8e3c1c31-dc00-4a43-b5cc-bec880c905ea\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:52.471734 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.471723 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-sys\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.471946 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.471740 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-root\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.471946 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.471780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn465\" (UniqueName: \"kubernetes.io/projected/4958e8fa-0500-46f4-8c4c-fa74cf93bc72-kube-api-access-mn465\") pod \"openshift-state-metrics-79f6958cdf-n85ms\" (UID: \"4958e8fa-0500-46f4-8c4c-fa74cf93bc72\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms" Jul 23 16:53:52.471946 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.471805 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-pr4rx\" (UID: \"8e3c1c31-dc00-4a43-b5cc-bec880c905ea\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:52.471946 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.471826 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.471946 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.471844 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4958e8fa-0500-46f4-8c4c-fa74cf93bc72-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-n85ms\" (UID: \"4958e8fa-0500-46f4-8c4c-fa74cf93bc72\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms" Jul 23 16:53:52.471946 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.471862 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-pr4rx\" (UID: \"8e3c1c31-dc00-4a43-b5cc-bec880c905ea\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:52.471946 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.471893 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-pr4rx\" (UID: \"8e3c1c31-dc00-4a43-b5cc-bec880c905ea\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:52.471946 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.471909 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-node-exporter-tls\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.472349 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.471948 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.472349 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.471989 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzlbl\" (UniqueName: \"kubernetes.io/projected/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-kube-api-access-fzlbl\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.472349 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.472042 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-node-exporter-textfile\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.472349 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.472075 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4958e8fa-0500-46f4-8c4c-fa74cf93bc72-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-n85ms\" (UID: \"4958e8fa-0500-46f4-8c4c-fa74cf93bc72\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms" Jul 23 16:53:52.472642 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.472620 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4958e8fa-0500-46f4-8c4c-fa74cf93bc72-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-n85ms\" (UID: \"4958e8fa-0500-46f4-8c4c-fa74cf93bc72\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms" Jul 23 16:53:52.474107 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.474080 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4958e8fa-0500-46f4-8c4c-fa74cf93bc72-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-n85ms\" (UID: \"4958e8fa-0500-46f4-8c4c-fa74cf93bc72\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms" Jul 23 16:53:52.474298 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.474282 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4958e8fa-0500-46f4-8c4c-fa74cf93bc72-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-n85ms\" (UID: \"4958e8fa-0500-46f4-8c4c-fa74cf93bc72\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms" Jul 23 16:53:52.481218 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.481198 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn465\" (UniqueName: \"kubernetes.io/projected/4958e8fa-0500-46f4-8c4c-fa74cf93bc72-kube-api-access-mn465\") pod \"openshift-state-metrics-79f6958cdf-n85ms\" (UID: \"4958e8fa-0500-46f4-8c4c-fa74cf93bc72\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms" Jul 23 16:53:52.573074 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.572955 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-sys\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.573074 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.573025 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-root\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.573074 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.573062 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-pr4rx\" (UID: \"8e3c1c31-dc00-4a43-b5cc-bec880c905ea\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:52.573074 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.573064 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-sys\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.573352 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.573083 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.573352 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.573110 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-root\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.573352 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.573112 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-pr4rx\" (UID: \"8e3c1c31-dc00-4a43-b5cc-bec880c905ea\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:52.573352 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.573143 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-pr4rx\" (UID: \"8e3c1c31-dc00-4a43-b5cc-bec880c905ea\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:52.573352 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.573160 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-node-exporter-tls\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.573352 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.573178 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.573352 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.573207 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzlbl\" (UniqueName: \"kubernetes.io/projected/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-kube-api-access-fzlbl\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.573352 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.573231 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-node-exporter-textfile\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.573352 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.573279 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzxjl\" (UniqueName: \"kubernetes.io/projected/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-kube-api-access-pzxjl\") pod \"kube-state-metrics-56c5594674-pr4rx\" (UID: \"8e3c1c31-dc00-4a43-b5cc-bec880c905ea\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:52.573839 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.573477 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-node-exporter-wtmp\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.573839 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.573520 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-pr4rx\" (UID: \"8e3c1c31-dc00-4a43-b5cc-bec880c905ea\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:52.573839 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.573563 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-metrics-client-ca\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.573839 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.573607 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-pr4rx\" (UID: \"8e3c1c31-dc00-4a43-b5cc-bec880c905ea\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:52.573839 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:52.573721 2574 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 23 16:53:52.573839 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:52.573783 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-kube-state-metrics-tls podName:8e3c1c31-dc00-4a43-b5cc-bec880c905ea nodeName:}" failed. No retries permitted until 2026-07-23 16:53:53.073763634 +0000 UTC m=+79.547578997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-pr4rx" (UID: "8e3c1c31-dc00-4a43-b5cc-bec880c905ea") : secret "kube-state-metrics-tls" not found Jul 23 16:53:52.574156 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.573885 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-node-exporter-textfile\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.574156 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.573903 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.574156 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.573934 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-pr4rx\" (UID: \"8e3c1c31-dc00-4a43-b5cc-bec880c905ea\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:52.574156 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.574061 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-pr4rx\" (UID: \"8e3c1c31-dc00-4a43-b5cc-bec880c905ea\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:52.574156 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.574093 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-node-exporter-wtmp\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.574355 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.574171 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-pr4rx\" (UID: \"8e3c1c31-dc00-4a43-b5cc-bec880c905ea\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:52.574355 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.574311 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-metrics-client-ca\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.575621 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.575592 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-node-exporter-tls\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.575714 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.575689 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.576023 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.575986 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-pr4rx\" (UID: \"8e3c1c31-dc00-4a43-b5cc-bec880c905ea\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:52.594610 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.594581 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzxjl\" (UniqueName: \"kubernetes.io/projected/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-kube-api-access-pzxjl\") pod \"kube-state-metrics-56c5594674-pr4rx\" (UID: \"8e3c1c31-dc00-4a43-b5cc-bec880c905ea\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:52.600411 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.600391 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzlbl\" (UniqueName: \"kubernetes.io/projected/cf37e5cd-7840-4620-bd24-8a9df8b3f5a1-kube-api-access-fzlbl\") pod \"node-exporter-kshk6\" (UID: \"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1\") " pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.609345 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.609331 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms" Jul 23 16:53:52.703359 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.703323 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kshk6" Jul 23 16:53:52.714817 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:53:52.714788 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf37e5cd_7840_4620_bd24_8a9df8b3f5a1.slice/crio-e46df9b7d5e79319a2e6959c4d62b2c4e3e5388590ca8720d474da4e1067dc8e WatchSource:0}: Error finding container e46df9b7d5e79319a2e6959c4d62b2c4e3e5388590ca8720d474da4e1067dc8e: Status 404 returned error can't find the container with id e46df9b7d5e79319a2e6959c4d62b2c4e3e5388590ca8720d474da4e1067dc8e Jul 23 16:53:52.764517 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:52.764492 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms"] Jul 23 16:53:52.768277 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:53:52.768250 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4958e8fa_0500_46f4_8c4c_fa74cf93bc72.slice/crio-05444ef3cc6b698657e7d9d1114fb773c90c9694b76b4c9334e692085f28c060 WatchSource:0}: Error finding container 05444ef3cc6b698657e7d9d1114fb773c90c9694b76b4c9334e692085f28c060: Status 404 returned error can't find the container with id 05444ef3cc6b698657e7d9d1114fb773c90c9694b76b4c9334e692085f28c060 Jul 23 16:53:53.076737 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:53.076652 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-pr4rx\" (UID: \"8e3c1c31-dc00-4a43-b5cc-bec880c905ea\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:53.078958 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:53.078937 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e3c1c31-dc00-4a43-b5cc-bec880c905ea-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-pr4rx\" (UID: \"8e3c1c31-dc00-4a43-b5cc-bec880c905ea\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:53.268962 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:53.268927 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" Jul 23 16:53:53.416441 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:53.416401 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms" event={"ID":"4958e8fa-0500-46f4-8c4c-fa74cf93bc72","Type":"ContainerStarted","Data":"f2d0027e5f25809ef05bbf27cfacd8c4710feef74797ddf83ff9f2c56e4a5465"} Jul 23 16:53:53.416870 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:53.416468 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms" event={"ID":"4958e8fa-0500-46f4-8c4c-fa74cf93bc72","Type":"ContainerStarted","Data":"7e9c95f389420c50353813f95284ae0fad46ad7fa0d320f288e2478eadea730b"} Jul 23 16:53:53.416870 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:53.416524 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms" event={"ID":"4958e8fa-0500-46f4-8c4c-fa74cf93bc72","Type":"ContainerStarted","Data":"05444ef3cc6b698657e7d9d1114fb773c90c9694b76b4c9334e692085f28c060"} Jul 23 16:53:53.417708 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:53.417684 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kshk6" event={"ID":"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1","Type":"ContainerStarted","Data":"e46df9b7d5e79319a2e6959c4d62b2c4e3e5388590ca8720d474da4e1067dc8e"} Jul 23 16:53:53.443969 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:53.443944 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-pr4rx"] Jul 23 16:53:53.446176 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:53:53.446154 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e3c1c31_dc00_4a43_b5cc_bec880c905ea.slice/crio-2a3a1fe053070e479d907f93f8e8f8b0f3aa0feb7ec445977423a2e5453c827d WatchSource:0}: Error finding container 2a3a1fe053070e479d907f93f8e8f8b0f3aa0feb7ec445977423a2e5453c827d: Status 404 returned error can't find the container with id 2a3a1fe053070e479d907f93f8e8f8b0f3aa0feb7ec445977423a2e5453c827d Jul 23 16:53:54.049720 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.049694 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 16:53:54.051970 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.051914 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.094695 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.094667 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w2j86\"" Jul 23 16:53:54.095052 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.095021 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 23 16:53:54.097693 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.097670 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 23 16:53:54.101729 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.101659 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 23 16:53:54.101729 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.101685 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 23 16:53:54.101887 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.101802 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 23 16:53:54.101944 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.101907 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 23 16:53:54.102029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.101976 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 23 16:53:54.103313 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.103295 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 23 16:53:54.106800 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.106781 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 23 16:53:54.144115 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.144062 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 16:53:54.186230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.186196 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.186389 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.186244 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.186389 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.186316 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.186389 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.186370 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-web-config\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.186545 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.186415 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-config-out\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.186545 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.186442 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64bzt\" (UniqueName: \"kubernetes.io/projected/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-kube-api-access-64bzt\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.186545 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.186505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.186696 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.186546 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.186696 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.186577 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.186696 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.186623 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.186696 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.186662 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.186696 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.186694 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.186931 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.186738 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-config-volume\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.210526 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:53:54.210494 2574 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf37e5cd_7840_4620_bd24_8a9df8b3f5a1.slice/crio-3829b4088c9ad46714f41a1f09044590bbeadd5fad4219c37a24d6050ffb3f36.scope\": RecentStats: unable to find data in memory cache]" Jul 23 16:53:54.287971 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.287938 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-config-volume\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.288176 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.287974 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.288176 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.288016 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.288176 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.288147 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.288312 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.288184 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-web-config\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.288312 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.288222 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-config-out\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.288312 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.288247 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64bzt\" (UniqueName: \"kubernetes.io/projected/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-kube-api-access-64bzt\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.288312 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.288280 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.288529 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.288318 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.288529 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.288352 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.288529 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.288401 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.288529 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.288437 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.288529 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.288470 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.288780 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.288565 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.289826 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.289477 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.289961 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.289866 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.291141 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.291100 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.291263 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.291239 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-config-volume\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.291347 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.291262 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.291864 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.291677 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-web-config\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.291981 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.291958 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.292081 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.292060 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.292360 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.292338 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-config-out\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.292463 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.292444 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.292784 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.292766 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.304728 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.304677 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64bzt\" (UniqueName: \"kubernetes.io/projected/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-kube-api-access-64bzt\") pod \"alertmanager-main-0\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.361987 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.361957 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:53:54.426956 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.426925 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms" event={"ID":"4958e8fa-0500-46f4-8c4c-fa74cf93bc72","Type":"ContainerStarted","Data":"cd0a604072ea53bd40420f3ab8f78e6c2c3de82c9c28f21c7a9a1a618d90273c"} Jul 23 16:53:54.428946 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.428916 2574 generic.go:356] "Generic (PLEG): container finished" podID="cf37e5cd-7840-4620-bd24-8a9df8b3f5a1" containerID="3829b4088c9ad46714f41a1f09044590bbeadd5fad4219c37a24d6050ffb3f36" exitCode=0 Jul 23 16:53:54.429094 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.429032 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kshk6" event={"ID":"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1","Type":"ContainerDied","Data":"3829b4088c9ad46714f41a1f09044590bbeadd5fad4219c37a24d6050ffb3f36"} Jul 23 16:53:54.431364 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.431301 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" event={"ID":"8e3c1c31-dc00-4a43-b5cc-bec880c905ea","Type":"ContainerStarted","Data":"2a3a1fe053070e479d907f93f8e8f8b0f3aa0feb7ec445977423a2e5453c827d"} Jul 23 16:53:54.459865 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.459810 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-n85ms" podStartSLOduration=1.286053859 podStartE2EDuration="2.459789606s" totalImagesPullingTime="1.173735747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:53:54.458556285 +0000 UTC m=+80.932371678" watchObservedRunningTime="2026-07-23 16:53:54.459789606 +0000 UTC m=+80.933604990" Jul 23 16:53:54.560204 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:53:54.560174 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe6ec84a_3e3f_4fd0_b755_70e2798d3eeb.slice/crio-7b574c0e3ec0eacabc0c816eaccbc14ca60188273251118e5e0ec1d8ec2bd403 WatchSource:0}: Error finding container 7b574c0e3ec0eacabc0c816eaccbc14ca60188273251118e5e0ec1d8ec2bd403: Status 404 returned error can't find the container with id 7b574c0e3ec0eacabc0c816eaccbc14ca60188273251118e5e0ec1d8ec2bd403 Jul 23 16:53:54.560980 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:54.560883 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 16:53:55.436947 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:55.436859 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb","Type":"ContainerStarted","Data":"7b574c0e3ec0eacabc0c816eaccbc14ca60188273251118e5e0ec1d8ec2bd403"} Jul 23 16:53:55.439332 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:55.439297 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kshk6" event={"ID":"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1","Type":"ContainerStarted","Data":"d50c9da38c79879a044f228f71a82b109734efbeeaeb39f5ad0731b1138d6273"} Jul 23 16:53:55.439483 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:55.439356 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kshk6" event={"ID":"cf37e5cd-7840-4620-bd24-8a9df8b3f5a1","Type":"ContainerStarted","Data":"29f1e1c173e13f48f324adba6d782ae7702c685c6c4ae17da8180d89d5b84ee8"} Jul 23 16:53:55.441444 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:55.441381 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" event={"ID":"8e3c1c31-dc00-4a43-b5cc-bec880c905ea","Type":"ContainerStarted","Data":"7daa515aadcbfc88ddfaf887a393b1dfca79eea18461a129d7ca0e15d5a62612"} Jul 23 16:53:55.441444 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:55.441438 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" event={"ID":"8e3c1c31-dc00-4a43-b5cc-bec880c905ea","Type":"ContainerStarted","Data":"90c18027e67e62e0ff7827ffb3e82d2c82511f09b054e58c50939ebdc5e87816"} Jul 23 16:53:55.441633 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:55.441469 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" event={"ID":"8e3c1c31-dc00-4a43-b5cc-bec880c905ea","Type":"ContainerStarted","Data":"1cca42236a1a603d30fcf75da1279e0ed9efa112031776aa902fea34bba6cc1c"} Jul 23 16:53:55.511813 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:55.511677 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kshk6" podStartSLOduration=2.10349938 podStartE2EDuration="3.511657028s" totalImagesPullingTime="1.330906206s" totalInitContainerRuntime="77.251442ms" isStatefulPod=true podCreationTimestamp="2026-07-23 16:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:53:55.469479468 +0000 UTC m=+81.943294851" watchObservedRunningTime="2026-07-23 16:53:55.511657028 +0000 UTC m=+81.985472410" Jul 23 16:53:55.512149 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:55.512117 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-pr4rx" podStartSLOduration=1.94295864 podStartE2EDuration="3.5121097s" totalImagesPullingTime="1.56915106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:53:55.510457266 +0000 UTC m=+81.984272648" watchObservedRunningTime="2026-07-23 16:53:55.5121097 +0000 UTC m=+81.985925091" Jul 23 16:53:55.957743 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:55.956617 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-69d74c6f46-rj9p9"] Jul 23 16:53:55.961803 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:55.961779 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:55.967350 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:55.967327 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 23 16:53:55.967350 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:55.967344 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 23 16:53:55.967618 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:55.967600 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2svcud9aa3she\"" Jul 23 16:53:55.967671 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:55.967600 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-25c59\"" Jul 23 16:53:55.967841 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:55.967828 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 23 16:53:55.971074 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:55.971051 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 23 16:53:55.971283 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:55.971270 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 23 16:53:56.000626 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.000555 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69d74c6f46-rj9p9"] Jul 23 16:53:56.104764 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.104728 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/826aa3e1-e923-478a-8a23-e156d85ebd14-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.104764 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.104764 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/826aa3e1-e923-478a-8a23-e156d85ebd14-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.104962 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.104787 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/826aa3e1-e923-478a-8a23-e156d85ebd14-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.104962 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.104803 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/826aa3e1-e923-478a-8a23-e156d85ebd14-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.104962 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.104891 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/826aa3e1-e923-478a-8a23-e156d85ebd14-secret-grpc-tls\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.104962 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.104927 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnplz\" (UniqueName: \"kubernetes.io/projected/826aa3e1-e923-478a-8a23-e156d85ebd14-kube-api-access-tnplz\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.105113 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.104961 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/826aa3e1-e923-478a-8a23-e156d85ebd14-secret-thanos-querier-tls\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.105113 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.104994 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/826aa3e1-e923-478a-8a23-e156d85ebd14-metrics-client-ca\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.205594 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.205557 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/826aa3e1-e923-478a-8a23-e156d85ebd14-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.205594 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.205594 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/826aa3e1-e923-478a-8a23-e156d85ebd14-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.205813 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.205617 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/826aa3e1-e923-478a-8a23-e156d85ebd14-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.205813 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.205635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/826aa3e1-e923-478a-8a23-e156d85ebd14-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.205813 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.205682 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/826aa3e1-e923-478a-8a23-e156d85ebd14-secret-grpc-tls\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.205813 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.205716 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnplz\" (UniqueName: \"kubernetes.io/projected/826aa3e1-e923-478a-8a23-e156d85ebd14-kube-api-access-tnplz\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.205813 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.205748 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/826aa3e1-e923-478a-8a23-e156d85ebd14-secret-thanos-querier-tls\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.206050 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.205871 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/826aa3e1-e923-478a-8a23-e156d85ebd14-metrics-client-ca\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.206698 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.206669 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/826aa3e1-e923-478a-8a23-e156d85ebd14-metrics-client-ca\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.208373 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.208344 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/826aa3e1-e923-478a-8a23-e156d85ebd14-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.208452 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.208403 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/826aa3e1-e923-478a-8a23-e156d85ebd14-secret-thanos-querier-tls\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.208613 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.208590 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/826aa3e1-e923-478a-8a23-e156d85ebd14-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.208648 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.208626 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/826aa3e1-e923-478a-8a23-e156d85ebd14-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.208725 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.208704 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/826aa3e1-e923-478a-8a23-e156d85ebd14-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.208803 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.208787 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/826aa3e1-e923-478a-8a23-e156d85ebd14-secret-grpc-tls\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.220710 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.220693 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnplz\" (UniqueName: \"kubernetes.io/projected/826aa3e1-e923-478a-8a23-e156d85ebd14-kube-api-access-tnplz\") pod \"thanos-querier-69d74c6f46-rj9p9\" (UID: \"826aa3e1-e923-478a-8a23-e156d85ebd14\") " pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.270816 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.270756 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:53:56.424848 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.424795 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69d74c6f46-rj9p9"] Jul 23 16:53:56.426939 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:53:56.426915 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod826aa3e1_e923_478a_8a23_e156d85ebd14.slice/crio-2dc9e327d756a62bb0bd39455b7bf9891404edc038b66f5dfee0ca2631c107ae WatchSource:0}: Error finding container 2dc9e327d756a62bb0bd39455b7bf9891404edc038b66f5dfee0ca2631c107ae: Status 404 returned error can't find the container with id 2dc9e327d756a62bb0bd39455b7bf9891404edc038b66f5dfee0ca2631c107ae Jul 23 16:53:56.446782 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.446755 2574 generic.go:356] "Generic (PLEG): container finished" podID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerID="33e3d1066ad0de9ab1750bac93fe08cbeca59f2d504a4b6eeafbb785e92324ea" exitCode=0 Jul 23 16:53:56.447235 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.446839 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb","Type":"ContainerDied","Data":"33e3d1066ad0de9ab1750bac93fe08cbeca59f2d504a4b6eeafbb785e92324ea"} Jul 23 16:53:56.448118 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:56.448097 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" event={"ID":"826aa3e1-e923-478a-8a23-e156d85ebd14","Type":"ContainerStarted","Data":"2dc9e327d756a62bb0bd39455b7bf9891404edc038b66f5dfee0ca2631c107ae"} Jul 23 16:53:57.054199 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.054163 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-758548d448-6x4t4"] Jul 23 16:53:57.058887 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.058864 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.078090 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.078070 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vx6s6\"" Jul 23 16:53:57.078828 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.078801 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 23 16:53:57.078951 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.078879 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 23 16:53:57.079058 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.079043 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 23 16:53:57.093210 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.093184 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 23 16:53:57.093407 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.093390 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dc4e3f04hjttp\"" Jul 23 16:53:57.114745 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.114722 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb887d03-cc33-480b-ab2a-c533d6837b63-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.114887 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.114748 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fb887d03-cc33-480b-ab2a-c533d6837b63-metrics-server-audit-profiles\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.114887 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.114775 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fb887d03-cc33-480b-ab2a-c533d6837b63-secret-metrics-server-client-certs\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.114887 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.114799 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb887d03-cc33-480b-ab2a-c533d6837b63-client-ca-bundle\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.114887 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.114869 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fb887d03-cc33-480b-ab2a-c533d6837b63-secret-metrics-server-tls\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.115102 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.114955 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxbt8\" (UniqueName: \"kubernetes.io/projected/fb887d03-cc33-480b-ab2a-c533d6837b63-kube-api-access-rxbt8\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.115102 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.114993 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fb887d03-cc33-480b-ab2a-c533d6837b63-audit-log\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.124054 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.124031 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-758548d448-6x4t4"] Jul 23 16:53:57.215687 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.215649 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb887d03-cc33-480b-ab2a-c533d6837b63-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.215687 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.215698 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fb887d03-cc33-480b-ab2a-c533d6837b63-metrics-server-audit-profiles\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.215904 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.215852 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fb887d03-cc33-480b-ab2a-c533d6837b63-secret-metrics-server-client-certs\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.215955 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.215920 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb887d03-cc33-480b-ab2a-c533d6837b63-client-ca-bundle\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.216030 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.215951 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fb887d03-cc33-480b-ab2a-c533d6837b63-secret-metrics-server-tls\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.216030 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.215995 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxbt8\" (UniqueName: \"kubernetes.io/projected/fb887d03-cc33-480b-ab2a-c533d6837b63-kube-api-access-rxbt8\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.216152 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.216056 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fb887d03-cc33-480b-ab2a-c533d6837b63-audit-log\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.216644 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.216616 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb887d03-cc33-480b-ab2a-c533d6837b63-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.216880 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.216857 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fb887d03-cc33-480b-ab2a-c533d6837b63-audit-log\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.216980 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.216867 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fb887d03-cc33-480b-ab2a-c533d6837b63-metrics-server-audit-profiles\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.218746 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.218714 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fb887d03-cc33-480b-ab2a-c533d6837b63-secret-metrics-server-client-certs\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.219293 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.219269 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb887d03-cc33-480b-ab2a-c533d6837b63-client-ca-bundle\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.219424 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.219362 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fb887d03-cc33-480b-ab2a-c533d6837b63-secret-metrics-server-tls\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.329581 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.329473 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxbt8\" (UniqueName: \"kubernetes.io/projected/fb887d03-cc33-480b-ab2a-c533d6837b63-kube-api-access-rxbt8\") pod \"metrics-server-758548d448-6x4t4\" (UID: \"fb887d03-cc33-480b-ab2a-c533d6837b63\") " pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.368091 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.368058 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:53:57.402655 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.402617 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np7l7"] Jul 23 16:53:57.407699 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.407324 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np7l7" Jul 23 16:53:57.427206 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.427168 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rtzhj\"" Jul 23 16:53:57.427641 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.427460 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 23 16:53:57.477819 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.475367 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np7l7"] Jul 23 16:53:57.518357 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.518320 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2drmn\" (UniqueName: \"kubernetes.io/projected/dccc051c-b8fb-4c76-904e-52fa96dc73b4-kube-api-access-2drmn\") pod \"monitoring-plugin-7b7b7bc8bf-np7l7\" (UID: \"dccc051c-b8fb-4c76-904e-52fa96dc73b4\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np7l7" Jul 23 16:53:57.518510 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.518402 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dccc051c-b8fb-4c76-904e-52fa96dc73b4-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-np7l7\" (UID: \"dccc051c-b8fb-4c76-904e-52fa96dc73b4\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np7l7" Jul 23 16:53:57.609740 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:53:57.609688 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb887d03_cc33_480b_ab2a_c533d6837b63.slice/crio-5056b051c94c1d7712d930c5943790566d0cb00e1244735d7cd2b9fe05435a43 WatchSource:0}: Error finding container 5056b051c94c1d7712d930c5943790566d0cb00e1244735d7cd2b9fe05435a43: Status 404 returned error can't find the container with id 5056b051c94c1d7712d930c5943790566d0cb00e1244735d7cd2b9fe05435a43 Jul 23 16:53:57.610412 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.610390 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b859b9586-n8pjc"] Jul 23 16:53:57.614136 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.614111 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-758548d448-6x4t4"] Jul 23 16:53:57.614256 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.614241 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.619755 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.619734 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dccc051c-b8fb-4c76-904e-52fa96dc73b4-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-np7l7\" (UID: \"dccc051c-b8fb-4c76-904e-52fa96dc73b4\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np7l7" Jul 23 16:53:57.619858 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.619825 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2drmn\" (UniqueName: \"kubernetes.io/projected/dccc051c-b8fb-4c76-904e-52fa96dc73b4-kube-api-access-2drmn\") pod \"monitoring-plugin-7b7b7bc8bf-np7l7\" (UID: \"dccc051c-b8fb-4c76-904e-52fa96dc73b4\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np7l7" Jul 23 16:53:57.622625 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.622595 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dccc051c-b8fb-4c76-904e-52fa96dc73b4-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-np7l7\" (UID: \"dccc051c-b8fb-4c76-904e-52fa96dc73b4\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np7l7" Jul 23 16:53:57.646933 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.646901 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2drmn\" (UniqueName: \"kubernetes.io/projected/dccc051c-b8fb-4c76-904e-52fa96dc73b4-kube-api-access-2drmn\") pod \"monitoring-plugin-7b7b7bc8bf-np7l7\" (UID: \"dccc051c-b8fb-4c76-904e-52fa96dc73b4\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np7l7" Jul 23 16:53:57.659738 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.659701 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b859b9586-n8pjc"] Jul 23 16:53:57.720068 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.720032 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np7l7" Jul 23 16:53:57.720327 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.720291 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-trusted-ca-bundle\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.720460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.720351 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-service-ca\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.720460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.720396 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-console-serving-cert\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.720460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.720454 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svnzp\" (UniqueName: \"kubernetes.io/projected/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-kube-api-access-svnzp\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.720617 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.720510 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-oauth-serving-cert\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.720617 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.720547 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-console-config\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.720712 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.720613 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-console-oauth-config\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.821616 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.821453 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-console-config\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.821616 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.821517 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-console-oauth-config\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.821616 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.821553 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-trusted-ca-bundle\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.821616 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.821605 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-service-ca\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.822546 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.821941 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-console-serving-cert\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.822647 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.822589 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-trusted-ca-bundle\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.823107 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.822794 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svnzp\" (UniqueName: \"kubernetes.io/projected/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-kube-api-access-svnzp\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.823107 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.822943 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-oauth-serving-cert\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.823667 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.823622 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-service-ca\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.823952 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.823910 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-console-config\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.824159 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.824141 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-oauth-serving-cert\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.825070 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.825033 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-console-serving-cert\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.825272 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.825249 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-console-oauth-config\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.839524 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.839469 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svnzp\" (UniqueName: \"kubernetes.io/projected/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-kube-api-access-svnzp\") pod \"console-b859b9586-n8pjc\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:57.893860 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.893783 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np7l7"] Jul 23 16:53:57.900202 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:53:57.900170 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddccc051c_b8fb_4c76_904e_52fa96dc73b4.slice/crio-0793d64341db873da01974dc6c76cfa8a14de22733c5cbba50ea9c54ba040277 WatchSource:0}: Error finding container 0793d64341db873da01974dc6c76cfa8a14de22733c5cbba50ea9c54ba040277: Status 404 returned error can't find the container with id 0793d64341db873da01974dc6c76cfa8a14de22733c5cbba50ea9c54ba040277 Jul 23 16:53:57.934431 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:57.934398 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:53:58.105234 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:58.105207 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b859b9586-n8pjc"] Jul 23 16:53:58.461409 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:58.461373 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np7l7" event={"ID":"dccc051c-b8fb-4c76-904e-52fa96dc73b4","Type":"ContainerStarted","Data":"0793d64341db873da01974dc6c76cfa8a14de22733c5cbba50ea9c54ba040277"} Jul 23 16:53:58.462643 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:58.462605 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-758548d448-6x4t4" event={"ID":"fb887d03-cc33-480b-ab2a-c533d6837b63","Type":"ContainerStarted","Data":"5056b051c94c1d7712d930c5943790566d0cb00e1244735d7cd2b9fe05435a43"} Jul 23 16:53:59.010112 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:53:59.010070 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod341ca8ba_a4ea_4e63_aba7_fde9b84c9589.slice/crio-53c706c5f8ce44828f9bdf9d1bb23b8034deaf5f3b5fd45226a74c1bf2090f72 WatchSource:0}: Error finding container 53c706c5f8ce44828f9bdf9d1bb23b8034deaf5f3b5fd45226a74c1bf2090f72: Status 404 returned error can't find the container with id 53c706c5f8ce44828f9bdf9d1bb23b8034deaf5f3b5fd45226a74c1bf2090f72 Jul 23 16:53:59.473626 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.473552 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b859b9586-n8pjc" event={"ID":"341ca8ba-a4ea-4e63-aba7-fde9b84c9589","Type":"ContainerStarted","Data":"53c706c5f8ce44828f9bdf9d1bb23b8034deaf5f3b5fd45226a74c1bf2090f72"} Jul 23 16:53:59.480190 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.480140 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 16:53:59.488771 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.488741 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.498358 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.497987 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 23 16:53:59.499749 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.499721 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 23 16:53:59.501774 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.501750 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 23 16:53:59.502312 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.502282 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 23 16:53:59.502312 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.502288 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 23 16:53:59.515619 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.515588 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 23 16:53:59.515774 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.515764 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 23 16:53:59.516634 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.515883 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 23 16:53:59.516634 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.515764 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1k5krv8uh7n65\"" Jul 23 16:53:59.516634 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.516052 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 23 16:53:59.516634 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.516116 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 23 16:53:59.516634 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.516359 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8spwt\"" Jul 23 16:53:59.516634 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.516375 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 23 16:53:59.516634 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.516543 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 23 16:53:59.517048 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.516875 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 23 16:53:59.538850 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.538819 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 23 16:53:59.567159 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.567125 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 16:53:59.642458 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.642416 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/210211fd-9035-40be-a4ec-b9660171703d-config-out\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.642646 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.642510 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.642646 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.642589 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.642646 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.642627 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.642864 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.642650 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.642864 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.642673 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.642864 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.642696 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.642864 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.642744 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/210211fd-9035-40be-a4ec-b9660171703d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.642864 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.642768 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.642864 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.642834 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.643172 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.642885 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.643172 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.642915 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.643172 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.642941 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.643172 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.642975 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.643172 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.643025 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-config\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.643172 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.643050 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.643172 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.643080 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.643172 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.643102 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45xwp\" (UniqueName: \"kubernetes.io/projected/210211fd-9035-40be-a4ec-b9660171703d-kube-api-access-45xwp\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.643437 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.643185 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-web-config\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.643437 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.643226 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.743957 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.743856 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-config\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.743957 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.743908 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.743957 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.743940 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.744245 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.743962 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45xwp\" (UniqueName: \"kubernetes.io/projected/210211fd-9035-40be-a4ec-b9660171703d-kube-api-access-45xwp\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.744245 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.744022 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-web-config\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.744245 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.744044 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.744245 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.744073 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/210211fd-9035-40be-a4ec-b9660171703d-config-out\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.744245 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.744095 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.744245 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.744130 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.744245 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.744191 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.744923 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.744897 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.745044 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.744897 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.745044 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.744968 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.745044 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.744994 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.745044 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.745040 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.745259 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.745085 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/210211fd-9035-40be-a4ec-b9660171703d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.745259 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.745109 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.745259 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.745140 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.745259 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.745178 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.745259 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.745205 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.745259 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.745234 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.745542 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.745274 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.745542 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.745367 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.746303 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.745951 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.748071 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.747498 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.748071 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.747710 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.748216 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.748157 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.749278 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.749251 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.749985 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.749958 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-config\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.749985 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.749973 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.750155 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.750132 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.750362 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.750320 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.750522 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.750475 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.750614 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.750561 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.751111 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.750908 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/210211fd-9035-40be-a4ec-b9660171703d-config-out\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.751111 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.751077 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-web-config\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.751253 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.751175 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.752502 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.752480 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.752584 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.752565 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/210211fd-9035-40be-a4ec-b9660171703d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.761423 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.761378 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45xwp\" (UniqueName: \"kubernetes.io/projected/210211fd-9035-40be-a4ec-b9660171703d-kube-api-access-45xwp\") pod \"prometheus-k8s-0\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:53:59.803053 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:53:59.802892 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:54:00.211605 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:00.211513 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 16:54:00.222142 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:54:00.220679 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod210211fd_9035_40be_a4ec_b9660171703d.slice/crio-edf91d16a97b5c3f8a48aa31454a9de3399b789b8e1442016c82ce356efb9237 WatchSource:0}: Error finding container edf91d16a97b5c3f8a48aa31454a9de3399b789b8e1442016c82ce356efb9237: Status 404 returned error can't find the container with id edf91d16a97b5c3f8a48aa31454a9de3399b789b8e1442016c82ce356efb9237 Jul 23 16:54:00.479198 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:00.479156 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-758548d448-6x4t4" event={"ID":"fb887d03-cc33-480b-ab2a-c533d6837b63","Type":"ContainerStarted","Data":"4e3e3319fc2843b42fbafdd032e59338c03f0739a1584a674353c7c33634662c"} Jul 23 16:54:00.482293 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:00.482265 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb","Type":"ContainerStarted","Data":"9fa80aa89a002159f897284f4c39b5a362ed8781ae8cf3a8d6882dd1eb736cb2"} Jul 23 16:54:00.482439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:00.482326 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb","Type":"ContainerStarted","Data":"5a9a1e88b40abeaee36d2a2ce94150659779a7a26119f3957cf8c1c7a383d876"} Jul 23 16:54:00.482439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:00.482361 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb","Type":"ContainerStarted","Data":"fa16df97d467c0c489e92b4bf7f94e29ff71c6b1fe964ee8c6822eb3203fd932"} Jul 23 16:54:00.482439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:00.482387 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb","Type":"ContainerStarted","Data":"42aa0d9593e469015cbc47b4247b4ebe7850058c671f6a416ab561af1e15b0b9"} Jul 23 16:54:00.482439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:00.482408 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb","Type":"ContainerStarted","Data":"5cd4baf06e31c5a5efb71b97865457c9e3804724639b9408718c9a1cfae18bb0"} Jul 23 16:54:00.483736 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:00.483706 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np7l7" event={"ID":"dccc051c-b8fb-4c76-904e-52fa96dc73b4","Type":"ContainerStarted","Data":"543349a7daf809ac18e3c6b081e637c090523d8766803cb4f488ce9a38b61701"} Jul 23 16:54:00.483862 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:00.483835 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np7l7" Jul 23 16:54:00.485375 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:00.485356 2574 generic.go:356] "Generic (PLEG): container finished" podID="210211fd-9035-40be-a4ec-b9660171703d" containerID="809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0" exitCode=0 Jul 23 16:54:00.485505 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:00.485443 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210211fd-9035-40be-a4ec-b9660171703d","Type":"ContainerDied","Data":"809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0"} Jul 23 16:54:00.485567 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:00.485512 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210211fd-9035-40be-a4ec-b9660171703d","Type":"ContainerStarted","Data":"edf91d16a97b5c3f8a48aa31454a9de3399b789b8e1442016c82ce356efb9237"} Jul 23 16:54:00.487200 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:00.487174 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b859b9586-n8pjc" event={"ID":"341ca8ba-a4ea-4e63-aba7-fde9b84c9589","Type":"ContainerStarted","Data":"59cf91c630e31a5744240cbaef65bf7918f47216af3326226a0c4e8685abb990"} Jul 23 16:54:00.489502 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:00.489472 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" event={"ID":"826aa3e1-e923-478a-8a23-e156d85ebd14","Type":"ContainerStarted","Data":"5760c3b0b9b71182a31ef76bebf10a18e850908d4698eac9e15b234472023a40"} Jul 23 16:54:00.489604 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:00.489537 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" event={"ID":"826aa3e1-e923-478a-8a23-e156d85ebd14","Type":"ContainerStarted","Data":"80927dc2c4c98e472b94058dd367613131b0d2a26b60e7979ece4800a6c94edb"} Jul 23 16:54:00.489604 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:00.489597 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np7l7" Jul 23 16:54:00.489706 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:00.489612 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" event={"ID":"826aa3e1-e923-478a-8a23-e156d85ebd14","Type":"ContainerStarted","Data":"1eaf2991eb18a7e3b03da5468e39d58cb4eaa4aed27759d993fbfa77586752c8"} Jul 23 16:54:00.598731 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:00.598625 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-758548d448-6x4t4" podStartSLOduration=1.271763699 podStartE2EDuration="3.598609206s" totalImagesPullingTime="2.326845507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:54:00.517286407 +0000 UTC m=+86.991101787" watchObservedRunningTime="2026-07-23 16:54:00.598609206 +0000 UTC m=+87.072424587" Jul 23 16:54:00.746348 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:00.746294 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b859b9586-n8pjc" podStartSLOduration=3.7462766419999998 podStartE2EDuration="3.746276642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:53:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:54:00.690717489 +0000 UTC m=+87.164532870" watchObservedRunningTime="2026-07-23 16:54:00.746276642 +0000 UTC m=+87.220092001" Jul 23 16:54:01.500700 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:01.500656 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb","Type":"ContainerStarted","Data":"51f91743947b4c005d9af1610de64f1c197ef4eeea5e80fc7cc7a0c95e1a8775"} Jul 23 16:54:01.504056 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:01.504024 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" event={"ID":"826aa3e1-e923-478a-8a23-e156d85ebd14","Type":"ContainerStarted","Data":"eda12a54aaad82eaa391d5015abc2426b3e48a892df1a4eb0f8b2d8233dac58c"} Jul 23 16:54:01.504190 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:01.504096 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" event={"ID":"826aa3e1-e923-478a-8a23-e156d85ebd14","Type":"ContainerStarted","Data":"92288a39356574820fae4cd26d01043c71646f4ca0c9a6b7e6c8c39e3560e376"} Jul 23 16:54:01.504190 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:01.504129 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" event={"ID":"826aa3e1-e923-478a-8a23-e156d85ebd14","Type":"ContainerStarted","Data":"bf6cd7beb7fbdac69e4b6b7b73566e246c8294005be3e3883f5449965acc85eb"} Jul 23 16:54:01.642908 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:01.642847 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.187387573 podStartE2EDuration="7.64282494s" totalImagesPullingTime="5.437623966s" totalInitContainerRuntime="17.813401ms" isStatefulPod=false podCreationTimestamp="2026-07-23 16:53:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:54:01.642345121 +0000 UTC m=+88.116160541" watchObservedRunningTime="2026-07-23 16:54:01.64282494 +0000 UTC m=+88.116640325" Jul 23 16:54:01.643595 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:01.643544 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-np7l7" podStartSLOduration=2.60285402 podStartE2EDuration="4.643533399s" totalImagesPullingTime="2.040679379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:54:00.745885305 +0000 UTC m=+87.219700699" watchObservedRunningTime="2026-07-23 16:54:01.643533399 +0000 UTC m=+88.117348782" Jul 23 16:54:02.509453 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:02.509420 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:54:04.522604 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:04.522568 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210211fd-9035-40be-a4ec-b9660171703d","Type":"ContainerStarted","Data":"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf"} Jul 23 16:54:04.522944 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:04.522632 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210211fd-9035-40be-a4ec-b9660171703d","Type":"ContainerStarted","Data":"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299"} Jul 23 16:54:04.522944 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:04.522657 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210211fd-9035-40be-a4ec-b9660171703d","Type":"ContainerStarted","Data":"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73"} Jul 23 16:54:04.522944 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:04.522682 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210211fd-9035-40be-a4ec-b9660171703d","Type":"ContainerStarted","Data":"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd"} Jul 23 16:54:04.522944 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:04.522705 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210211fd-9035-40be-a4ec-b9660171703d","Type":"ContainerStarted","Data":"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998"} Jul 23 16:54:04.522944 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:04.522729 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210211fd-9035-40be-a4ec-b9660171703d","Type":"ContainerStarted","Data":"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068"} Jul 23 16:54:04.604359 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:04.604299 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" podStartSLOduration=5.116917879 podStartE2EDuration="9.604248844s" totalImagesPullingTime="4.487330965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:53:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:54:01.729791644 +0000 UTC m=+88.203607032" watchObservedRunningTime="2026-07-23 16:54:04.604248844 +0000 UTC m=+91.078064264" Jul 23 16:54:04.604943 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:04.604896 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.620450187 podStartE2EDuration="5.604884871s" totalImagesPullingTime="2.96292682s" totalInitContainerRuntime="21.507864ms" isStatefulPod=false podCreationTimestamp="2026-07-23 16:53:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:54:04.603713273 +0000 UTC m=+91.077528693" watchObservedRunningTime="2026-07-23 16:54:04.604884871 +0000 UTC m=+91.078700245" Jul 23 16:54:04.803925 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:04.803826 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:54:07.935363 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:07.935329 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:54:07.935821 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:07.935388 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:54:07.939836 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:07.939819 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:54:08.519206 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:08.519181 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-69d74c6f46-rj9p9" Jul 23 16:54:08.543719 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:08.543694 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:54:08.752751 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:08.752723 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fbf9f6595-mb7sl"] Jul 23 16:54:12.469435 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:12.469385 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-566694b65c-64cjg" podUID="08ebdcca-a950-49f5-aa27-5676082fecd6" containerName="console" containerID="cri-o://767a5ae214f914b1377af6d5e20236b2555d086421c74d88e87c48c7eb19ce45" gracePeriod=15 Jul 23 16:54:13.305828 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.305798 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:54:13.388899 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.388868 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08ebdcca-a950-49f5-aa27-5676082fecd6-oauth-serving-cert\") pod \"08ebdcca-a950-49f5-aa27-5676082fecd6\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " Jul 23 16:54:13.388899 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.388904 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kxqz\" (UniqueName: \"kubernetes.io/projected/08ebdcca-a950-49f5-aa27-5676082fecd6-kube-api-access-5kxqz\") pod \"08ebdcca-a950-49f5-aa27-5676082fecd6\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " Jul 23 16:54:13.389160 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.388941 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08ebdcca-a950-49f5-aa27-5676082fecd6-console-oauth-config\") pod \"08ebdcca-a950-49f5-aa27-5676082fecd6\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " Jul 23 16:54:13.389160 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.388965 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08ebdcca-a950-49f5-aa27-5676082fecd6-console-serving-cert\") pod \"08ebdcca-a950-49f5-aa27-5676082fecd6\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " Jul 23 16:54:13.389160 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.389043 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08ebdcca-a950-49f5-aa27-5676082fecd6-console-config\") pod \"08ebdcca-a950-49f5-aa27-5676082fecd6\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " Jul 23 16:54:13.389160 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.389069 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08ebdcca-a950-49f5-aa27-5676082fecd6-service-ca\") pod \"08ebdcca-a950-49f5-aa27-5676082fecd6\" (UID: \"08ebdcca-a950-49f5-aa27-5676082fecd6\") " Jul 23 16:54:13.389420 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.389391 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08ebdcca-a950-49f5-aa27-5676082fecd6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "08ebdcca-a950-49f5-aa27-5676082fecd6" (UID: "08ebdcca-a950-49f5-aa27-5676082fecd6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:54:13.389571 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.389495 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08ebdcca-a950-49f5-aa27-5676082fecd6-console-config" (OuterVolumeSpecName: "console-config") pod "08ebdcca-a950-49f5-aa27-5676082fecd6" (UID: "08ebdcca-a950-49f5-aa27-5676082fecd6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:54:13.389637 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.389598 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08ebdcca-a950-49f5-aa27-5676082fecd6-service-ca" (OuterVolumeSpecName: "service-ca") pod "08ebdcca-a950-49f5-aa27-5676082fecd6" (UID: "08ebdcca-a950-49f5-aa27-5676082fecd6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:54:13.391494 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.391462 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08ebdcca-a950-49f5-aa27-5676082fecd6-kube-api-access-5kxqz" (OuterVolumeSpecName: "kube-api-access-5kxqz") pod "08ebdcca-a950-49f5-aa27-5676082fecd6" (UID: "08ebdcca-a950-49f5-aa27-5676082fecd6"). InnerVolumeSpecName "kube-api-access-5kxqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 16:54:13.391494 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.391474 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08ebdcca-a950-49f5-aa27-5676082fecd6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "08ebdcca-a950-49f5-aa27-5676082fecd6" (UID: "08ebdcca-a950-49f5-aa27-5676082fecd6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:54:13.391617 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.391546 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08ebdcca-a950-49f5-aa27-5676082fecd6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "08ebdcca-a950-49f5-aa27-5676082fecd6" (UID: "08ebdcca-a950-49f5-aa27-5676082fecd6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:54:13.489722 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.489686 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08ebdcca-a950-49f5-aa27-5676082fecd6-console-oauth-config\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:54:13.489722 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.489714 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08ebdcca-a950-49f5-aa27-5676082fecd6-console-serving-cert\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:54:13.489722 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.489724 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08ebdcca-a950-49f5-aa27-5676082fecd6-console-config\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:54:13.489722 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.489733 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08ebdcca-a950-49f5-aa27-5676082fecd6-service-ca\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:54:13.490194 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.489741 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08ebdcca-a950-49f5-aa27-5676082fecd6-oauth-serving-cert\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:54:13.490194 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.489749 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kxqz\" (UniqueName: \"kubernetes.io/projected/08ebdcca-a950-49f5-aa27-5676082fecd6-kube-api-access-5kxqz\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:54:13.565060 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.564971 2574 generic.go:356] "Generic (PLEG): container finished" podID="08ebdcca-a950-49f5-aa27-5676082fecd6" containerID="767a5ae214f914b1377af6d5e20236b2555d086421c74d88e87c48c7eb19ce45" exitCode=0 Jul 23 16:54:13.565060 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.565019 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566694b65c-64cjg" Jul 23 16:54:13.565226 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.565058 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566694b65c-64cjg" event={"ID":"08ebdcca-a950-49f5-aa27-5676082fecd6","Type":"ContainerDied","Data":"767a5ae214f914b1377af6d5e20236b2555d086421c74d88e87c48c7eb19ce45"} Jul 23 16:54:13.565226 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.565109 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566694b65c-64cjg" event={"ID":"08ebdcca-a950-49f5-aa27-5676082fecd6","Type":"ContainerDied","Data":"354c920be42119d7226c107c54822bb487272fdccd56afc7b2a11f37e5e7f232"} Jul 23 16:54:13.565226 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.565130 2574 scope.go:117] "RemoveContainer" containerID="767a5ae214f914b1377af6d5e20236b2555d086421c74d88e87c48c7eb19ce45" Jul 23 16:54:13.573704 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.573686 2574 scope.go:117] "RemoveContainer" containerID="767a5ae214f914b1377af6d5e20236b2555d086421c74d88e87c48c7eb19ce45" Jul 23 16:54:13.573952 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:54:13.573925 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"767a5ae214f914b1377af6d5e20236b2555d086421c74d88e87c48c7eb19ce45\": container with ID starting with 767a5ae214f914b1377af6d5e20236b2555d086421c74d88e87c48c7eb19ce45 not found: ID does not exist" containerID="767a5ae214f914b1377af6d5e20236b2555d086421c74d88e87c48c7eb19ce45" Jul 23 16:54:13.573996 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.573961 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"767a5ae214f914b1377af6d5e20236b2555d086421c74d88e87c48c7eb19ce45"} err="failed to get container status \"767a5ae214f914b1377af6d5e20236b2555d086421c74d88e87c48c7eb19ce45\": rpc error: code = NotFound desc = could not find container \"767a5ae214f914b1377af6d5e20236b2555d086421c74d88e87c48c7eb19ce45\": container with ID starting with 767a5ae214f914b1377af6d5e20236b2555d086421c74d88e87c48c7eb19ce45 not found: ID does not exist" Jul 23 16:54:13.596513 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.596491 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566694b65c-64cjg"] Jul 23 16:54:13.625516 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:13.625493 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-566694b65c-64cjg"] Jul 23 16:54:14.111186 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:14.111155 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08ebdcca-a950-49f5-aa27-5676082fecd6" path="/var/lib/kubelet/pods/08ebdcca-a950-49f5-aa27-5676082fecd6/volumes" Jul 23 16:54:17.368850 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:17.368816 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:54:17.369289 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:17.368876 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:54:21.405744 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:21.405709 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4sbpm" Jul 23 16:54:33.772810 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:33.772771 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5fbf9f6595-mb7sl" podUID="35198a44-9207-44e0-92b1-d155399cd44b" containerName="console" containerID="cri-o://19ef85595649c74016277b5add4371807f21870dc55480cf86ac4de2b18a0e19" gracePeriod=15 Jul 23 16:54:34.042162 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.042135 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:54:34.155257 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.155221 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35198a44-9207-44e0-92b1-d155399cd44b-console-serving-cert\") pod \"35198a44-9207-44e0-92b1-d155399cd44b\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " Jul 23 16:54:34.155437 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.155284 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35198a44-9207-44e0-92b1-d155399cd44b-console-oauth-config\") pod \"35198a44-9207-44e0-92b1-d155399cd44b\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " Jul 23 16:54:34.155437 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.155318 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5p2cp\" (UniqueName: \"kubernetes.io/projected/35198a44-9207-44e0-92b1-d155399cd44b-kube-api-access-5p2cp\") pod \"35198a44-9207-44e0-92b1-d155399cd44b\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " Jul 23 16:54:34.155437 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.155344 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-service-ca\") pod \"35198a44-9207-44e0-92b1-d155399cd44b\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " Jul 23 16:54:34.155437 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.155389 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-oauth-serving-cert\") pod \"35198a44-9207-44e0-92b1-d155399cd44b\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " Jul 23 16:54:34.155437 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.155429 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-trusted-ca-bundle\") pod \"35198a44-9207-44e0-92b1-d155399cd44b\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " Jul 23 16:54:34.155683 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.155456 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-console-config\") pod \"35198a44-9207-44e0-92b1-d155399cd44b\" (UID: \"35198a44-9207-44e0-92b1-d155399cd44b\") " Jul 23 16:54:34.155788 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.155750 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-service-ca" (OuterVolumeSpecName: "service-ca") pod "35198a44-9207-44e0-92b1-d155399cd44b" (UID: "35198a44-9207-44e0-92b1-d155399cd44b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:54:34.156075 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.155817 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "35198a44-9207-44e0-92b1-d155399cd44b" (UID: "35198a44-9207-44e0-92b1-d155399cd44b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:54:34.156075 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.155975 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "35198a44-9207-44e0-92b1-d155399cd44b" (UID: "35198a44-9207-44e0-92b1-d155399cd44b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:54:34.156215 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.156073 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-console-config" (OuterVolumeSpecName: "console-config") pod "35198a44-9207-44e0-92b1-d155399cd44b" (UID: "35198a44-9207-44e0-92b1-d155399cd44b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:54:34.157512 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.157485 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35198a44-9207-44e0-92b1-d155399cd44b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "35198a44-9207-44e0-92b1-d155399cd44b" (UID: "35198a44-9207-44e0-92b1-d155399cd44b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:54:34.157618 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.157584 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35198a44-9207-44e0-92b1-d155399cd44b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "35198a44-9207-44e0-92b1-d155399cd44b" (UID: "35198a44-9207-44e0-92b1-d155399cd44b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:54:34.157618 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.157592 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35198a44-9207-44e0-92b1-d155399cd44b-kube-api-access-5p2cp" (OuterVolumeSpecName: "kube-api-access-5p2cp") pod "35198a44-9207-44e0-92b1-d155399cd44b" (UID: "35198a44-9207-44e0-92b1-d155399cd44b"). InnerVolumeSpecName "kube-api-access-5p2cp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 16:54:34.256835 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.256806 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35198a44-9207-44e0-92b1-d155399cd44b-console-serving-cert\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:54:34.256835 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.256834 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35198a44-9207-44e0-92b1-d155399cd44b-console-oauth-config\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:54:34.257066 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.256846 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5p2cp\" (UniqueName: \"kubernetes.io/projected/35198a44-9207-44e0-92b1-d155399cd44b-kube-api-access-5p2cp\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:54:34.257066 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.256860 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-service-ca\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:54:34.257066 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.256872 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-oauth-serving-cert\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:54:34.257066 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.256882 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-trusted-ca-bundle\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:54:34.257066 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.256893 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35198a44-9207-44e0-92b1-d155399cd44b-console-config\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:54:34.653203 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.653166 2574 generic.go:356] "Generic (PLEG): container finished" podID="35198a44-9207-44e0-92b1-d155399cd44b" containerID="19ef85595649c74016277b5add4371807f21870dc55480cf86ac4de2b18a0e19" exitCode=0 Jul 23 16:54:34.653367 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.653209 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fbf9f6595-mb7sl" Jul 23 16:54:34.653367 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.653212 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fbf9f6595-mb7sl" event={"ID":"35198a44-9207-44e0-92b1-d155399cd44b","Type":"ContainerDied","Data":"19ef85595649c74016277b5add4371807f21870dc55480cf86ac4de2b18a0e19"} Jul 23 16:54:34.653367 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.653264 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fbf9f6595-mb7sl" event={"ID":"35198a44-9207-44e0-92b1-d155399cd44b","Type":"ContainerDied","Data":"7268a94758e7ef4c080d07778ca94fe25c380766d1fdf38191dcb71c55fa5839"} Jul 23 16:54:34.653367 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.653290 2574 scope.go:117] "RemoveContainer" containerID="19ef85595649c74016277b5add4371807f21870dc55480cf86ac4de2b18a0e19" Jul 23 16:54:34.662375 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.662357 2574 scope.go:117] "RemoveContainer" containerID="19ef85595649c74016277b5add4371807f21870dc55480cf86ac4de2b18a0e19" Jul 23 16:54:34.662680 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:54:34.662657 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19ef85595649c74016277b5add4371807f21870dc55480cf86ac4de2b18a0e19\": container with ID starting with 19ef85595649c74016277b5add4371807f21870dc55480cf86ac4de2b18a0e19 not found: ID does not exist" containerID="19ef85595649c74016277b5add4371807f21870dc55480cf86ac4de2b18a0e19" Jul 23 16:54:34.662735 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.662690 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19ef85595649c74016277b5add4371807f21870dc55480cf86ac4de2b18a0e19"} err="failed to get container status \"19ef85595649c74016277b5add4371807f21870dc55480cf86ac4de2b18a0e19\": rpc error: code = NotFound desc = could not find container \"19ef85595649c74016277b5add4371807f21870dc55480cf86ac4de2b18a0e19\": container with ID starting with 19ef85595649c74016277b5add4371807f21870dc55480cf86ac4de2b18a0e19 not found: ID does not exist" Jul 23 16:54:34.686038 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.686015 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fbf9f6595-mb7sl"] Jul 23 16:54:34.695527 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:34.695507 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fbf9f6595-mb7sl"] Jul 23 16:54:36.110114 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:36.110086 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35198a44-9207-44e0-92b1-d155399cd44b" path="/var/lib/kubelet/pods/35198a44-9207-44e0-92b1-d155399cd44b/volumes" Jul 23 16:54:37.373939 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:37.373908 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:54:37.377686 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:37.377667 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-758548d448-6x4t4" Jul 23 16:54:59.803985 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:59.803950 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:54:59.824269 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:54:59.824241 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:00.782350 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:00.782318 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:13.861052 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:13.861016 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 16:55:13.861493 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:13.861347 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="alertmanager" containerID="cri-o://5cd4baf06e31c5a5efb71b97865457c9e3804724639b9408718c9a1cfae18bb0" gracePeriod=120 Jul 23 16:55:13.861493 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:13.861403 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="kube-rbac-proxy-metric" containerID="cri-o://9fa80aa89a002159f897284f4c39b5a362ed8781ae8cf3a8d6882dd1eb736cb2" gracePeriod=120 Jul 23 16:55:13.861493 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:13.861429 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="kube-rbac-proxy-web" containerID="cri-o://fa16df97d467c0c489e92b4bf7f94e29ff71c6b1fe964ee8c6822eb3203fd932" gracePeriod=120 Jul 23 16:55:13.861698 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:13.861471 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="config-reloader" containerID="cri-o://42aa0d9593e469015cbc47b4247b4ebe7850058c671f6a416ab561af1e15b0b9" gracePeriod=120 Jul 23 16:55:13.861698 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:13.861479 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="prom-label-proxy" containerID="cri-o://51f91743947b4c005d9af1610de64f1c197ef4eeea5e80fc7cc7a0c95e1a8775" gracePeriod=120 Jul 23 16:55:13.861698 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:13.861439 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="kube-rbac-proxy" containerID="cri-o://5a9a1e88b40abeaee36d2a2ce94150659779a7a26119f3957cf8c1c7a383d876" gracePeriod=120 Jul 23 16:55:14.824565 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:14.824537 2574 generic.go:356] "Generic (PLEG): container finished" podID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerID="51f91743947b4c005d9af1610de64f1c197ef4eeea5e80fc7cc7a0c95e1a8775" exitCode=0 Jul 23 16:55:14.824565 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:14.824559 2574 generic.go:356] "Generic (PLEG): container finished" podID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerID="9fa80aa89a002159f897284f4c39b5a362ed8781ae8cf3a8d6882dd1eb736cb2" exitCode=0 Jul 23 16:55:14.824565 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:14.824564 2574 generic.go:356] "Generic (PLEG): container finished" podID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerID="5a9a1e88b40abeaee36d2a2ce94150659779a7a26119f3957cf8c1c7a383d876" exitCode=0 Jul 23 16:55:14.824565 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:14.824570 2574 generic.go:356] "Generic (PLEG): container finished" podID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerID="42aa0d9593e469015cbc47b4247b4ebe7850058c671f6a416ab561af1e15b0b9" exitCode=0 Jul 23 16:55:14.824565 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:14.824575 2574 generic.go:356] "Generic (PLEG): container finished" podID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerID="5cd4baf06e31c5a5efb71b97865457c9e3804724639b9408718c9a1cfae18bb0" exitCode=0 Jul 23 16:55:14.824849 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:14.824604 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb","Type":"ContainerDied","Data":"51f91743947b4c005d9af1610de64f1c197ef4eeea5e80fc7cc7a0c95e1a8775"} Jul 23 16:55:14.824849 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:14.824667 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb","Type":"ContainerDied","Data":"9fa80aa89a002159f897284f4c39b5a362ed8781ae8cf3a8d6882dd1eb736cb2"} Jul 23 16:55:14.824849 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:14.824694 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb","Type":"ContainerDied","Data":"5a9a1e88b40abeaee36d2a2ce94150659779a7a26119f3957cf8c1c7a383d876"} Jul 23 16:55:14.824849 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:14.824717 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb","Type":"ContainerDied","Data":"42aa0d9593e469015cbc47b4247b4ebe7850058c671f6a416ab561af1e15b0b9"} Jul 23 16:55:14.824849 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:14.824740 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb","Type":"ContainerDied","Data":"5cd4baf06e31c5a5efb71b97865457c9e3804724639b9408718c9a1cfae18bb0"} Jul 23 16:55:15.129765 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.129742 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:15.227529 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.227490 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64bzt\" (UniqueName: \"kubernetes.io/projected/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-kube-api-access-64bzt\") pod \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " Jul 23 16:55:15.227713 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.227548 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " Jul 23 16:55:15.227713 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.227606 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-kube-rbac-proxy\") pod \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " Jul 23 16:55:15.227713 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.227672 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-alertmanager-trusted-ca-bundle\") pod \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " Jul 23 16:55:15.227875 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.227718 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-kube-rbac-proxy-web\") pod \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " Jul 23 16:55:15.227875 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.227742 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-config-volume\") pod \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " Jul 23 16:55:15.227875 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.227782 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-web-config\") pod \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " Jul 23 16:55:15.228829 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.228109 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-cluster-tls-config\") pod \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " Jul 23 16:55:15.228829 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.228164 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-config-out\") pod \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " Jul 23 16:55:15.228829 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.228198 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-tls-assets\") pod \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " Jul 23 16:55:15.228829 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.228232 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-alertmanager-main-db\") pod \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " Jul 23 16:55:15.228829 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.228256 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-metrics-client-ca\") pod \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " Jul 23 16:55:15.228829 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.228308 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-main-tls\") pod \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\" (UID: \"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb\") " Jul 23 16:55:15.228829 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.228599 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" (UID: "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:55:15.229385 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.229354 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" (UID: "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 16:55:15.231483 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.231436 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" (UID: "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:55:15.232208 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.231850 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" (UID: "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:55:15.232208 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.231991 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" (UID: "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:55:15.232208 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.232186 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-kube-api-access-64bzt" (OuterVolumeSpecName: "kube-api-access-64bzt") pod "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" (UID: "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb"). InnerVolumeSpecName "kube-api-access-64bzt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 16:55:15.232438 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.232187 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" (UID: "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:55:15.232438 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.232303 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-config-out" (OuterVolumeSpecName: "config-out") pod "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" (UID: "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 16:55:15.232700 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.232676 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-config-volume" (OuterVolumeSpecName: "config-volume") pod "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" (UID: "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:55:15.233556 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.233525 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" (UID: "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 16:55:15.233644 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.233547 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" (UID: "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:55:15.236439 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.236414 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" (UID: "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:55:15.242635 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.242611 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-web-config" (OuterVolumeSpecName: "web-config") pod "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" (UID: "fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:55:15.329899 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.329847 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-web-config\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:15.329899 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.329890 2574 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-cluster-tls-config\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:15.329899 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.329901 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-config-out\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:15.329899 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.329909 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-tls-assets\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:15.329899 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.329919 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-alertmanager-main-db\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:15.330232 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.329928 2574 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-metrics-client-ca\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:15.330232 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.329937 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-main-tls\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:15.330232 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.329945 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64bzt\" (UniqueName: \"kubernetes.io/projected/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-kube-api-access-64bzt\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:15.330232 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.329956 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:15.330232 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.329965 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:15.330232 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.329973 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:15.330232 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.329981 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:15.330232 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.329991 2574 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb-config-volume\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:15.831585 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.831551 2574 generic.go:356] "Generic (PLEG): container finished" podID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerID="fa16df97d467c0c489e92b4bf7f94e29ff71c6b1fe964ee8c6822eb3203fd932" exitCode=0 Jul 23 16:55:15.831763 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.831627 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:15.831763 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.831636 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb","Type":"ContainerDied","Data":"fa16df97d467c0c489e92b4bf7f94e29ff71c6b1fe964ee8c6822eb3203fd932"} Jul 23 16:55:15.831763 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.831705 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb","Type":"ContainerDied","Data":"7b574c0e3ec0eacabc0c816eaccbc14ca60188273251118e5e0ec1d8ec2bd403"} Jul 23 16:55:15.831763 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.831740 2574 scope.go:117] "RemoveContainer" containerID="51f91743947b4c005d9af1610de64f1c197ef4eeea5e80fc7cc7a0c95e1a8775" Jul 23 16:55:15.844757 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.844737 2574 scope.go:117] "RemoveContainer" containerID="9fa80aa89a002159f897284f4c39b5a362ed8781ae8cf3a8d6882dd1eb736cb2" Jul 23 16:55:15.852026 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.851993 2574 scope.go:117] "RemoveContainer" containerID="5a9a1e88b40abeaee36d2a2ce94150659779a7a26119f3957cf8c1c7a383d876" Jul 23 16:55:15.858722 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.858705 2574 scope.go:117] "RemoveContainer" containerID="fa16df97d467c0c489e92b4bf7f94e29ff71c6b1fe964ee8c6822eb3203fd932" Jul 23 16:55:15.866068 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.866044 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 16:55:15.866859 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.866841 2574 scope.go:117] "RemoveContainer" containerID="42aa0d9593e469015cbc47b4247b4ebe7850058c671f6a416ab561af1e15b0b9" Jul 23 16:55:15.873705 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.873691 2574 scope.go:117] "RemoveContainer" containerID="5cd4baf06e31c5a5efb71b97865457c9e3804724639b9408718c9a1cfae18bb0" Jul 23 16:55:15.880185 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.880156 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 16:55:15.882039 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.882018 2574 scope.go:117] "RemoveContainer" containerID="33e3d1066ad0de9ab1750bac93fe08cbeca59f2d504a4b6eeafbb785e92324ea" Jul 23 16:55:15.888798 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.888784 2574 scope.go:117] "RemoveContainer" containerID="51f91743947b4c005d9af1610de64f1c197ef4eeea5e80fc7cc7a0c95e1a8775" Jul 23 16:55:15.889112 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:55:15.889075 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51f91743947b4c005d9af1610de64f1c197ef4eeea5e80fc7cc7a0c95e1a8775\": container with ID starting with 51f91743947b4c005d9af1610de64f1c197ef4eeea5e80fc7cc7a0c95e1a8775 not found: ID does not exist" containerID="51f91743947b4c005d9af1610de64f1c197ef4eeea5e80fc7cc7a0c95e1a8775" Jul 23 16:55:15.889202 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.889122 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51f91743947b4c005d9af1610de64f1c197ef4eeea5e80fc7cc7a0c95e1a8775"} err="failed to get container status \"51f91743947b4c005d9af1610de64f1c197ef4eeea5e80fc7cc7a0c95e1a8775\": rpc error: code = NotFound desc = could not find container \"51f91743947b4c005d9af1610de64f1c197ef4eeea5e80fc7cc7a0c95e1a8775\": container with ID starting with 51f91743947b4c005d9af1610de64f1c197ef4eeea5e80fc7cc7a0c95e1a8775 not found: ID does not exist" Jul 23 16:55:15.889202 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.889148 2574 scope.go:117] "RemoveContainer" containerID="9fa80aa89a002159f897284f4c39b5a362ed8781ae8cf3a8d6882dd1eb736cb2" Jul 23 16:55:15.889443 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:55:15.889424 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fa80aa89a002159f897284f4c39b5a362ed8781ae8cf3a8d6882dd1eb736cb2\": container with ID starting with 9fa80aa89a002159f897284f4c39b5a362ed8781ae8cf3a8d6882dd1eb736cb2 not found: ID does not exist" containerID="9fa80aa89a002159f897284f4c39b5a362ed8781ae8cf3a8d6882dd1eb736cb2" Jul 23 16:55:15.889487 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.889454 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fa80aa89a002159f897284f4c39b5a362ed8781ae8cf3a8d6882dd1eb736cb2"} err="failed to get container status \"9fa80aa89a002159f897284f4c39b5a362ed8781ae8cf3a8d6882dd1eb736cb2\": rpc error: code = NotFound desc = could not find container \"9fa80aa89a002159f897284f4c39b5a362ed8781ae8cf3a8d6882dd1eb736cb2\": container with ID starting with 9fa80aa89a002159f897284f4c39b5a362ed8781ae8cf3a8d6882dd1eb736cb2 not found: ID does not exist" Jul 23 16:55:15.889487 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.889474 2574 scope.go:117] "RemoveContainer" containerID="5a9a1e88b40abeaee36d2a2ce94150659779a7a26119f3957cf8c1c7a383d876" Jul 23 16:55:15.889707 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:55:15.889687 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a9a1e88b40abeaee36d2a2ce94150659779a7a26119f3957cf8c1c7a383d876\": container with ID starting with 5a9a1e88b40abeaee36d2a2ce94150659779a7a26119f3957cf8c1c7a383d876 not found: ID does not exist" containerID="5a9a1e88b40abeaee36d2a2ce94150659779a7a26119f3957cf8c1c7a383d876" Jul 23 16:55:15.889756 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.889715 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a9a1e88b40abeaee36d2a2ce94150659779a7a26119f3957cf8c1c7a383d876"} err="failed to get container status \"5a9a1e88b40abeaee36d2a2ce94150659779a7a26119f3957cf8c1c7a383d876\": rpc error: code = NotFound desc = could not find container \"5a9a1e88b40abeaee36d2a2ce94150659779a7a26119f3957cf8c1c7a383d876\": container with ID starting with 5a9a1e88b40abeaee36d2a2ce94150659779a7a26119f3957cf8c1c7a383d876 not found: ID does not exist" Jul 23 16:55:15.889756 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.889731 2574 scope.go:117] "RemoveContainer" containerID="fa16df97d467c0c489e92b4bf7f94e29ff71c6b1fe964ee8c6822eb3203fd932" Jul 23 16:55:15.889986 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:55:15.889963 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa16df97d467c0c489e92b4bf7f94e29ff71c6b1fe964ee8c6822eb3203fd932\": container with ID starting with fa16df97d467c0c489e92b4bf7f94e29ff71c6b1fe964ee8c6822eb3203fd932 not found: ID does not exist" containerID="fa16df97d467c0c489e92b4bf7f94e29ff71c6b1fe964ee8c6822eb3203fd932" Jul 23 16:55:15.890073 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.889993 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa16df97d467c0c489e92b4bf7f94e29ff71c6b1fe964ee8c6822eb3203fd932"} err="failed to get container status \"fa16df97d467c0c489e92b4bf7f94e29ff71c6b1fe964ee8c6822eb3203fd932\": rpc error: code = NotFound desc = could not find container \"fa16df97d467c0c489e92b4bf7f94e29ff71c6b1fe964ee8c6822eb3203fd932\": container with ID starting with fa16df97d467c0c489e92b4bf7f94e29ff71c6b1fe964ee8c6822eb3203fd932 not found: ID does not exist" Jul 23 16:55:15.890073 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.890035 2574 scope.go:117] "RemoveContainer" containerID="42aa0d9593e469015cbc47b4247b4ebe7850058c671f6a416ab561af1e15b0b9" Jul 23 16:55:15.890251 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:55:15.890231 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42aa0d9593e469015cbc47b4247b4ebe7850058c671f6a416ab561af1e15b0b9\": container with ID starting with 42aa0d9593e469015cbc47b4247b4ebe7850058c671f6a416ab561af1e15b0b9 not found: ID does not exist" containerID="42aa0d9593e469015cbc47b4247b4ebe7850058c671f6a416ab561af1e15b0b9" Jul 23 16:55:15.890291 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.890256 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42aa0d9593e469015cbc47b4247b4ebe7850058c671f6a416ab561af1e15b0b9"} err="failed to get container status \"42aa0d9593e469015cbc47b4247b4ebe7850058c671f6a416ab561af1e15b0b9\": rpc error: code = NotFound desc = could not find container \"42aa0d9593e469015cbc47b4247b4ebe7850058c671f6a416ab561af1e15b0b9\": container with ID starting with 42aa0d9593e469015cbc47b4247b4ebe7850058c671f6a416ab561af1e15b0b9 not found: ID does not exist" Jul 23 16:55:15.890291 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.890269 2574 scope.go:117] "RemoveContainer" containerID="5cd4baf06e31c5a5efb71b97865457c9e3804724639b9408718c9a1cfae18bb0" Jul 23 16:55:15.890471 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:55:15.890443 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cd4baf06e31c5a5efb71b97865457c9e3804724639b9408718c9a1cfae18bb0\": container with ID starting with 5cd4baf06e31c5a5efb71b97865457c9e3804724639b9408718c9a1cfae18bb0 not found: ID does not exist" containerID="5cd4baf06e31c5a5efb71b97865457c9e3804724639b9408718c9a1cfae18bb0" Jul 23 16:55:15.890471 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.890464 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cd4baf06e31c5a5efb71b97865457c9e3804724639b9408718c9a1cfae18bb0"} err="failed to get container status \"5cd4baf06e31c5a5efb71b97865457c9e3804724639b9408718c9a1cfae18bb0\": rpc error: code = NotFound desc = could not find container \"5cd4baf06e31c5a5efb71b97865457c9e3804724639b9408718c9a1cfae18bb0\": container with ID starting with 5cd4baf06e31c5a5efb71b97865457c9e3804724639b9408718c9a1cfae18bb0 not found: ID does not exist" Jul 23 16:55:15.890551 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.890479 2574 scope.go:117] "RemoveContainer" containerID="33e3d1066ad0de9ab1750bac93fe08cbeca59f2d504a4b6eeafbb785e92324ea" Jul 23 16:55:15.890760 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:55:15.890744 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33e3d1066ad0de9ab1750bac93fe08cbeca59f2d504a4b6eeafbb785e92324ea\": container with ID starting with 33e3d1066ad0de9ab1750bac93fe08cbeca59f2d504a4b6eeafbb785e92324ea not found: ID does not exist" containerID="33e3d1066ad0de9ab1750bac93fe08cbeca59f2d504a4b6eeafbb785e92324ea" Jul 23 16:55:15.890800 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.890764 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33e3d1066ad0de9ab1750bac93fe08cbeca59f2d504a4b6eeafbb785e92324ea"} err="failed to get container status \"33e3d1066ad0de9ab1750bac93fe08cbeca59f2d504a4b6eeafbb785e92324ea\": rpc error: code = NotFound desc = could not find container \"33e3d1066ad0de9ab1750bac93fe08cbeca59f2d504a4b6eeafbb785e92324ea\": container with ID starting with 33e3d1066ad0de9ab1750bac93fe08cbeca59f2d504a4b6eeafbb785e92324ea not found: ID does not exist" Jul 23 16:55:15.933608 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.933573 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 16:55:15.933953 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.933935 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="kube-rbac-proxy" Jul 23 16:55:15.934052 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.933955 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="kube-rbac-proxy" Jul 23 16:55:15.934052 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.933978 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="alertmanager" Jul 23 16:55:15.934052 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.933987 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="alertmanager" Jul 23 16:55:15.934052 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934018 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35198a44-9207-44e0-92b1-d155399cd44b" containerName="console" Jul 23 16:55:15.934052 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934027 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="35198a44-9207-44e0-92b1-d155399cd44b" containerName="console" Jul 23 16:55:15.934052 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934037 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08ebdcca-a950-49f5-aa27-5676082fecd6" containerName="console" Jul 23 16:55:15.934052 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934045 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="08ebdcca-a950-49f5-aa27-5676082fecd6" containerName="console" Jul 23 16:55:15.934402 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934059 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="init-config-reloader" Jul 23 16:55:15.934402 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934068 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="init-config-reloader" Jul 23 16:55:15.934402 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934079 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="kube-rbac-proxy-metric" Jul 23 16:55:15.934402 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934087 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="kube-rbac-proxy-metric" Jul 23 16:55:15.934402 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934099 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="kube-rbac-proxy-web" Jul 23 16:55:15.934402 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934107 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="kube-rbac-proxy-web" Jul 23 16:55:15.934402 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934118 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="prom-label-proxy" Jul 23 16:55:15.934402 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934126 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="prom-label-proxy" Jul 23 16:55:15.934402 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934146 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="config-reloader" Jul 23 16:55:15.934402 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934154 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="config-reloader" Jul 23 16:55:15.934402 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934240 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="alertmanager" Jul 23 16:55:15.934402 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934254 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="config-reloader" Jul 23 16:55:15.934402 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934262 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="kube-rbac-proxy" Jul 23 16:55:15.934402 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934271 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="kube-rbac-proxy-web" Jul 23 16:55:15.934402 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934280 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="35198a44-9207-44e0-92b1-d155399cd44b" containerName="console" Jul 23 16:55:15.934402 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934292 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="08ebdcca-a950-49f5-aa27-5676082fecd6" containerName="console" Jul 23 16:55:15.934402 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934300 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="kube-rbac-proxy-metric" Jul 23 16:55:15.934402 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.934308 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" containerName="prom-label-proxy" Jul 23 16:55:15.938300 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.938280 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:15.941370 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.941342 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 23 16:55:15.941370 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.941344 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 23 16:55:15.942215 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.942193 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 23 16:55:15.942311 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.942253 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 23 16:55:15.942311 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.942279 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w2j86\"" Jul 23 16:55:15.945125 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.944836 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 23 16:55:15.945125 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.944940 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 23 16:55:15.945125 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.944845 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 23 16:55:15.949473 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.949456 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 23 16:55:15.949878 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.949860 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 23 16:55:15.959973 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:15.959950 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 16:55:16.037342 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.037308 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/956448aa-93ae-4508-9551-065906ff037f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.037342 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.037345 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.037552 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.037366 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-config-volume\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.037552 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.037383 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.037552 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.037459 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.037552 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.037501 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/956448aa-93ae-4508-9551-065906ff037f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.037673 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.037545 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7878\" (UniqueName: \"kubernetes.io/projected/956448aa-93ae-4508-9551-065906ff037f-kube-api-access-t7878\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.037673 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.037589 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-web-config\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.037673 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.037610 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.037673 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.037627 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/956448aa-93ae-4508-9551-065906ff037f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.037673 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.037656 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.037815 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.037676 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/956448aa-93ae-4508-9551-065906ff037f-config-out\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.037815 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.037699 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/956448aa-93ae-4508-9551-065906ff037f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.110389 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.110326 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb" path="/var/lib/kubelet/pods/fe6ec84a-3e3f-4fd0-b755-70e2798d3eeb/volumes" Jul 23 16:55:16.139015 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.138956 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-config-volume\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.139432 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.139024 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.139432 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.139068 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.139432 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.139187 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/956448aa-93ae-4508-9551-065906ff037f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.139432 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.139284 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7878\" (UniqueName: \"kubernetes.io/projected/956448aa-93ae-4508-9551-065906ff037f-kube-api-access-t7878\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.139432 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.139326 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-web-config\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.139432 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.139351 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.139432 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.139377 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/956448aa-93ae-4508-9551-065906ff037f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.139432 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.139414 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.139819 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.139437 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/956448aa-93ae-4508-9551-065906ff037f-config-out\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.139819 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.139463 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/956448aa-93ae-4508-9551-065906ff037f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.139819 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.139558 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/956448aa-93ae-4508-9551-065906ff037f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.139819 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.139621 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.141203 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.141171 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/956448aa-93ae-4508-9551-065906ff037f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.142052 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.141861 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/956448aa-93ae-4508-9551-065906ff037f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.142052 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.141913 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/956448aa-93ae-4508-9551-065906ff037f-config-out\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.142222 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.142055 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.142282 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.142228 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.142282 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.142266 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/956448aa-93ae-4508-9551-065906ff037f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.142645 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.142619 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.142776 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.142725 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-config-volume\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.142874 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.142857 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/956448aa-93ae-4508-9551-065906ff037f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.143772 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.143747 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.144608 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.144581 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.144723 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.144703 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/956448aa-93ae-4508-9551-065906ff037f-web-config\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.149693 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.149674 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7878\" (UniqueName: \"kubernetes.io/projected/956448aa-93ae-4508-9551-065906ff037f-kube-api-access-t7878\") pod \"alertmanager-main-0\" (UID: \"956448aa-93ae-4508-9551-065906ff037f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.247354 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.247304 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 16:55:16.423709 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.423637 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 16:55:16.431749 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:55:16.431725 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod956448aa_93ae_4508_9551_065906ff037f.slice/crio-dad16376ff32894bf72aecfb18dd224db86f2694119cd66b027502bd44f0057d WatchSource:0}: Error finding container dad16376ff32894bf72aecfb18dd224db86f2694119cd66b027502bd44f0057d: Status 404 returned error can't find the container with id dad16376ff32894bf72aecfb18dd224db86f2694119cd66b027502bd44f0057d Jul 23 16:55:16.836969 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.836934 2574 generic.go:356] "Generic (PLEG): container finished" podID="956448aa-93ae-4508-9551-065906ff037f" containerID="42c0ec69c497a4a5cbaed8c3b53a4f37617d38fa30d510f313a04cdc3231e910" exitCode=0 Jul 23 16:55:16.837130 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.837022 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"956448aa-93ae-4508-9551-065906ff037f","Type":"ContainerDied","Data":"42c0ec69c497a4a5cbaed8c3b53a4f37617d38fa30d510f313a04cdc3231e910"} Jul 23 16:55:16.837130 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:16.837100 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"956448aa-93ae-4508-9551-065906ff037f","Type":"ContainerStarted","Data":"dad16376ff32894bf72aecfb18dd224db86f2694119cd66b027502bd44f0057d"} Jul 23 16:55:17.849642 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:17.849599 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"956448aa-93ae-4508-9551-065906ff037f","Type":"ContainerStarted","Data":"160aaa51a1bace38a952e11a5bd6e8e53937319d482605540aca5c1baa8c766b"} Jul 23 16:55:17.850135 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:17.849725 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"956448aa-93ae-4508-9551-065906ff037f","Type":"ContainerStarted","Data":"efb6549bfb665f41ce64faa24fb043d3d6f6774964ee9cfdde70a1feb59991fa"} Jul 23 16:55:17.850135 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:17.849772 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"956448aa-93ae-4508-9551-065906ff037f","Type":"ContainerStarted","Data":"00185fa2f1a6596379e3a289a349c9f62d832b58428ed5d060d36a0ec5f4b78b"} Jul 23 16:55:17.850135 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:17.849813 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"956448aa-93ae-4508-9551-065906ff037f","Type":"ContainerStarted","Data":"48c4d6618fef4470a3ba9b44f747b56ec67b5fa99be14a9e6da848f9763964cc"} Jul 23 16:55:17.850135 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:17.849850 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"956448aa-93ae-4508-9551-065906ff037f","Type":"ContainerStarted","Data":"3902c3d9a5a8106b921265e26590108e514a37bdf09bc580e716dc5a73ff7ba0"} Jul 23 16:55:17.850135 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:17.849889 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"956448aa-93ae-4508-9551-065906ff037f","Type":"ContainerStarted","Data":"e7cca552a1e5895e6f6b1f182d9c205da0a9247b94a3649d9054fe56ed861bf4"} Jul 23 16:55:17.952503 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:17.952450 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.937454767 podStartE2EDuration="2.952434574s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.979807ms" isStatefulPod=false podCreationTimestamp="2026-07-23 16:55:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:55:17.950847122 +0000 UTC m=+164.424662503" watchObservedRunningTime="2026-07-23 16:55:17.952434574 +0000 UTC m=+164.426249955" Jul 23 16:55:18.310856 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.310824 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 16:55:18.311155 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.311115 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="prometheus" containerID="cri-o://b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068" gracePeriod=600 Jul 23 16:55:18.311314 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.311164 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="thanos-sidecar" containerID="cri-o://31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd" gracePeriod=600 Jul 23 16:55:18.311314 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.311169 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="kube-rbac-proxy-web" containerID="cri-o://9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73" gracePeriod=600 Jul 23 16:55:18.311314 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.311196 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="config-reloader" containerID="cri-o://7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998" gracePeriod=600 Jul 23 16:55:18.311314 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.311175 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="kube-rbac-proxy-thanos" containerID="cri-o://be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf" gracePeriod=600 Jul 23 16:55:18.311314 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.311143 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="kube-rbac-proxy" containerID="cri-o://fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299" gracePeriod=600 Jul 23 16:55:18.586363 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.585508 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:18.661587 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.661554 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-db\") pod \"210211fd-9035-40be-a4ec-b9660171703d\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " Jul 23 16:55:18.661587 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.661593 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/210211fd-9035-40be-a4ec-b9660171703d-tls-assets\") pod \"210211fd-9035-40be-a4ec-b9660171703d\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " Jul 23 16:55:18.661798 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.661613 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-trusted-ca-bundle\") pod \"210211fd-9035-40be-a4ec-b9660171703d\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " Jul 23 16:55:18.661798 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.661638 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-metrics-client-certs\") pod \"210211fd-9035-40be-a4ec-b9660171703d\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " Jul 23 16:55:18.661798 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.661672 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-thanos-prometheus-http-client-file\") pod \"210211fd-9035-40be-a4ec-b9660171703d\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " Jul 23 16:55:18.661798 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.661699 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-rulefiles-0\") pod \"210211fd-9035-40be-a4ec-b9660171703d\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " Jul 23 16:55:18.661798 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.661728 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-web-config\") pod \"210211fd-9035-40be-a4ec-b9660171703d\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " Jul 23 16:55:18.661798 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.661755 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-kube-rbac-proxy\") pod \"210211fd-9035-40be-a4ec-b9660171703d\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " Jul 23 16:55:18.661798 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.661786 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-configmap-serving-certs-ca-bundle\") pod \"210211fd-9035-40be-a4ec-b9660171703d\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " Jul 23 16:55:18.662240 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.661818 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"210211fd-9035-40be-a4ec-b9660171703d\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " Jul 23 16:55:18.662240 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.661842 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-prometheus-k8s-tls\") pod \"210211fd-9035-40be-a4ec-b9660171703d\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " Jul 23 16:55:18.662240 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.661875 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-config\") pod \"210211fd-9035-40be-a4ec-b9660171703d\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " Jul 23 16:55:18.662240 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.661899 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45xwp\" (UniqueName: \"kubernetes.io/projected/210211fd-9035-40be-a4ec-b9660171703d-kube-api-access-45xwp\") pod \"210211fd-9035-40be-a4ec-b9660171703d\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " Jul 23 16:55:18.662240 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.661930 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-rulefiles-1\") pod \"210211fd-9035-40be-a4ec-b9660171703d\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " Jul 23 16:55:18.662240 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.661959 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-configmap-metrics-client-ca\") pod \"210211fd-9035-40be-a4ec-b9660171703d\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " Jul 23 16:55:18.662240 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.661967 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "210211fd-9035-40be-a4ec-b9660171703d" (UID: "210211fd-9035-40be-a4ec-b9660171703d"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:55:18.662240 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.662025 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-configmap-kubelet-serving-ca-bundle\") pod \"210211fd-9035-40be-a4ec-b9660171703d\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " Jul 23 16:55:18.662240 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.662131 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-grpc-tls\") pod \"210211fd-9035-40be-a4ec-b9660171703d\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " Jul 23 16:55:18.662240 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.662156 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-rulefiles-2\") pod \"210211fd-9035-40be-a4ec-b9660171703d\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " Jul 23 16:55:18.662240 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.662183 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"210211fd-9035-40be-a4ec-b9660171703d\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " Jul 23 16:55:18.662240 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.662217 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/210211fd-9035-40be-a4ec-b9660171703d-config-out\") pod \"210211fd-9035-40be-a4ec-b9660171703d\" (UID: \"210211fd-9035-40be-a4ec-b9660171703d\") " Jul 23 16:55:18.662885 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.662501 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:18.662885 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.662712 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "210211fd-9035-40be-a4ec-b9660171703d" (UID: "210211fd-9035-40be-a4ec-b9660171703d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:55:18.662885 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.662860 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "210211fd-9035-40be-a4ec-b9660171703d" (UID: "210211fd-9035-40be-a4ec-b9660171703d"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 16:55:18.663069 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.663017 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "210211fd-9035-40be-a4ec-b9660171703d" (UID: "210211fd-9035-40be-a4ec-b9660171703d"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:55:18.663824 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.663443 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "210211fd-9035-40be-a4ec-b9660171703d" (UID: "210211fd-9035-40be-a4ec-b9660171703d"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:55:18.663824 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.663652 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "210211fd-9035-40be-a4ec-b9660171703d" (UID: "210211fd-9035-40be-a4ec-b9660171703d"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:55:18.664024 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.663879 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "210211fd-9035-40be-a4ec-b9660171703d" (UID: "210211fd-9035-40be-a4ec-b9660171703d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:55:18.664286 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.664260 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "210211fd-9035-40be-a4ec-b9660171703d" (UID: "210211fd-9035-40be-a4ec-b9660171703d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:55:18.664413 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.664389 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/210211fd-9035-40be-a4ec-b9660171703d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "210211fd-9035-40be-a4ec-b9660171703d" (UID: "210211fd-9035-40be-a4ec-b9660171703d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 16:55:18.664499 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.664479 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "210211fd-9035-40be-a4ec-b9660171703d" (UID: "210211fd-9035-40be-a4ec-b9660171703d"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:55:18.664581 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.664561 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "210211fd-9035-40be-a4ec-b9660171703d" (UID: "210211fd-9035-40be-a4ec-b9660171703d"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:55:18.664960 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.664795 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/210211fd-9035-40be-a4ec-b9660171703d-config-out" (OuterVolumeSpecName: "config-out") pod "210211fd-9035-40be-a4ec-b9660171703d" (UID: "210211fd-9035-40be-a4ec-b9660171703d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 16:55:18.665308 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.665271 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "210211fd-9035-40be-a4ec-b9660171703d" (UID: "210211fd-9035-40be-a4ec-b9660171703d"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:55:18.665711 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.665674 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "210211fd-9035-40be-a4ec-b9660171703d" (UID: "210211fd-9035-40be-a4ec-b9660171703d"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:55:18.666441 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.666412 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "210211fd-9035-40be-a4ec-b9660171703d" (UID: "210211fd-9035-40be-a4ec-b9660171703d"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:55:18.666871 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.666823 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/210211fd-9035-40be-a4ec-b9660171703d-kube-api-access-45xwp" (OuterVolumeSpecName: "kube-api-access-45xwp") pod "210211fd-9035-40be-a4ec-b9660171703d" (UID: "210211fd-9035-40be-a4ec-b9660171703d"). InnerVolumeSpecName "kube-api-access-45xwp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 16:55:18.666960 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.666919 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-config" (OuterVolumeSpecName: "config") pod "210211fd-9035-40be-a4ec-b9660171703d" (UID: "210211fd-9035-40be-a4ec-b9660171703d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:55:18.669065 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.668641 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "210211fd-9035-40be-a4ec-b9660171703d" (UID: "210211fd-9035-40be-a4ec-b9660171703d"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:55:18.669065 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.668663 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "210211fd-9035-40be-a4ec-b9660171703d" (UID: "210211fd-9035-40be-a4ec-b9660171703d"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:55:18.680180 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.680147 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-web-config" (OuterVolumeSpecName: "web-config") pod "210211fd-9035-40be-a4ec-b9660171703d" (UID: "210211fd-9035-40be-a4ec-b9660171703d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:55:18.763261 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.763234 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-db\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:18.763261 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.763259 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/210211fd-9035-40be-a4ec-b9660171703d-tls-assets\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:18.763261 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.763268 2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-metrics-client-certs\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:18.763488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.763278 2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:18.763488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.763287 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:18.763488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.763297 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-web-config\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:18.763488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.763306 2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-kube-rbac-proxy\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:18.763488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.763313 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:18.763488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.763325 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:18.763488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.763334 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:18.763488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.763342 2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-config\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:18.763488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.763350 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45xwp\" (UniqueName: \"kubernetes.io/projected/210211fd-9035-40be-a4ec-b9660171703d-kube-api-access-45xwp\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:18.763488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.763359 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:18.763488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.763367 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-configmap-metrics-client-ca\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:18.763488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.763375 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:18.763488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.763383 2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-grpc-tls\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:18.763488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.763391 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/210211fd-9035-40be-a4ec-b9660171703d-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:18.763488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.763399 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/210211fd-9035-40be-a4ec-b9660171703d-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:18.763488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.763409 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/210211fd-9035-40be-a4ec-b9660171703d-config-out\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:18.857511 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.857417 2574 generic.go:356] "Generic (PLEG): container finished" podID="210211fd-9035-40be-a4ec-b9660171703d" containerID="be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf" exitCode=0 Jul 23 16:55:18.857511 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.857444 2574 generic.go:356] "Generic (PLEG): container finished" podID="210211fd-9035-40be-a4ec-b9660171703d" containerID="fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299" exitCode=0 Jul 23 16:55:18.857511 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.857453 2574 generic.go:356] "Generic (PLEG): container finished" podID="210211fd-9035-40be-a4ec-b9660171703d" containerID="9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73" exitCode=0 Jul 23 16:55:18.857511 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.857461 2574 generic.go:356] "Generic (PLEG): container finished" podID="210211fd-9035-40be-a4ec-b9660171703d" containerID="31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd" exitCode=0 Jul 23 16:55:18.857511 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.857469 2574 generic.go:356] "Generic (PLEG): container finished" podID="210211fd-9035-40be-a4ec-b9660171703d" containerID="7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998" exitCode=0 Jul 23 16:55:18.857511 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.857476 2574 generic.go:356] "Generic (PLEG): container finished" podID="210211fd-9035-40be-a4ec-b9660171703d" containerID="b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068" exitCode=0 Jul 23 16:55:18.857511 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.857500 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210211fd-9035-40be-a4ec-b9660171703d","Type":"ContainerDied","Data":"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf"} Jul 23 16:55:18.858212 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.857523 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:18.858212 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.857577 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210211fd-9035-40be-a4ec-b9660171703d","Type":"ContainerDied","Data":"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299"} Jul 23 16:55:18.858212 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.857607 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210211fd-9035-40be-a4ec-b9660171703d","Type":"ContainerDied","Data":"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73"} Jul 23 16:55:18.858212 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.857620 2574 scope.go:117] "RemoveContainer" containerID="be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf" Jul 23 16:55:18.858212 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.857634 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210211fd-9035-40be-a4ec-b9660171703d","Type":"ContainerDied","Data":"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd"} Jul 23 16:55:18.858212 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.857659 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210211fd-9035-40be-a4ec-b9660171703d","Type":"ContainerDied","Data":"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998"} Jul 23 16:55:18.858212 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.857684 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210211fd-9035-40be-a4ec-b9660171703d","Type":"ContainerDied","Data":"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068"} Jul 23 16:55:18.858212 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.857709 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"210211fd-9035-40be-a4ec-b9660171703d","Type":"ContainerDied","Data":"edf91d16a97b5c3f8a48aa31454a9de3399b789b8e1442016c82ce356efb9237"} Jul 23 16:55:18.865969 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.865952 2574 scope.go:117] "RemoveContainer" containerID="fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299" Jul 23 16:55:18.872856 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.872841 2574 scope.go:117] "RemoveContainer" containerID="9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73" Jul 23 16:55:18.879396 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.879379 2574 scope.go:117] "RemoveContainer" containerID="31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd" Jul 23 16:55:18.885863 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.885785 2574 scope.go:117] "RemoveContainer" containerID="7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998" Jul 23 16:55:18.888338 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.888321 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 16:55:18.892782 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.892761 2574 scope.go:117] "RemoveContainer" containerID="b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068" Jul 23 16:55:18.895381 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.895357 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 16:55:18.900125 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.900109 2574 scope.go:117] "RemoveContainer" containerID="809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0" Jul 23 16:55:18.906580 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.906564 2574 scope.go:117] "RemoveContainer" containerID="be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf" Jul 23 16:55:18.906844 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:55:18.906827 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf\": container with ID starting with be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf not found: ID does not exist" containerID="be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf" Jul 23 16:55:18.906894 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.906853 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf"} err="failed to get container status \"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf\": rpc error: code = NotFound desc = could not find container \"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf\": container with ID starting with be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf not found: ID does not exist" Jul 23 16:55:18.906894 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.906872 2574 scope.go:117] "RemoveContainer" containerID="fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299" Jul 23 16:55:18.907145 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:55:18.907127 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299\": container with ID starting with fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299 not found: ID does not exist" containerID="fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299" Jul 23 16:55:18.907193 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.907151 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299"} err="failed to get container status \"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299\": rpc error: code = NotFound desc = could not find container \"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299\": container with ID starting with fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299 not found: ID does not exist" Jul 23 16:55:18.907193 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.907165 2574 scope.go:117] "RemoveContainer" containerID="9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73" Jul 23 16:55:18.907391 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:55:18.907377 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73\": container with ID starting with 9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73 not found: ID does not exist" containerID="9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73" Jul 23 16:55:18.907431 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.907396 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73"} err="failed to get container status \"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73\": rpc error: code = NotFound desc = could not find container \"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73\": container with ID starting with 9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73 not found: ID does not exist" Jul 23 16:55:18.907431 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.907414 2574 scope.go:117] "RemoveContainer" containerID="31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd" Jul 23 16:55:18.907624 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:55:18.907608 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd\": container with ID starting with 31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd not found: ID does not exist" containerID="31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd" Jul 23 16:55:18.907670 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.907627 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd"} err="failed to get container status \"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd\": rpc error: code = NotFound desc = could not find container \"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd\": container with ID starting with 31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd not found: ID does not exist" Jul 23 16:55:18.907670 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.907640 2574 scope.go:117] "RemoveContainer" containerID="7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998" Jul 23 16:55:18.907855 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:55:18.907839 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998\": container with ID starting with 7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998 not found: ID does not exist" containerID="7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998" Jul 23 16:55:18.907893 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.907858 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998"} err="failed to get container status \"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998\": rpc error: code = NotFound desc = could not find container \"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998\": container with ID starting with 7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998 not found: ID does not exist" Jul 23 16:55:18.907893 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.907871 2574 scope.go:117] "RemoveContainer" containerID="b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068" Jul 23 16:55:18.908114 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:55:18.908098 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068\": container with ID starting with b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068 not found: ID does not exist" containerID="b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068" Jul 23 16:55:18.908162 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.908119 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068"} err="failed to get container status \"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068\": rpc error: code = NotFound desc = could not find container \"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068\": container with ID starting with b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068 not found: ID does not exist" Jul 23 16:55:18.908162 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.908133 2574 scope.go:117] "RemoveContainer" containerID="809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0" Jul 23 16:55:18.908352 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:55:18.908335 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0\": container with ID starting with 809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0 not found: ID does not exist" containerID="809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0" Jul 23 16:55:18.908392 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.908356 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0"} err="failed to get container status \"809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0\": rpc error: code = NotFound desc = could not find container \"809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0\": container with ID starting with 809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0 not found: ID does not exist" Jul 23 16:55:18.908392 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.908369 2574 scope.go:117] "RemoveContainer" containerID="be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf" Jul 23 16:55:18.908612 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.908596 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf"} err="failed to get container status \"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf\": rpc error: code = NotFound desc = could not find container \"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf\": container with ID starting with be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf not found: ID does not exist" Jul 23 16:55:18.908612 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.908611 2574 scope.go:117] "RemoveContainer" containerID="fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299" Jul 23 16:55:18.908830 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.908810 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299"} err="failed to get container status \"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299\": rpc error: code = NotFound desc = could not find container \"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299\": container with ID starting with fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299 not found: ID does not exist" Jul 23 16:55:18.908875 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.908832 2574 scope.go:117] "RemoveContainer" containerID="9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73" Jul 23 16:55:18.909061 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.909044 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73"} err="failed to get container status \"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73\": rpc error: code = NotFound desc = could not find container \"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73\": container with ID starting with 9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73 not found: ID does not exist" Jul 23 16:55:18.909061 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.909061 2574 scope.go:117] "RemoveContainer" containerID="31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd" Jul 23 16:55:18.909268 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.909234 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd"} err="failed to get container status \"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd\": rpc error: code = NotFound desc = could not find container \"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd\": container with ID starting with 31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd not found: ID does not exist" Jul 23 16:55:18.909268 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.909259 2574 scope.go:117] "RemoveContainer" containerID="7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998" Jul 23 16:55:18.909495 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.909479 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998"} err="failed to get container status \"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998\": rpc error: code = NotFound desc = could not find container \"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998\": container with ID starting with 7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998 not found: ID does not exist" Jul 23 16:55:18.909534 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.909497 2574 scope.go:117] "RemoveContainer" containerID="b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068" Jul 23 16:55:18.909685 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.909670 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068"} err="failed to get container status \"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068\": rpc error: code = NotFound desc = could not find container \"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068\": container with ID starting with b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068 not found: ID does not exist" Jul 23 16:55:18.909721 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.909686 2574 scope.go:117] "RemoveContainer" containerID="809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0" Jul 23 16:55:18.909907 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.909892 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0"} err="failed to get container status \"809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0\": rpc error: code = NotFound desc = could not find container \"809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0\": container with ID starting with 809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0 not found: ID does not exist" Jul 23 16:55:18.909945 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.909908 2574 scope.go:117] "RemoveContainer" containerID="be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf" Jul 23 16:55:18.910131 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.910115 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf"} err="failed to get container status \"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf\": rpc error: code = NotFound desc = could not find container \"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf\": container with ID starting with be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf not found: ID does not exist" Jul 23 16:55:18.910180 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.910132 2574 scope.go:117] "RemoveContainer" containerID="fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299" Jul 23 16:55:18.910352 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.910335 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299"} err="failed to get container status \"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299\": rpc error: code = NotFound desc = could not find container \"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299\": container with ID starting with fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299 not found: ID does not exist" Jul 23 16:55:18.910399 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.910353 2574 scope.go:117] "RemoveContainer" containerID="9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73" Jul 23 16:55:18.910586 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.910565 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73"} err="failed to get container status \"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73\": rpc error: code = NotFound desc = could not find container \"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73\": container with ID starting with 9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73 not found: ID does not exist" Jul 23 16:55:18.910654 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.910590 2574 scope.go:117] "RemoveContainer" containerID="31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd" Jul 23 16:55:18.910820 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.910803 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd"} err="failed to get container status \"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd\": rpc error: code = NotFound desc = could not find container \"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd\": container with ID starting with 31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd not found: ID does not exist" Jul 23 16:55:18.910892 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.910822 2574 scope.go:117] "RemoveContainer" containerID="7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998" Jul 23 16:55:18.911084 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.911061 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998"} err="failed to get container status \"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998\": rpc error: code = NotFound desc = could not find container \"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998\": container with ID starting with 7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998 not found: ID does not exist" Jul 23 16:55:18.911084 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.911084 2574 scope.go:117] "RemoveContainer" containerID="b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068" Jul 23 16:55:18.911300 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.911281 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068"} err="failed to get container status \"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068\": rpc error: code = NotFound desc = could not find container \"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068\": container with ID starting with b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068 not found: ID does not exist" Jul 23 16:55:18.911341 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.911302 2574 scope.go:117] "RemoveContainer" containerID="809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0" Jul 23 16:55:18.911534 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.911515 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0"} err="failed to get container status \"809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0\": rpc error: code = NotFound desc = could not find container \"809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0\": container with ID starting with 809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0 not found: ID does not exist" Jul 23 16:55:18.911583 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.911535 2574 scope.go:117] "RemoveContainer" containerID="be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf" Jul 23 16:55:18.911744 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.911729 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf"} err="failed to get container status \"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf\": rpc error: code = NotFound desc = could not find container \"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf\": container with ID starting with be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf not found: ID does not exist" Jul 23 16:55:18.911794 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.911746 2574 scope.go:117] "RemoveContainer" containerID="fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299" Jul 23 16:55:18.911946 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.911927 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299"} err="failed to get container status \"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299\": rpc error: code = NotFound desc = could not find container \"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299\": container with ID starting with fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299 not found: ID does not exist" Jul 23 16:55:18.911946 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.911944 2574 scope.go:117] "RemoveContainer" containerID="9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73" Jul 23 16:55:18.912207 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.912190 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73"} err="failed to get container status \"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73\": rpc error: code = NotFound desc = could not find container \"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73\": container with ID starting with 9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73 not found: ID does not exist" Jul 23 16:55:18.912277 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.912209 2574 scope.go:117] "RemoveContainer" containerID="31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd" Jul 23 16:55:18.912419 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.912404 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd"} err="failed to get container status \"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd\": rpc error: code = NotFound desc = could not find container \"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd\": container with ID starting with 31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd not found: ID does not exist" Jul 23 16:55:18.912472 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.912421 2574 scope.go:117] "RemoveContainer" containerID="7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998" Jul 23 16:55:18.912622 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.912600 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998"} err="failed to get container status \"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998\": rpc error: code = NotFound desc = could not find container \"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998\": container with ID starting with 7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998 not found: ID does not exist" Jul 23 16:55:18.912622 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.912622 2574 scope.go:117] "RemoveContainer" containerID="b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068" Jul 23 16:55:18.912786 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.912769 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068"} err="failed to get container status \"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068\": rpc error: code = NotFound desc = could not find container \"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068\": container with ID starting with b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068 not found: ID does not exist" Jul 23 16:55:18.912823 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.912786 2574 scope.go:117] "RemoveContainer" containerID="809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0" Jul 23 16:55:18.913067 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.912993 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0"} err="failed to get container status \"809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0\": rpc error: code = NotFound desc = could not find container \"809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0\": container with ID starting with 809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0 not found: ID does not exist" Jul 23 16:55:18.913067 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.913032 2574 scope.go:117] "RemoveContainer" containerID="be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf" Jul 23 16:55:18.913272 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.913253 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf"} err="failed to get container status \"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf\": rpc error: code = NotFound desc = could not find container \"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf\": container with ID starting with be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf not found: ID does not exist" Jul 23 16:55:18.913316 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.913272 2574 scope.go:117] "RemoveContainer" containerID="fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299" Jul 23 16:55:18.913488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.913469 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299"} err="failed to get container status \"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299\": rpc error: code = NotFound desc = could not find container \"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299\": container with ID starting with fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299 not found: ID does not exist" Jul 23 16:55:18.913561 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.913490 2574 scope.go:117] "RemoveContainer" containerID="9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73" Jul 23 16:55:18.913693 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.913676 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73"} err="failed to get container status \"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73\": rpc error: code = NotFound desc = could not find container \"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73\": container with ID starting with 9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73 not found: ID does not exist" Jul 23 16:55:18.913752 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.913694 2574 scope.go:117] "RemoveContainer" containerID="31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd" Jul 23 16:55:18.913899 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.913884 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd"} err="failed to get container status \"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd\": rpc error: code = NotFound desc = could not find container \"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd\": container with ID starting with 31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd not found: ID does not exist" Jul 23 16:55:18.913962 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.913901 2574 scope.go:117] "RemoveContainer" containerID="7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998" Jul 23 16:55:18.914151 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.914135 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998"} err="failed to get container status \"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998\": rpc error: code = NotFound desc = could not find container \"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998\": container with ID starting with 7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998 not found: ID does not exist" Jul 23 16:55:18.914221 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.914152 2574 scope.go:117] "RemoveContainer" containerID="b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068" Jul 23 16:55:18.914374 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.914357 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068"} err="failed to get container status \"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068\": rpc error: code = NotFound desc = could not find container \"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068\": container with ID starting with b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068 not found: ID does not exist" Jul 23 16:55:18.914414 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.914374 2574 scope.go:117] "RemoveContainer" containerID="809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0" Jul 23 16:55:18.914600 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.914581 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0"} err="failed to get container status \"809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0\": rpc error: code = NotFound desc = could not find container \"809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0\": container with ID starting with 809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0 not found: ID does not exist" Jul 23 16:55:18.914642 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.914601 2574 scope.go:117] "RemoveContainer" containerID="be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf" Jul 23 16:55:18.914811 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.914794 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf"} err="failed to get container status \"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf\": rpc error: code = NotFound desc = could not find container \"be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf\": container with ID starting with be2f98034d2bda60b70e9b03e1b375b6eac68f16d57925fd14a61b4567318ebf not found: ID does not exist" Jul 23 16:55:18.914857 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.914812 2574 scope.go:117] "RemoveContainer" containerID="fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299" Jul 23 16:55:18.915040 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.915018 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299"} err="failed to get container status \"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299\": rpc error: code = NotFound desc = could not find container \"fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299\": container with ID starting with fd75f85c9a06e97811cc204b16c277a7cd31bdfdcc6a974d4a9ff5752eceb299 not found: ID does not exist" Jul 23 16:55:18.915089 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.915042 2574 scope.go:117] "RemoveContainer" containerID="9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73" Jul 23 16:55:18.915264 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.915248 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73"} err="failed to get container status \"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73\": rpc error: code = NotFound desc = could not find container \"9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73\": container with ID starting with 9a9417e9efb0c01d107165f3bbe9e418065c9755387d851b87fb5e146e299d73 not found: ID does not exist" Jul 23 16:55:18.915313 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.915264 2574 scope.go:117] "RemoveContainer" containerID="31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd" Jul 23 16:55:18.915483 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.915465 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd"} err="failed to get container status \"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd\": rpc error: code = NotFound desc = could not find container \"31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd\": container with ID starting with 31a61f74046e102f48f6caaa6f9eea72ff2d23c81c7e936a0ebc67359ac123cd not found: ID does not exist" Jul 23 16:55:18.915483 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.915482 2574 scope.go:117] "RemoveContainer" containerID="7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998" Jul 23 16:55:18.915701 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.915684 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998"} err="failed to get container status \"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998\": rpc error: code = NotFound desc = could not find container \"7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998\": container with ID starting with 7aa5353f8a378677c8220d6f7032be91d1112b605a9366da36d9905e48264998 not found: ID does not exist" Jul 23 16:55:18.915759 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.915702 2574 scope.go:117] "RemoveContainer" containerID="b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068" Jul 23 16:55:18.915919 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.915900 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068"} err="failed to get container status \"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068\": rpc error: code = NotFound desc = could not find container \"b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068\": container with ID starting with b5ce6ee86d88f5b609d5852e136bb76bbc78357d854ff714a3e6a6296084e068 not found: ID does not exist" Jul 23 16:55:18.915984 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.915921 2574 scope.go:117] "RemoveContainer" containerID="809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0" Jul 23 16:55:18.916182 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.916165 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0"} err="failed to get container status \"809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0\": rpc error: code = NotFound desc = could not find container \"809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0\": container with ID starting with 809baf8397bea966d1907e6b64b478ad494a22920ee9da9eeb052abd0464b2e0 not found: ID does not exist" Jul 23 16:55:18.942473 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942447 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 16:55:18.942789 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942776 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="kube-rbac-proxy-thanos" Jul 23 16:55:18.942835 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942791 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="kube-rbac-proxy-thanos" Jul 23 16:55:18.942835 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942802 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="kube-rbac-proxy" Jul 23 16:55:18.942835 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942807 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="kube-rbac-proxy" Jul 23 16:55:18.942835 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942814 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="config-reloader" Jul 23 16:55:18.942835 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942819 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="config-reloader" Jul 23 16:55:18.942835 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942826 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="kube-rbac-proxy-web" Jul 23 16:55:18.942835 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942831 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="kube-rbac-proxy-web" Jul 23 16:55:18.943047 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942843 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="init-config-reloader" Jul 23 16:55:18.943047 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942849 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="init-config-reloader" Jul 23 16:55:18.943047 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942856 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="thanos-sidecar" Jul 23 16:55:18.943047 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942860 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="thanos-sidecar" Jul 23 16:55:18.943047 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942867 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="prometheus" Jul 23 16:55:18.943047 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942872 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="prometheus" Jul 23 16:55:18.943047 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942916 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="kube-rbac-proxy" Jul 23 16:55:18.943047 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942923 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="kube-rbac-proxy-thanos" Jul 23 16:55:18.943047 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942930 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="thanos-sidecar" Jul 23 16:55:18.943047 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942936 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="kube-rbac-proxy-web" Jul 23 16:55:18.943047 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942942 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="config-reloader" Jul 23 16:55:18.943047 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.942947 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="210211fd-9035-40be-a4ec-b9660171703d" containerName="prometheus" Jul 23 16:55:18.950274 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.950245 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:18.955804 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.955773 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 23 16:55:18.955919 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.955832 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 23 16:55:18.955919 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.955868 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 23 16:55:18.956570 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.956550 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 23 16:55:18.956570 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.956563 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 23 16:55:18.956704 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.956618 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8spwt\"" Jul 23 16:55:18.957105 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.957089 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 23 16:55:18.957157 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.957103 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 23 16:55:18.958093 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.958076 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 23 16:55:18.958189 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.958169 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 23 16:55:18.959869 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.959414 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 23 16:55:18.959869 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.959427 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 23 16:55:18.959869 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.959849 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1k5krv8uh7n65\"" Jul 23 16:55:18.961175 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.961142 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 23 16:55:18.961574 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.961557 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 23 16:55:18.964645 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.964620 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 23 16:55:18.988871 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:18.988851 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 16:55:19.065284 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.065253 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-web-config\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.065284 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.065288 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.065518 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.065310 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.065518 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.065339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb330d1e-a3f0-4745-8ceb-19f2fe032862-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.065518 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.065363 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.065518 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.065380 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.065518 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.065396 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.065518 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.065418 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.065518 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.065503 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.065854 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.065536 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.065854 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.065571 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.065854 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.065604 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.065854 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.065655 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.065854 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.065681 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.065854 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.065708 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-config\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.065854 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.065739 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb330d1e-a3f0-4745-8ceb-19f2fe032862-config-out\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.065854 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.065763 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.065854 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.065787 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eb330d1e-a3f0-4745-8ceb-19f2fe032862-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.065854 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.065814 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5knp\" (UniqueName: \"kubernetes.io/projected/eb330d1e-a3f0-4745-8ceb-19f2fe032862-kube-api-access-k5knp\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.065854 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.065840 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.166945 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.166832 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.166945 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.166895 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.166945 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.166926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.167264 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.167089 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-config\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.167264 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.167127 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb330d1e-a3f0-4745-8ceb-19f2fe032862-config-out\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.167264 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.167155 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.167264 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.167178 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eb330d1e-a3f0-4745-8ceb-19f2fe032862-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.167264 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.167204 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5knp\" (UniqueName: \"kubernetes.io/projected/eb330d1e-a3f0-4745-8ceb-19f2fe032862-kube-api-access-k5knp\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.167264 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.167230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.167551 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.167294 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-web-config\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.167551 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.167322 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.167551 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.167360 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.167551 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.167395 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb330d1e-a3f0-4745-8ceb-19f2fe032862-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.167551 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.167421 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.167551 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.167443 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.167551 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.167482 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.167551 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.167508 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.167551 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.167513 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eb330d1e-a3f0-4745-8ceb-19f2fe032862-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.167973 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.167926 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.168047 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.168028 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.169025 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.168609 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.169992 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.169964 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.170109 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.170091 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-config\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.170109 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.170103 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.170229 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.170088 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.170289 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.170227 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.170289 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.170257 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.170388 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.170308 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.170555 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.170531 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb330d1e-a3f0-4745-8ceb-19f2fe032862-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.170629 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.170590 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.170969 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.170705 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-web-config\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.170969 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.170720 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.171127 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.171112 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.171352 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.171329 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.171535 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.171520 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.172258 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.172242 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb330d1e-a3f0-4745-8ceb-19f2fe032862-config-out\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.172876 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.172856 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.173276 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.173260 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eb330d1e-a3f0-4745-8ceb-19f2fe032862-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.174030 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.173993 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eb330d1e-a3f0-4745-8ceb-19f2fe032862-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.179302 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.179286 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5knp\" (UniqueName: \"kubernetes.io/projected/eb330d1e-a3f0-4745-8ceb-19f2fe032862-kube-api-access-k5knp\") pod \"prometheus-k8s-0\" (UID: \"eb330d1e-a3f0-4745-8ceb-19f2fe032862\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.262444 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.262415 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:19.440285 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.440263 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 16:55:19.440687 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:55:19.440664 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb330d1e_a3f0_4745_8ceb_19f2fe032862.slice/crio-64ba869463a33476256708cd37b667030ec3df61201b4076ea47f5b119809abe WatchSource:0}: Error finding container 64ba869463a33476256708cd37b667030ec3df61201b4076ea47f5b119809abe: Status 404 returned error can't find the container with id 64ba869463a33476256708cd37b667030ec3df61201b4076ea47f5b119809abe Jul 23 16:55:19.863165 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.863132 2574 generic.go:356] "Generic (PLEG): container finished" podID="eb330d1e-a3f0-4745-8ceb-19f2fe032862" containerID="e8dd9ed198aee3346220d38d70bac3c6df6848d7349f3d1409bc7e2365b98008" exitCode=0 Jul 23 16:55:19.863609 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.863226 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb330d1e-a3f0-4745-8ceb-19f2fe032862","Type":"ContainerDied","Data":"e8dd9ed198aee3346220d38d70bac3c6df6848d7349f3d1409bc7e2365b98008"} Jul 23 16:55:19.863609 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:19.863317 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb330d1e-a3f0-4745-8ceb-19f2fe032862","Type":"ContainerStarted","Data":"64ba869463a33476256708cd37b667030ec3df61201b4076ea47f5b119809abe"} Jul 23 16:55:20.115614 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:20.115570 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="210211fd-9035-40be-a4ec-b9660171703d" path="/var/lib/kubelet/pods/210211fd-9035-40be-a4ec-b9660171703d/volumes" Jul 23 16:55:20.871922 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:20.871890 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb330d1e-a3f0-4745-8ceb-19f2fe032862","Type":"ContainerStarted","Data":"867d2bf88ee3ce31975f1ffe90e4f71cf42655ada4e2ad2463eae71a05421cfe"} Jul 23 16:55:20.872297 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:20.871984 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb330d1e-a3f0-4745-8ceb-19f2fe032862","Type":"ContainerStarted","Data":"e7ab5daf643cbd1898085a6955974e251823338ec0925bb90fef84a9b667e15a"} Jul 23 16:55:20.872297 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:20.872025 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb330d1e-a3f0-4745-8ceb-19f2fe032862","Type":"ContainerStarted","Data":"9a06c4b1c02869fa523220f4b9b74febe22ba404085403b0fa0a1c8798e20689"} Jul 23 16:55:20.872297 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:20.872052 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb330d1e-a3f0-4745-8ceb-19f2fe032862","Type":"ContainerStarted","Data":"378737e928ae62e467963f7e7efe756c9c6f3223b421e04cd1fce6d8964f8bc5"} Jul 23 16:55:20.872297 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:20.872074 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb330d1e-a3f0-4745-8ceb-19f2fe032862","Type":"ContainerStarted","Data":"d40ee99a27d37eb82c7974f480399dfa9a41997fd78a89441edfeca148d738a3"} Jul 23 16:55:20.872297 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:20.872097 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb330d1e-a3f0-4745-8ceb-19f2fe032862","Type":"ContainerStarted","Data":"961cd0db1497f9d147bc8f03717f29e9b629a60cd300fa7cd10f97e469635d67"} Jul 23 16:55:21.047386 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:21.047307 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.028207671 podStartE2EDuration="3.047285247s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.077576ms" isStatefulPod=false podCreationTimestamp="2026-07-23 16:55:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:55:21.041276681 +0000 UTC m=+167.515092062" watchObservedRunningTime="2026-07-23 16:55:21.047285247 +0000 UTC m=+167.521100630" Jul 23 16:55:23.290453 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.290420 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fc566b87c-mmftd"] Jul 23 16:55:23.293239 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.292819 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.318326 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.318294 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc566b87c-mmftd"] Jul 23 16:55:23.412656 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.412618 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5feebbc0-c0be-4845-984d-10fc77b6d298-console-serving-cert\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.412656 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.412655 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-trusted-ca-bundle\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.412859 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.412690 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-oauth-serving-cert\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.412859 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.412713 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-service-ca\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.412859 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.412741 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5feebbc0-c0be-4845-984d-10fc77b6d298-console-oauth-config\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.412859 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.412764 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdhsc\" (UniqueName: \"kubernetes.io/projected/5feebbc0-c0be-4845-984d-10fc77b6d298-kube-api-access-sdhsc\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.412859 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.412798 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-console-config\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.513738 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.513698 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5feebbc0-c0be-4845-984d-10fc77b6d298-console-serving-cert\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.513909 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.513745 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-trusted-ca-bundle\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.513909 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.513779 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-oauth-serving-cert\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.513909 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.513803 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-service-ca\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.513909 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.513843 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5feebbc0-c0be-4845-984d-10fc77b6d298-console-oauth-config\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.513909 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.513870 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdhsc\" (UniqueName: \"kubernetes.io/projected/5feebbc0-c0be-4845-984d-10fc77b6d298-kube-api-access-sdhsc\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.513909 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.513904 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-console-config\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.514716 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.514691 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-console-config\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.514878 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.514744 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-oauth-serving-cert\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.515495 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.515447 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-service-ca\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.515856 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.515829 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-trusted-ca-bundle\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.517337 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.517316 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5feebbc0-c0be-4845-984d-10fc77b6d298-console-oauth-config\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.517527 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.517512 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5feebbc0-c0be-4845-984d-10fc77b6d298-console-serving-cert\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.531695 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.531657 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdhsc\" (UniqueName: \"kubernetes.io/projected/5feebbc0-c0be-4845-984d-10fc77b6d298-kube-api-access-sdhsc\") pod \"console-fc566b87c-mmftd\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.603154 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.603055 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:23.955627 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:23.955599 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc566b87c-mmftd"] Jul 23 16:55:23.959479 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:55:23.959453 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5feebbc0_c0be_4845_984d_10fc77b6d298.slice/crio-4a01000870e00bf3984ca9d6811fa1746aacfcbb09026b1f2eacf249f736abfc WatchSource:0}: Error finding container 4a01000870e00bf3984ca9d6811fa1746aacfcbb09026b1f2eacf249f736abfc: Status 404 returned error can't find the container with id 4a01000870e00bf3984ca9d6811fa1746aacfcbb09026b1f2eacf249f736abfc Jul 23 16:55:24.263355 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:24.263262 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:55:24.890385 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:24.890346 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc566b87c-mmftd" event={"ID":"5feebbc0-c0be-4845-984d-10fc77b6d298","Type":"ContainerStarted","Data":"b1c60922595e0d385d39902e96eb09d6e2842855a93ec2ae1518212f36dfbf02"} Jul 23 16:55:24.890883 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:24.890398 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc566b87c-mmftd" event={"ID":"5feebbc0-c0be-4845-984d-10fc77b6d298","Type":"ContainerStarted","Data":"4a01000870e00bf3984ca9d6811fa1746aacfcbb09026b1f2eacf249f736abfc"} Jul 23 16:55:24.926350 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:24.926290 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fc566b87c-mmftd" podStartSLOduration=1.926273445 podStartE2EDuration="1.926273445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:55:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:55:24.926258909 +0000 UTC m=+171.400074291" watchObservedRunningTime="2026-07-23 16:55:24.926273445 +0000 UTC m=+171.400088825" Jul 23 16:55:33.604326 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:33.604240 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:33.604326 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:33.604309 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:33.609057 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:33.609034 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:33.931736 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:33.931665 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:55:33.998243 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:33.998203 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b859b9586-n8pjc"] Jul 23 16:55:59.024198 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.024158 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b859b9586-n8pjc" podUID="341ca8ba-a4ea-4e63-aba7-fde9b84c9589" containerName="console" containerID="cri-o://59cf91c630e31a5744240cbaef65bf7918f47216af3326226a0c4e8685abb990" gracePeriod=15 Jul 23 16:55:59.289050 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.289026 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:55:59.350396 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.350361 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-oauth-serving-cert\") pod \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " Jul 23 16:55:59.350560 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.350403 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-service-ca\") pod \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " Jul 23 16:55:59.350560 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.350430 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-trusted-ca-bundle\") pod \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " Jul 23 16:55:59.350662 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.350630 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-console-config\") pod \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " Jul 23 16:55:59.350756 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.350739 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-console-oauth-config\") pod \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " Jul 23 16:55:59.350756 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.350744 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-service-ca" (OuterVolumeSpecName: "service-ca") pod "341ca8ba-a4ea-4e63-aba7-fde9b84c9589" (UID: "341ca8ba-a4ea-4e63-aba7-fde9b84c9589"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:55:59.350878 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.350775 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svnzp\" (UniqueName: \"kubernetes.io/projected/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-kube-api-access-svnzp\") pod \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " Jul 23 16:55:59.350932 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.350781 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "341ca8ba-a4ea-4e63-aba7-fde9b84c9589" (UID: "341ca8ba-a4ea-4e63-aba7-fde9b84c9589"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:55:59.350932 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.350830 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "341ca8ba-a4ea-4e63-aba7-fde9b84c9589" (UID: "341ca8ba-a4ea-4e63-aba7-fde9b84c9589"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:55:59.351081 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.350832 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-console-serving-cert\") pod \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\" (UID: \"341ca8ba-a4ea-4e63-aba7-fde9b84c9589\") " Jul 23 16:55:59.351081 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.350948 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-console-config" (OuterVolumeSpecName: "console-config") pod "341ca8ba-a4ea-4e63-aba7-fde9b84c9589" (UID: "341ca8ba-a4ea-4e63-aba7-fde9b84c9589"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:55:59.351194 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.351177 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-console-config\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:59.351230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.351196 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-oauth-serving-cert\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:59.351230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.351206 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-service-ca\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:59.351230 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.351215 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-trusted-ca-bundle\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:59.352769 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.352749 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-kube-api-access-svnzp" (OuterVolumeSpecName: "kube-api-access-svnzp") pod "341ca8ba-a4ea-4e63-aba7-fde9b84c9589" (UID: "341ca8ba-a4ea-4e63-aba7-fde9b84c9589"). InnerVolumeSpecName "kube-api-access-svnzp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 16:55:59.353234 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.353213 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "341ca8ba-a4ea-4e63-aba7-fde9b84c9589" (UID: "341ca8ba-a4ea-4e63-aba7-fde9b84c9589"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:55:59.353234 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.353226 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "341ca8ba-a4ea-4e63-aba7-fde9b84c9589" (UID: "341ca8ba-a4ea-4e63-aba7-fde9b84c9589"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:55:59.451875 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.451832 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-console-oauth-config\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:59.451875 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.451865 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svnzp\" (UniqueName: \"kubernetes.io/projected/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-kube-api-access-svnzp\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:55:59.451875 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:55:59.451881 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/341ca8ba-a4ea-4e63-aba7-fde9b84c9589-console-serving-cert\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:56:00.032698 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:00.032661 2574 generic.go:356] "Generic (PLEG): container finished" podID="341ca8ba-a4ea-4e63-aba7-fde9b84c9589" containerID="59cf91c630e31a5744240cbaef65bf7918f47216af3326226a0c4e8685abb990" exitCode=0 Jul 23 16:56:00.033083 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:00.032711 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b859b9586-n8pjc" Jul 23 16:56:00.033083 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:00.032753 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b859b9586-n8pjc" event={"ID":"341ca8ba-a4ea-4e63-aba7-fde9b84c9589","Type":"ContainerDied","Data":"59cf91c630e31a5744240cbaef65bf7918f47216af3326226a0c4e8685abb990"} Jul 23 16:56:00.033083 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:00.032981 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b859b9586-n8pjc" event={"ID":"341ca8ba-a4ea-4e63-aba7-fde9b84c9589","Type":"ContainerDied","Data":"53c706c5f8ce44828f9bdf9d1bb23b8034deaf5f3b5fd45226a74c1bf2090f72"} Jul 23 16:56:00.033263 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:00.033200 2574 scope.go:117] "RemoveContainer" containerID="59cf91c630e31a5744240cbaef65bf7918f47216af3326226a0c4e8685abb990" Jul 23 16:56:00.046921 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:00.046898 2574 scope.go:117] "RemoveContainer" containerID="59cf91c630e31a5744240cbaef65bf7918f47216af3326226a0c4e8685abb990" Jul 23 16:56:00.047227 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:56:00.047206 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59cf91c630e31a5744240cbaef65bf7918f47216af3326226a0c4e8685abb990\": container with ID starting with 59cf91c630e31a5744240cbaef65bf7918f47216af3326226a0c4e8685abb990 not found: ID does not exist" containerID="59cf91c630e31a5744240cbaef65bf7918f47216af3326226a0c4e8685abb990" Jul 23 16:56:00.047286 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:00.047237 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59cf91c630e31a5744240cbaef65bf7918f47216af3326226a0c4e8685abb990"} err="failed to get container status \"59cf91c630e31a5744240cbaef65bf7918f47216af3326226a0c4e8685abb990\": rpc error: code = NotFound desc = could not find container \"59cf91c630e31a5744240cbaef65bf7918f47216af3326226a0c4e8685abb990\": container with ID starting with 59cf91c630e31a5744240cbaef65bf7918f47216af3326226a0c4e8685abb990 not found: ID does not exist" Jul 23 16:56:00.060295 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:00.060269 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b859b9586-n8pjc"] Jul 23 16:56:00.067032 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:00.066988 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b859b9586-n8pjc"] Jul 23 16:56:00.111460 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:00.111430 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="341ca8ba-a4ea-4e63-aba7-fde9b84c9589" path="/var/lib/kubelet/pods/341ca8ba-a4ea-4e63-aba7-fde9b84c9589/volumes" Jul 23 16:56:19.263560 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:19.263518 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:56:19.278989 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:19.278964 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:56:20.128774 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:20.128748 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 16:56:28.424116 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.424085 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b576fd95c-t569f"] Jul 23 16:56:28.424600 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.424405 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="341ca8ba-a4ea-4e63-aba7-fde9b84c9589" containerName="console" Jul 23 16:56:28.424600 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.424415 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="341ca8ba-a4ea-4e63-aba7-fde9b84c9589" containerName="console" Jul 23 16:56:28.424600 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.424482 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="341ca8ba-a4ea-4e63-aba7-fde9b84c9589" containerName="console" Jul 23 16:56:28.427075 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.427057 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.443854 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.443830 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b576fd95c-t569f"] Jul 23 16:56:28.508771 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.508742 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d11607e5-3325-408d-b705-7c7682487568-console-config\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.508957 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.508780 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d11607e5-3325-408d-b705-7c7682487568-console-oauth-config\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.508957 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.508802 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d11607e5-3325-408d-b705-7c7682487568-trusted-ca-bundle\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.508957 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.508819 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d11607e5-3325-408d-b705-7c7682487568-oauth-serving-cert\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.508957 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.508891 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d11607e5-3325-408d-b705-7c7682487568-service-ca\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.509136 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.508963 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmlmn\" (UniqueName: \"kubernetes.io/projected/d11607e5-3325-408d-b705-7c7682487568-kube-api-access-kmlmn\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.509136 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.509027 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d11607e5-3325-408d-b705-7c7682487568-console-serving-cert\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.609898 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.609860 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d11607e5-3325-408d-b705-7c7682487568-console-oauth-config\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.609898 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.609900 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d11607e5-3325-408d-b705-7c7682487568-trusted-ca-bundle\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.610147 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.609918 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d11607e5-3325-408d-b705-7c7682487568-oauth-serving-cert\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.610147 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.609993 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d11607e5-3325-408d-b705-7c7682487568-service-ca\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.610147 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.610066 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmlmn\" (UniqueName: \"kubernetes.io/projected/d11607e5-3325-408d-b705-7c7682487568-kube-api-access-kmlmn\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.610147 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.610097 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d11607e5-3325-408d-b705-7c7682487568-console-serving-cert\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.610355 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.610152 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d11607e5-3325-408d-b705-7c7682487568-console-config\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.610744 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.610717 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d11607e5-3325-408d-b705-7c7682487568-oauth-serving-cert\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.610909 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.610885 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d11607e5-3325-408d-b705-7c7682487568-console-config\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.610909 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.610893 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d11607e5-3325-408d-b705-7c7682487568-service-ca\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.611102 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.611043 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d11607e5-3325-408d-b705-7c7682487568-trusted-ca-bundle\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.612626 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.612604 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d11607e5-3325-408d-b705-7c7682487568-console-oauth-config\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.612699 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.612679 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d11607e5-3325-408d-b705-7c7682487568-console-serving-cert\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.618872 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.618849 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmlmn\" (UniqueName: \"kubernetes.io/projected/d11607e5-3325-408d-b705-7c7682487568-kube-api-access-kmlmn\") pod \"console-b576fd95c-t569f\" (UID: \"d11607e5-3325-408d-b705-7c7682487568\") " pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.736360 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.736335 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:28.876259 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:28.876237 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b576fd95c-t569f"] Jul 23 16:56:28.878645 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:56:28.878612 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd11607e5_3325_408d_b705_7c7682487568.slice/crio-29bef2558d0d1c6b06a6aee0586c0ffce60f97e22c73519c61a62ae09e2d8f8e WatchSource:0}: Error finding container 29bef2558d0d1c6b06a6aee0586c0ffce60f97e22c73519c61a62ae09e2d8f8e: Status 404 returned error can't find the container with id 29bef2558d0d1c6b06a6aee0586c0ffce60f97e22c73519c61a62ae09e2d8f8e Jul 23 16:56:29.145808 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:29.145722 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b576fd95c-t569f" event={"ID":"d11607e5-3325-408d-b705-7c7682487568","Type":"ContainerStarted","Data":"07869827ffd554e1ea530c2a3aa67f374611e3167118523b361910ec3302775b"} Jul 23 16:56:29.145808 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:29.145780 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b576fd95c-t569f" event={"ID":"d11607e5-3325-408d-b705-7c7682487568","Type":"ContainerStarted","Data":"29bef2558d0d1c6b06a6aee0586c0ffce60f97e22c73519c61a62ae09e2d8f8e"} Jul 23 16:56:38.737084 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:38.737057 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:38.737476 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:38.737133 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:38.741770 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:38.741748 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:38.767062 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:38.767017 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b576fd95c-t569f" podStartSLOduration=10.766991534 podStartE2EDuration="10.766991534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:56:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:56:29.182774911 +0000 UTC m=+235.656590292" watchObservedRunningTime="2026-07-23 16:56:38.766991534 +0000 UTC m=+245.240806914" Jul 23 16:56:39.189586 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:39.189509 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b576fd95c-t569f" Jul 23 16:56:39.279618 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:56:39.279588 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fc566b87c-mmftd"] Jul 23 16:57:04.299633 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.299592 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fc566b87c-mmftd" podUID="5feebbc0-c0be-4845-984d-10fc77b6d298" containerName="console" containerID="cri-o://b1c60922595e0d385d39902e96eb09d6e2842855a93ec2ae1518212f36dfbf02" gracePeriod=15 Jul 23 16:57:04.541114 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.541090 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:57:04.615298 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.615209 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5feebbc0-c0be-4845-984d-10fc77b6d298-console-serving-cert\") pod \"5feebbc0-c0be-4845-984d-10fc77b6d298\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " Jul 23 16:57:04.615298 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.615246 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5feebbc0-c0be-4845-984d-10fc77b6d298-console-oauth-config\") pod \"5feebbc0-c0be-4845-984d-10fc77b6d298\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " Jul 23 16:57:04.615298 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.615281 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-console-config\") pod \"5feebbc0-c0be-4845-984d-10fc77b6d298\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " Jul 23 16:57:04.615560 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.615321 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-oauth-serving-cert\") pod \"5feebbc0-c0be-4845-984d-10fc77b6d298\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " Jul 23 16:57:04.615560 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.615348 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-trusted-ca-bundle\") pod \"5feebbc0-c0be-4845-984d-10fc77b6d298\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " Jul 23 16:57:04.615560 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.615381 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-service-ca\") pod \"5feebbc0-c0be-4845-984d-10fc77b6d298\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " Jul 23 16:57:04.615560 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.615407 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdhsc\" (UniqueName: \"kubernetes.io/projected/5feebbc0-c0be-4845-984d-10fc77b6d298-kube-api-access-sdhsc\") pod \"5feebbc0-c0be-4845-984d-10fc77b6d298\" (UID: \"5feebbc0-c0be-4845-984d-10fc77b6d298\") " Jul 23 16:57:04.615812 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.615785 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-console-config" (OuterVolumeSpecName: "console-config") pod "5feebbc0-c0be-4845-984d-10fc77b6d298" (UID: "5feebbc0-c0be-4845-984d-10fc77b6d298"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:57:04.615884 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.615814 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5feebbc0-c0be-4845-984d-10fc77b6d298" (UID: "5feebbc0-c0be-4845-984d-10fc77b6d298"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:57:04.615884 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.615872 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-service-ca" (OuterVolumeSpecName: "service-ca") pod "5feebbc0-c0be-4845-984d-10fc77b6d298" (UID: "5feebbc0-c0be-4845-984d-10fc77b6d298"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:57:04.615995 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.615875 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5feebbc0-c0be-4845-984d-10fc77b6d298" (UID: "5feebbc0-c0be-4845-984d-10fc77b6d298"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 16:57:04.617457 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.617434 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5feebbc0-c0be-4845-984d-10fc77b6d298-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5feebbc0-c0be-4845-984d-10fc77b6d298" (UID: "5feebbc0-c0be-4845-984d-10fc77b6d298"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:57:04.617630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.617614 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5feebbc0-c0be-4845-984d-10fc77b6d298-kube-api-access-sdhsc" (OuterVolumeSpecName: "kube-api-access-sdhsc") pod "5feebbc0-c0be-4845-984d-10fc77b6d298" (UID: "5feebbc0-c0be-4845-984d-10fc77b6d298"). InnerVolumeSpecName "kube-api-access-sdhsc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 16:57:04.617630 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.617619 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5feebbc0-c0be-4845-984d-10fc77b6d298-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5feebbc0-c0be-4845-984d-10fc77b6d298" (UID: "5feebbc0-c0be-4845-984d-10fc77b6d298"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 16:57:04.716348 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.716307 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-console-config\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:57:04.716348 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.716342 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-oauth-serving-cert\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:57:04.716348 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.716356 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-trusted-ca-bundle\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:57:04.716603 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.716368 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5feebbc0-c0be-4845-984d-10fc77b6d298-service-ca\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:57:04.716603 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.716380 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdhsc\" (UniqueName: \"kubernetes.io/projected/5feebbc0-c0be-4845-984d-10fc77b6d298-kube-api-access-sdhsc\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:57:04.716603 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.716392 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5feebbc0-c0be-4845-984d-10fc77b6d298-console-serving-cert\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:57:04.716603 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:04.716403 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5feebbc0-c0be-4845-984d-10fc77b6d298-console-oauth-config\") on node \"ip-10-0-138-250.ec2.internal\" DevicePath \"\"" Jul 23 16:57:05.289658 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:05.289627 2574 generic.go:356] "Generic (PLEG): container finished" podID="5feebbc0-c0be-4845-984d-10fc77b6d298" containerID="b1c60922595e0d385d39902e96eb09d6e2842855a93ec2ae1518212f36dfbf02" exitCode=0 Jul 23 16:57:05.289838 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:05.289674 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc566b87c-mmftd" Jul 23 16:57:05.289838 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:05.289720 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc566b87c-mmftd" event={"ID":"5feebbc0-c0be-4845-984d-10fc77b6d298","Type":"ContainerDied","Data":"b1c60922595e0d385d39902e96eb09d6e2842855a93ec2ae1518212f36dfbf02"} Jul 23 16:57:05.289838 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:05.289769 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc566b87c-mmftd" event={"ID":"5feebbc0-c0be-4845-984d-10fc77b6d298","Type":"ContainerDied","Data":"4a01000870e00bf3984ca9d6811fa1746aacfcbb09026b1f2eacf249f736abfc"} Jul 23 16:57:05.289838 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:05.289790 2574 scope.go:117] "RemoveContainer" containerID="b1c60922595e0d385d39902e96eb09d6e2842855a93ec2ae1518212f36dfbf02" Jul 23 16:57:05.298885 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:05.298867 2574 scope.go:117] "RemoveContainer" containerID="b1c60922595e0d385d39902e96eb09d6e2842855a93ec2ae1518212f36dfbf02" Jul 23 16:57:05.299186 ip-10-0-138-250 kubenswrapper[2574]: E0723 16:57:05.299167 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1c60922595e0d385d39902e96eb09d6e2842855a93ec2ae1518212f36dfbf02\": container with ID starting with b1c60922595e0d385d39902e96eb09d6e2842855a93ec2ae1518212f36dfbf02 not found: ID does not exist" containerID="b1c60922595e0d385d39902e96eb09d6e2842855a93ec2ae1518212f36dfbf02" Jul 23 16:57:05.299246 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:05.299194 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1c60922595e0d385d39902e96eb09d6e2842855a93ec2ae1518212f36dfbf02"} err="failed to get container status \"b1c60922595e0d385d39902e96eb09d6e2842855a93ec2ae1518212f36dfbf02\": rpc error: code = NotFound desc = could not find container \"b1c60922595e0d385d39902e96eb09d6e2842855a93ec2ae1518212f36dfbf02\": container with ID starting with b1c60922595e0d385d39902e96eb09d6e2842855a93ec2ae1518212f36dfbf02 not found: ID does not exist" Jul 23 16:57:05.313963 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:05.313942 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fc566b87c-mmftd"] Jul 23 16:57:05.320160 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:05.320139 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fc566b87c-mmftd"] Jul 23 16:57:06.111078 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:06.111045 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5feebbc0-c0be-4845-984d-10fc77b6d298" path="/var/lib/kubelet/pods/5feebbc0-c0be-4845-984d-10fc77b6d298/volumes" Jul 23 16:57:28.124733 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:28.124698 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qp842/must-gather-t96x7"] Jul 23 16:57:28.125210 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:28.125044 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5feebbc0-c0be-4845-984d-10fc77b6d298" containerName="console" Jul 23 16:57:28.125210 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:28.125056 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5feebbc0-c0be-4845-984d-10fc77b6d298" containerName="console" Jul 23 16:57:28.125210 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:28.125102 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5feebbc0-c0be-4845-984d-10fc77b6d298" containerName="console" Jul 23 16:57:28.130866 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:28.129287 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qp842/must-gather-t96x7" Jul 23 16:57:28.132673 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:28.132654 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qp842\"/\"kube-root-ca.crt\"" Jul 23 16:57:28.133492 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:28.133478 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qp842\"/\"default-dockercfg-t8tp4\"" Jul 23 16:57:28.133544 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:28.133499 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qp842\"/\"openshift-service-ca.crt\"" Jul 23 16:57:28.137664 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:28.137631 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qp842/must-gather-t96x7"] Jul 23 16:57:28.216044 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:28.215980 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prc66\" (UniqueName: \"kubernetes.io/projected/776340aa-bd5c-4c09-9740-6a5c96792834-kube-api-access-prc66\") pod \"must-gather-t96x7\" (UID: \"776340aa-bd5c-4c09-9740-6a5c96792834\") " pod="openshift-must-gather-qp842/must-gather-t96x7" Jul 23 16:57:28.216267 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:28.216112 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/776340aa-bd5c-4c09-9740-6a5c96792834-must-gather-output\") pod \"must-gather-t96x7\" (UID: \"776340aa-bd5c-4c09-9740-6a5c96792834\") " pod="openshift-must-gather-qp842/must-gather-t96x7" Jul 23 16:57:28.316966 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:28.316926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prc66\" (UniqueName: \"kubernetes.io/projected/776340aa-bd5c-4c09-9740-6a5c96792834-kube-api-access-prc66\") pod \"must-gather-t96x7\" (UID: \"776340aa-bd5c-4c09-9740-6a5c96792834\") " pod="openshift-must-gather-qp842/must-gather-t96x7" Jul 23 16:57:28.317183 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:28.316975 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/776340aa-bd5c-4c09-9740-6a5c96792834-must-gather-output\") pod \"must-gather-t96x7\" (UID: \"776340aa-bd5c-4c09-9740-6a5c96792834\") " pod="openshift-must-gather-qp842/must-gather-t96x7" Jul 23 16:57:28.317368 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:28.317347 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/776340aa-bd5c-4c09-9740-6a5c96792834-must-gather-output\") pod \"must-gather-t96x7\" (UID: \"776340aa-bd5c-4c09-9740-6a5c96792834\") " pod="openshift-must-gather-qp842/must-gather-t96x7" Jul 23 16:57:28.326576 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:28.326545 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prc66\" (UniqueName: \"kubernetes.io/projected/776340aa-bd5c-4c09-9740-6a5c96792834-kube-api-access-prc66\") pod \"must-gather-t96x7\" (UID: \"776340aa-bd5c-4c09-9740-6a5c96792834\") " pod="openshift-must-gather-qp842/must-gather-t96x7" Jul 23 16:57:28.455714 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:28.455685 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qp842/must-gather-t96x7" Jul 23 16:57:28.586111 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:28.586089 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qp842/must-gather-t96x7"] Jul 23 16:57:28.588324 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:57:28.588290 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod776340aa_bd5c_4c09_9740_6a5c96792834.slice/crio-65adae8071dd7fb9452101f4342616662a16e75008bd00b56c0c05d7f0c56fee WatchSource:0}: Error finding container 65adae8071dd7fb9452101f4342616662a16e75008bd00b56c0c05d7f0c56fee: Status 404 returned error can't find the container with id 65adae8071dd7fb9452101f4342616662a16e75008bd00b56c0c05d7f0c56fee Jul 23 16:57:29.388394 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:29.388358 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qp842/must-gather-t96x7" event={"ID":"776340aa-bd5c-4c09-9740-6a5c96792834","Type":"ContainerStarted","Data":"65adae8071dd7fb9452101f4342616662a16e75008bd00b56c0c05d7f0c56fee"} Jul 23 16:57:30.396160 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:30.396125 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qp842/must-gather-t96x7" event={"ID":"776340aa-bd5c-4c09-9740-6a5c96792834","Type":"ContainerStarted","Data":"28b8a4396864cb5ce6b77b8b315414f5e68ba368c5f0b057dd78944a6deacad4"} Jul 23 16:57:30.396745 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:30.396169 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qp842/must-gather-t96x7" event={"ID":"776340aa-bd5c-4c09-9740-6a5c96792834","Type":"ContainerStarted","Data":"41ab82bdbce1100313d2c5d5fa4abf5d60b4d8a86c225d9e33e54542007c6c84"} Jul 23 16:57:30.416258 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:30.416209 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qp842/must-gather-t96x7" podStartSLOduration=1.652915438 podStartE2EDuration="2.416192182s" totalImagesPullingTime="763.276744ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:57:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:57:30.414207014 +0000 UTC m=+296.888022396" watchObservedRunningTime="2026-07-23 16:57:30.416192182 +0000 UTC m=+296.890007563" Jul 23 16:57:30.834254 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:30.834213 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kwpqc_7e9af723-4871-490b-8739-6f07536c313d/global-pull-secret-syncer/0.log" Jul 23 16:57:31.032547 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:31.032507 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nmkrm_533e4c7f-7865-43c9-a5d7-8e1426ab19ad/konnectivity-agent/0.log" Jul 23 16:57:31.115747 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:31.115679 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-250.ec2.internal_05ea4021fcfb88e582ecfb9097a979df/haproxy/0.log" Jul 23 16:57:34.069774 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:34.069744 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xsg_109e3c98-c98e-494b-ad16-f6a7caffa6ea/ovn-acl-logging/0.log" Jul 23 16:57:34.070320 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:34.070030 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xsg_109e3c98-c98e-494b-ad16-f6a7caffa6ea/ovn-acl-logging/0.log" Jul 23 16:57:34.081894 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:34.081764 2574 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 16:57:34.349017 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:34.348918 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_956448aa-93ae-4508-9551-065906ff037f/alertmanager/0.log" Jul 23 16:57:34.385036 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:34.384992 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_956448aa-93ae-4508-9551-065906ff037f/config-reloader/0.log" Jul 23 16:57:34.421872 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:34.421849 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_956448aa-93ae-4508-9551-065906ff037f/kube-rbac-proxy-web/0.log" Jul 23 16:57:34.477201 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:34.477159 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_956448aa-93ae-4508-9551-065906ff037f/kube-rbac-proxy/0.log" Jul 23 16:57:34.524146 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:34.524116 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_956448aa-93ae-4508-9551-065906ff037f/kube-rbac-proxy-metric/0.log" Jul 23 16:57:34.571820 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:34.571801 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_956448aa-93ae-4508-9551-065906ff037f/prom-label-proxy/0.log" Jul 23 16:57:34.602352 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:34.602256 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_956448aa-93ae-4508-9551-065906ff037f/init-config-reloader/0.log" Jul 23 16:57:34.672941 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:34.672908 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-pr4rx_8e3c1c31-dc00-4a43-b5cc-bec880c905ea/kube-state-metrics/0.log" Jul 23 16:57:34.699924 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:34.699887 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-pr4rx_8e3c1c31-dc00-4a43-b5cc-bec880c905ea/kube-rbac-proxy-main/0.log" Jul 23 16:57:34.728879 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:34.728847 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-pr4rx_8e3c1c31-dc00-4a43-b5cc-bec880c905ea/kube-rbac-proxy-self/0.log" Jul 23 16:57:34.766836 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:34.766808 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-758548d448-6x4t4_fb887d03-cc33-480b-ab2a-c533d6837b63/metrics-server/0.log" Jul 23 16:57:34.799330 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:34.799299 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-np7l7_dccc051c-b8fb-4c76-904e-52fa96dc73b4/monitoring-plugin/0.log" Jul 23 16:57:34.926025 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:34.925929 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kshk6_cf37e5cd-7840-4620-bd24-8a9df8b3f5a1/node-exporter/0.log" Jul 23 16:57:34.948975 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:34.948946 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kshk6_cf37e5cd-7840-4620-bd24-8a9df8b3f5a1/kube-rbac-proxy/0.log" Jul 23 16:57:34.978824 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:34.978797 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kshk6_cf37e5cd-7840-4620-bd24-8a9df8b3f5a1/init-textfile/0.log" Jul 23 16:57:35.100850 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:35.100820 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-n85ms_4958e8fa-0500-46f4-8c4c-fa74cf93bc72/kube-rbac-proxy-main/0.log" Jul 23 16:57:35.128268 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:35.128237 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-n85ms_4958e8fa-0500-46f4-8c4c-fa74cf93bc72/kube-rbac-proxy-self/0.log" Jul 23 16:57:35.165861 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:35.165826 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-n85ms_4958e8fa-0500-46f4-8c4c-fa74cf93bc72/openshift-state-metrics/0.log" Jul 23 16:57:35.206709 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:35.206686 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb330d1e-a3f0-4745-8ceb-19f2fe032862/prometheus/0.log" Jul 23 16:57:35.239258 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:35.239213 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb330d1e-a3f0-4745-8ceb-19f2fe032862/config-reloader/0.log" Jul 23 16:57:35.263754 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:35.263726 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb330d1e-a3f0-4745-8ceb-19f2fe032862/thanos-sidecar/0.log" Jul 23 16:57:35.289770 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:35.289740 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb330d1e-a3f0-4745-8ceb-19f2fe032862/kube-rbac-proxy-web/0.log" Jul 23 16:57:35.316631 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:35.316593 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb330d1e-a3f0-4745-8ceb-19f2fe032862/kube-rbac-proxy/0.log" Jul 23 16:57:35.344941 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:35.344905 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb330d1e-a3f0-4745-8ceb-19f2fe032862/kube-rbac-proxy-thanos/0.log" Jul 23 16:57:35.369655 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:35.369628 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb330d1e-a3f0-4745-8ceb-19f2fe032862/init-config-reloader/0.log" Jul 23 16:57:35.408740 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:35.408716 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-z7mrq_288fde13-044f-442e-905b-55424842c6cf/prometheus-operator/0.log" Jul 23 16:57:35.430859 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:35.430798 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-z7mrq_288fde13-044f-442e-905b-55424842c6cf/kube-rbac-proxy/0.log" Jul 23 16:57:35.463575 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:35.463485 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-lzgtw_7d5df5db-c89e-47ab-a46b-4a8ec748f4c9/prometheus-operator-admission-webhook/0.log" Jul 23 16:57:35.612029 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:35.611976 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d74c6f46-rj9p9_826aa3e1-e923-478a-8a23-e156d85ebd14/thanos-query/0.log" Jul 23 16:57:35.640309 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:35.640259 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d74c6f46-rj9p9_826aa3e1-e923-478a-8a23-e156d85ebd14/kube-rbac-proxy-web/0.log" Jul 23 16:57:35.676727 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:35.676698 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d74c6f46-rj9p9_826aa3e1-e923-478a-8a23-e156d85ebd14/kube-rbac-proxy/0.log" Jul 23 16:57:35.707294 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:35.707266 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d74c6f46-rj9p9_826aa3e1-e923-478a-8a23-e156d85ebd14/prom-label-proxy/0.log" Jul 23 16:57:35.731243 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:35.731171 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d74c6f46-rj9p9_826aa3e1-e923-478a-8a23-e156d85ebd14/kube-rbac-proxy-rules/0.log" Jul 23 16:57:35.759508 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:35.759482 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d74c6f46-rj9p9_826aa3e1-e923-478a-8a23-e156d85ebd14/kube-rbac-proxy-metrics/0.log" Jul 23 16:57:37.938422 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:37.938396 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b576fd95c-t569f_d11607e5-3325-408d-b705-7c7682487568/console/0.log" Jul 23 16:57:38.326088 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:38.326058 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n"] Jul 23 16:57:38.331685 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:38.331656 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" Jul 23 16:57:38.341110 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:38.341085 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n"] Jul 23 16:57:38.418076 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:38.418046 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/297065e5-53aa-4539-b318-9007fec1744c-proc\") pod \"perf-node-gather-daemonset-t4f8n\" (UID: \"297065e5-53aa-4539-b318-9007fec1744c\") " pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" Jul 23 16:57:38.418076 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:38.418080 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/297065e5-53aa-4539-b318-9007fec1744c-lib-modules\") pod \"perf-node-gather-daemonset-t4f8n\" (UID: \"297065e5-53aa-4539-b318-9007fec1744c\") " pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" Jul 23 16:57:38.418322 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:38.418101 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/297065e5-53aa-4539-b318-9007fec1744c-sys\") pod \"perf-node-gather-daemonset-t4f8n\" (UID: \"297065e5-53aa-4539-b318-9007fec1744c\") " pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" Jul 23 16:57:38.418322 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:38.418260 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/297065e5-53aa-4539-b318-9007fec1744c-podres\") pod \"perf-node-gather-daemonset-t4f8n\" (UID: \"297065e5-53aa-4539-b318-9007fec1744c\") " pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" Jul 23 16:57:38.418322 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:38.418298 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpf2c\" (UniqueName: \"kubernetes.io/projected/297065e5-53aa-4539-b318-9007fec1744c-kube-api-access-fpf2c\") pod \"perf-node-gather-daemonset-t4f8n\" (UID: \"297065e5-53aa-4539-b318-9007fec1744c\") " pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" Jul 23 16:57:38.519667 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:38.519632 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/297065e5-53aa-4539-b318-9007fec1744c-podres\") pod \"perf-node-gather-daemonset-t4f8n\" (UID: \"297065e5-53aa-4539-b318-9007fec1744c\") " pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" Jul 23 16:57:38.519667 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:38.519670 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpf2c\" (UniqueName: \"kubernetes.io/projected/297065e5-53aa-4539-b318-9007fec1744c-kube-api-access-fpf2c\") pod \"perf-node-gather-daemonset-t4f8n\" (UID: \"297065e5-53aa-4539-b318-9007fec1744c\") " pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" Jul 23 16:57:38.519878 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:38.519712 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/297065e5-53aa-4539-b318-9007fec1744c-proc\") pod \"perf-node-gather-daemonset-t4f8n\" (UID: \"297065e5-53aa-4539-b318-9007fec1744c\") " pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" Jul 23 16:57:38.519878 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:38.519732 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/297065e5-53aa-4539-b318-9007fec1744c-lib-modules\") pod \"perf-node-gather-daemonset-t4f8n\" (UID: \"297065e5-53aa-4539-b318-9007fec1744c\") " pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" Jul 23 16:57:38.519878 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:38.519764 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/297065e5-53aa-4539-b318-9007fec1744c-sys\") pod \"perf-node-gather-daemonset-t4f8n\" (UID: \"297065e5-53aa-4539-b318-9007fec1744c\") " pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" Jul 23 16:57:38.519878 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:38.519826 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/297065e5-53aa-4539-b318-9007fec1744c-podres\") pod \"perf-node-gather-daemonset-t4f8n\" (UID: \"297065e5-53aa-4539-b318-9007fec1744c\") " pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" Jul 23 16:57:38.519878 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:38.519828 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/297065e5-53aa-4539-b318-9007fec1744c-proc\") pod \"perf-node-gather-daemonset-t4f8n\" (UID: \"297065e5-53aa-4539-b318-9007fec1744c\") " pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" Jul 23 16:57:38.519878 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:38.519871 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/297065e5-53aa-4539-b318-9007fec1744c-sys\") pod \"perf-node-gather-daemonset-t4f8n\" (UID: \"297065e5-53aa-4539-b318-9007fec1744c\") " pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" Jul 23 16:57:38.520107 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:38.519895 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/297065e5-53aa-4539-b318-9007fec1744c-lib-modules\") pod \"perf-node-gather-daemonset-t4f8n\" (UID: \"297065e5-53aa-4539-b318-9007fec1744c\") " pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" Jul 23 16:57:38.530948 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:38.530914 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpf2c\" (UniqueName: \"kubernetes.io/projected/297065e5-53aa-4539-b318-9007fec1744c-kube-api-access-fpf2c\") pod \"perf-node-gather-daemonset-t4f8n\" (UID: \"297065e5-53aa-4539-b318-9007fec1744c\") " pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" Jul 23 16:57:38.644733 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:38.644649 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" Jul 23 16:57:38.797379 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:38.797355 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n"] Jul 23 16:57:38.799312 ip-10-0-138-250 kubenswrapper[2574]: W0723 16:57:38.799283 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod297065e5_53aa_4539_b318_9007fec1744c.slice/crio-5705f5b34373d1997d9e0006ca52018f5b4eb34f31d5704ef11eaf59a96f224f WatchSource:0}: Error finding container 5705f5b34373d1997d9e0006ca52018f5b4eb34f31d5704ef11eaf59a96f224f: Status 404 returned error can't find the container with id 5705f5b34373d1997d9e0006ca52018f5b4eb34f31d5704ef11eaf59a96f224f Jul 23 16:57:39.426331 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:39.426301 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fln7z_8eb78804-a2f6-4124-b5ed-302ee5f7f0b9/dns/0.log" Jul 23 16:57:39.447608 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:39.447577 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" event={"ID":"297065e5-53aa-4539-b318-9007fec1744c","Type":"ContainerStarted","Data":"264def58eb09aca1db990043a6434ca95a815fab7fe30e2b2005f39c60c55c20"} Jul 23 16:57:39.447762 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:39.447657 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" event={"ID":"297065e5-53aa-4539-b318-9007fec1744c","Type":"ContainerStarted","Data":"5705f5b34373d1997d9e0006ca52018f5b4eb34f31d5704ef11eaf59a96f224f"} Jul 23 16:57:39.447762 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:39.447712 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" Jul 23 16:57:39.450165 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:39.450139 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fln7z_8eb78804-a2f6-4124-b5ed-302ee5f7f0b9/kube-rbac-proxy/0.log" Jul 23 16:57:39.466355 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:39.466305 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" podStartSLOduration=1.4662855750000001 podStartE2EDuration="1.466285575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:57:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:57:39.464863749 +0000 UTC m=+305.938679157" watchObservedRunningTime="2026-07-23 16:57:39.466285575 +0000 UTC m=+305.940100957" Jul 23 16:57:39.570888 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:39.570859 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f9bh2_9e494496-9aa7-476c-8bba-1711f19517b3/dns-node-resolver/0.log" Jul 23 16:57:40.072019 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:40.071979 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fqrgt_25e64bf5-928d-4675-a1de-cd03bae729c3/node-ca/0.log" Jul 23 16:57:41.343212 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:41.343185 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bngwk_c8ee823c-f384-4c3d-844e-1a75f90b85de/serve-healthcheck-canary/0.log" Jul 23 16:57:41.898935 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:41.898902 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbvld_785920fb-be6e-4554-866a-f2a721504715/kube-rbac-proxy/0.log" Jul 23 16:57:41.929841 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:41.929811 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbvld_785920fb-be6e-4554-866a-f2a721504715/exporter/0.log" Jul 23 16:57:41.978247 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:41.978223 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbvld_785920fb-be6e-4554-866a-f2a721504715/extractor/0.log" Jul 23 16:57:45.461193 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:45.461164 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qp842/perf-node-gather-daemonset-t4f8n" Jul 23 16:57:48.050840 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:48.050811 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dk5w9_5ac875d6-c91e-446a-b99f-a676d029da0f/kube-multus-additional-cni-plugins/0.log" Jul 23 16:57:48.082278 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:48.082245 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dk5w9_5ac875d6-c91e-446a-b99f-a676d029da0f/egress-router-binary-copy/0.log" Jul 23 16:57:48.116854 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:48.116776 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dk5w9_5ac875d6-c91e-446a-b99f-a676d029da0f/cni-plugins/0.log" Jul 23 16:57:48.142804 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:48.142782 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dk5w9_5ac875d6-c91e-446a-b99f-a676d029da0f/bond-cni-plugin/0.log" Jul 23 16:57:48.171488 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:48.171460 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dk5w9_5ac875d6-c91e-446a-b99f-a676d029da0f/routeoverride-cni/0.log" Jul 23 16:57:48.199719 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:48.199692 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dk5w9_5ac875d6-c91e-446a-b99f-a676d029da0f/whereabouts-cni-bincopy/0.log" Jul 23 16:57:48.226856 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:48.226825 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dk5w9_5ac875d6-c91e-446a-b99f-a676d029da0f/whereabouts-cni/0.log" Jul 23 16:57:48.757336 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:48.757307 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qmnnk_631c6c0a-d55a-45ba-9153-a84ed84db311/kube-multus/0.log" Jul 23 16:57:48.890462 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:48.890432 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qzqbk_e6fdffd3-cc88-4a7e-91d1-a2e45102fc88/network-metrics-daemon/0.log" Jul 23 16:57:48.929758 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:48.929734 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qzqbk_e6fdffd3-cc88-4a7e-91d1-a2e45102fc88/kube-rbac-proxy/0.log" Jul 23 16:57:50.269507 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:50.269482 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xsg_109e3c98-c98e-494b-ad16-f6a7caffa6ea/ovn-controller/0.log" Jul 23 16:57:50.310598 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:50.310573 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xsg_109e3c98-c98e-494b-ad16-f6a7caffa6ea/ovn-acl-logging/0.log" Jul 23 16:57:50.310598 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:50.310587 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xsg_109e3c98-c98e-494b-ad16-f6a7caffa6ea/ovn-acl-logging/1.log" Jul 23 16:57:50.336087 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:50.336048 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xsg_109e3c98-c98e-494b-ad16-f6a7caffa6ea/kube-rbac-proxy-node/0.log" Jul 23 16:57:50.371394 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:50.371367 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xsg_109e3c98-c98e-494b-ad16-f6a7caffa6ea/kube-rbac-proxy-ovn-metrics/0.log" Jul 23 16:57:50.405782 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:50.405743 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xsg_109e3c98-c98e-494b-ad16-f6a7caffa6ea/northd/0.log" Jul 23 16:57:50.430232 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:50.430205 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xsg_109e3c98-c98e-494b-ad16-f6a7caffa6ea/nbdb/0.log" Jul 23 16:57:50.465397 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:50.465344 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xsg_109e3c98-c98e-494b-ad16-f6a7caffa6ea/sbdb/0.log" Jul 23 16:57:50.516861 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:50.516826 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xsg_109e3c98-c98e-494b-ad16-f6a7caffa6ea/ovnkube-controller/0.log" Jul 23 16:57:51.754293 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:51.754263 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-4sbpm_beb54da2-dd72-41f4-a716-4235f9a3559f/network-check-target-container/0.log" Jul 23 16:57:52.719215 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:52.719185 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-jsbxp_41d0aca9-8760-4a31-8035-4170984c2577/iptables-alerter/0.log" Jul 23 16:57:53.443751 ip-10-0-138-250 kubenswrapper[2574]: I0723 16:57:53.443725 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-kkcbd_b6696092-1dab-4d36-ae83-856549abf7a2/tuned/0.log"