Jul 20 09:55:26.718648 ip-10-0-142-23 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 20 09:55:26.718665 ip-10-0-142-23 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 20 09:55:26.718675 ip-10-0-142-23 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 20 09:55:26.719147 ip-10-0-142-23 systemd[1]: Failed to start Kubernetes Kubelet. Jul 20 09:55:36.726332 ip-10-0-142-23 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 20 09:55:36.726350 ip-10-0-142-23 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ce74b3ed6ce8499d801c7fbe9d5496f9 -- Jul 20 09:57:14.114844 ip-10-0-142-23 systemd[1]: Starting Kubernetes Kubelet... Jul 20 09:57:14.610946 ip-10-0-142-23 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 09:57:14.610946 ip-10-0-142-23 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 20 09:57:14.610946 ip-10-0-142-23 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 09:57:14.610946 ip-10-0-142-23 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 20 09:57:14.610946 ip-10-0-142-23 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 09:57:14.610946 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.561648 2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 20 09:57:14.610946 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568427 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:57:14.610946 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568443 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:57:14.610946 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568446 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:57:14.610946 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568450 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:57:14.610946 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568453 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:57:14.610946 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568456 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:57:14.610946 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568459 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:57:14.610946 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568461 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:57:14.613007 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568464 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:57:14.613007 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568469 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:57:14.613007 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568471 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:57:14.613007 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568474 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:57:14.613007 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568476 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:57:14.613007 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568479 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:57:14.613007 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568482 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:57:14.613007 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568485 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:57:14.613007 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568487 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:57:14.613007 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568491 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:57:14.613007 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568493 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:57:14.613007 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568496 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:57:14.613007 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568502 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:57:14.613007 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568506 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:57:14.613007 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568508 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:57:14.613007 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568511 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:57:14.613007 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568514 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:57:14.613007 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568517 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:57:14.613007 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568519 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:57:14.615259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568525 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:57:14.615259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568529 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:57:14.615259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568547 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:57:14.615259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568554 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:57:14.615259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568557 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:57:14.615259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568560 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:57:14.615259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568564 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:57:14.615259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568567 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:57:14.615259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568570 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:57:14.615259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568573 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:57:14.615259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568575 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:57:14.615259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568578 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:57:14.615259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568583 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:57:14.615259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568586 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:57:14.615259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568588 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:57:14.615259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568591 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:57:14.615259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568594 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:57:14.615259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568598 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:57:14.615259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568602 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:57:14.617032 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568605 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:57:14.617032 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568609 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:57:14.617032 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568613 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:57:14.617032 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568616 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:57:14.617032 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568626 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:57:14.617032 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568630 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:57:14.617032 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568633 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:57:14.617032 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568635 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:57:14.617032 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568638 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:57:14.617032 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568641 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:57:14.617032 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568643 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:57:14.617032 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568646 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:57:14.617032 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568649 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:57:14.617032 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568651 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:57:14.617032 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568654 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:57:14.617032 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568657 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:57:14.617032 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568660 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:57:14.617032 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568662 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:57:14.617032 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568665 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:57:14.617032 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568667 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:57:14.619276 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568670 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:57:14.619276 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568673 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:57:14.619276 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568676 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:57:14.619276 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568680 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:57:14.619276 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568683 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:57:14.619276 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568686 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:57:14.619276 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568688 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:57:14.619276 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568691 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:57:14.619276 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568694 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:57:14.619276 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568697 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:57:14.619276 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568700 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:57:14.619276 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568702 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:57:14.619276 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568705 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:57:14.619276 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568708 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:57:14.619276 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568711 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:57:14.619276 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568713 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:57:14.619276 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568716 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:57:14.619276 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568724 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:57:14.619276 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568727 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:57:14.619276 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568730 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:57:14.621051 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568733 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:57:14.621051 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568735 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:57:14.621051 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568738 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:57:14.621051 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568740 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:57:14.621051 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568743 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:57:14.621051 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568745 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:57:14.621051 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568748 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:57:14.621051 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568750 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:57:14.621051 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568753 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:57:14.621051 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568755 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:57:14.621051 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568760 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:57:14.621051 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568763 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:57:14.621051 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.568766 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:57:14.621051 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569470 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:57:14.621051 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569477 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:57:14.621051 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569480 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:57:14.621051 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569483 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:57:14.621051 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569487 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:57:14.621051 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569490 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:57:14.623442 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569493 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:57:14.623442 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569496 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:57:14.623442 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569499 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:57:14.623442 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569502 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:57:14.623442 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569505 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:57:14.623442 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569508 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:57:14.623442 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569511 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:57:14.623442 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569514 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:57:14.623442 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569516 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:57:14.623442 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569519 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:57:14.623442 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569522 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:57:14.623442 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569553 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:57:14.623442 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569557 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:57:14.623442 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569560 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:57:14.623442 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569564 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:57:14.623442 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569568 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:57:14.623442 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569571 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:57:14.623442 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569575 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:57:14.623442 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569578 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:57:14.625200 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569581 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:57:14.625200 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569584 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:57:14.625200 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569587 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:57:14.625200 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569596 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:57:14.625200 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569601 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:57:14.625200 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569603 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:57:14.625200 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569609 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:57:14.625200 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569612 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:57:14.625200 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569615 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:57:14.625200 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569618 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:57:14.625200 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569622 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:57:14.625200 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569625 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:57:14.625200 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569628 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:57:14.625200 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569630 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:57:14.625200 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569633 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:57:14.625200 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569635 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:57:14.625200 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569638 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:57:14.625200 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569641 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:57:14.625200 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569643 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:57:14.625200 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569645 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:57:14.627559 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569648 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:57:14.627559 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569651 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:57:14.627559 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569654 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:57:14.627559 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569656 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:57:14.627559 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569659 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:57:14.627559 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569668 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:57:14.627559 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569672 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:57:14.627559 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569674 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:57:14.627559 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569677 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:57:14.627559 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569680 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:57:14.627559 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569683 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:57:14.627559 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569686 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:57:14.627559 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569688 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:57:14.627559 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569691 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:57:14.627559 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569693 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:57:14.627559 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569696 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:57:14.627559 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569699 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:57:14.627559 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569702 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:57:14.627559 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569705 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:57:14.627559 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569707 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:57:14.629402 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569710 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:57:14.629402 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569712 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:57:14.629402 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569716 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:57:14.629402 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569719 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:57:14.629402 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569722 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:57:14.629402 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569726 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:57:14.629402 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569729 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:57:14.629402 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569732 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:57:14.629402 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569734 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:57:14.629402 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569737 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:57:14.629402 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569739 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:57:14.629402 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569742 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:57:14.629402 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569744 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:57:14.629402 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569747 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:57:14.629402 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569750 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:57:14.629402 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569753 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:57:14.629402 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569756 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:57:14.629402 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569759 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:57:14.629402 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569762 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:57:14.629402 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569765 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:57:14.631972 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569768 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:57:14.631972 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569770 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:57:14.631972 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569773 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:57:14.631972 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569775 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:57:14.631972 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569778 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:57:14.631972 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569780 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:57:14.631972 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569783 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:57:14.631972 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569785 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:57:14.631972 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569788 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:57:14.631972 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569790 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:57:14.631972 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569793 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:57:14.631972 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569795 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:57:14.631972 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569798 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:57:14.631972 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.569800 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:57:14.631972 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570177 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:57:14.631972 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570182 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:57:14.631972 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570184 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:57:14.631972 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570187 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:57:14.631972 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570190 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:57:14.631972 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570192 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:57:14.633924 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570195 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:57:14.633924 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570197 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:57:14.633924 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570200 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:57:14.633924 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570203 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:57:14.633924 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570207 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:57:14.633924 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570210 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:57:14.633924 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570213 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:57:14.633924 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570215 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:57:14.633924 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570218 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:57:14.633924 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570221 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:57:14.633924 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570224 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:57:14.633924 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570227 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:57:14.633924 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570230 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:57:14.633924 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570232 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:57:14.633924 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570235 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:57:14.633924 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570237 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:57:14.633924 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570240 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:57:14.633924 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570242 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:57:14.633924 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570245 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:57:14.633924 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570250 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:57:14.636190 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570253 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:57:14.636190 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570256 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:57:14.636190 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570258 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:57:14.636190 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570261 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:57:14.636190 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570263 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:57:14.636190 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570266 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:57:14.636190 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570268 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:57:14.636190 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570271 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:57:14.636190 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570274 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:57:14.636190 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570278 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:57:14.636190 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570280 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:57:14.636190 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570285 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:57:14.636190 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570288 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:57:14.636190 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570291 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:57:14.636190 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570294 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:57:14.636190 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570297 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:57:14.636190 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570300 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:57:14.636190 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570303 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:57:14.636190 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570306 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:57:14.638202 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570308 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:57:14.638202 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570311 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:57:14.638202 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570313 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:57:14.638202 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570316 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:57:14.638202 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570319 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:57:14.638202 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570322 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:57:14.638202 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570325 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:57:14.638202 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570327 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:57:14.638202 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570330 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:57:14.638202 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570332 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:57:14.638202 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570335 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:57:14.638202 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570338 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:57:14.638202 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570342 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:57:14.638202 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570344 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:57:14.638202 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570348 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:57:14.638202 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570352 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:57:14.638202 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570354 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:57:14.638202 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570358 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:57:14.638202 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570361 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:57:14.640631 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570364 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:57:14.640631 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570367 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:57:14.640631 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570370 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:57:14.640631 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570375 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:57:14.640631 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570378 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:57:14.640631 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570381 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:57:14.640631 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570383 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:57:14.640631 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570386 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:57:14.640631 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570388 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:57:14.640631 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570391 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:57:14.640631 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570394 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:57:14.640631 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570397 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:57:14.640631 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570399 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:57:14.640631 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570402 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:57:14.640631 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570404 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:57:14.640631 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570408 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:57:14.640631 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570410 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:57:14.640631 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570413 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:57:14.640631 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570416 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:57:14.640631 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570418 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570421 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570423 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570426 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570428 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570431 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570435 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570437 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570440 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570442 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570445 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570447 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570450 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570452 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570455 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.570458 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570528 2584 flags.go:64] FLAG: --address="0.0.0.0" Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570550 2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570558 2584 flags.go:64] FLAG: --anonymous-auth="true" Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570563 2584 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570566 2584 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 20 09:57:14.642354 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570570 2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570574 2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570577 2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570581 2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570584 2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570588 2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570591 2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570594 2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570597 2584 flags.go:64] FLAG: --cgroup-root="" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570600 2584 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570602 2584 flags.go:64] FLAG: --client-ca-file="" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570606 2584 flags.go:64] FLAG: --cloud-provider="external" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570609 2584 flags.go:64] FLAG: --cluster-dns="[]" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570613 2584 flags.go:64] FLAG: --cluster-domain="" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570616 2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570619 2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570622 2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570627 2584 flags.go:64] FLAG: --container-log-max-files="5" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570635 2584 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570638 2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570642 2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570645 2584 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570648 2584 flags.go:64] FLAG: --contention-profiling="false" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570651 2584 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 20 09:57:14.644686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570653 2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 20 09:57:14.643926 ip-10-0-142-23 systemd[1]: Started Kubernetes Kubelet. Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570657 2584 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570660 2584 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570665 2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570669 2584 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570671 2584 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570674 2584 flags.go:64] FLAG: --enable-load-reader="false" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570677 2584 flags.go:64] FLAG: --enable-server="true" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570681 2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570685 2584 flags.go:64] FLAG: --event-burst="100" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570688 2584 flags.go:64] FLAG: --event-qps="50" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570691 2584 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570694 2584 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570697 2584 flags.go:64] FLAG: --eviction-hard="" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570701 2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570704 2584 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570707 2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570710 2584 flags.go:64] FLAG: --eviction-soft="" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570712 2584 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570715 2584 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570719 2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570722 2584 flags.go:64] FLAG: --experimental-mounter-path="" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570725 2584 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570728 2584 flags.go:64] FLAG: --fail-swap-on="true" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570731 2584 flags.go:64] FLAG: --feature-gates="" Jul 20 09:57:14.647206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570736 2584 flags.go:64] FLAG: --file-check-frequency="20s" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570739 2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570742 2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570745 2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570748 2584 flags.go:64] FLAG: --healthz-port="10248" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570751 2584 flags.go:64] FLAG: --help="false" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570754 2584 flags.go:64] FLAG: --hostname-override="ip-10-0-142-23.ec2.internal" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570757 2584 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570760 2584 flags.go:64] FLAG: --http-check-frequency="20s" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570763 2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570767 2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570770 2584 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570774 2584 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570776 2584 flags.go:64] FLAG: --image-service-endpoint="" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570779 2584 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570782 2584 flags.go:64] FLAG: --kube-api-burst="100" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570785 2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570788 2584 flags.go:64] FLAG: --kube-api-qps="50" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570791 2584 flags.go:64] FLAG: --kube-reserved="" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570794 2584 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570797 2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570800 2584 flags.go:64] FLAG: --kubelet-cgroups="" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570803 2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570806 2584 flags.go:64] FLAG: --lock-file="" Jul 20 09:57:14.648942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570809 2584 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570812 2584 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570815 2584 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570820 2584 flags.go:64] FLAG: --log-json-split-stream="false" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570824 2584 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570827 2584 flags.go:64] FLAG: --log-text-split-stream="false" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570829 2584 flags.go:64] FLAG: --logging-format="text" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570832 2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570837 2584 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570840 2584 flags.go:64] FLAG: --manifest-url="" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570843 2584 flags.go:64] FLAG: --manifest-url-header="" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570847 2584 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570850 2584 flags.go:64] FLAG: --max-open-files="1000000" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570854 2584 flags.go:64] FLAG: --max-pods="110" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570857 2584 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570860 2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570863 2584 flags.go:64] FLAG: --memory-manager-policy="None" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570866 2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570870 2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570873 2584 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570876 2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570883 2584 flags.go:64] FLAG: --node-status-max-images="50" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570886 2584 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570889 2584 flags.go:64] FLAG: --oom-score-adj="-999" Jul 20 09:57:14.678693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570892 2584 flags.go:64] FLAG: --pod-cidr="" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570895 2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570900 2584 flags.go:64] FLAG: --pod-manifest-path="" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570903 2584 flags.go:64] FLAG: --pod-max-pids="-1" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570906 2584 flags.go:64] FLAG: --pods-per-core="0" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570909 2584 flags.go:64] FLAG: --port="10250" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570912 2584 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570915 2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00136e41fbc1fd80e" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570918 2584 flags.go:64] FLAG: --qos-reserved="" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570921 2584 flags.go:64] FLAG: --read-only-port="10255" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570924 2584 flags.go:64] FLAG: --register-node="true" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570927 2584 flags.go:64] FLAG: --register-with-taints="" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570930 2584 flags.go:64] FLAG: --registry-burst="10" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570937 2584 flags.go:64] FLAG: --registry-qps="5" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570940 2584 flags.go:64] FLAG: --reserved-cpus="" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570943 2584 flags.go:64] FLAG: --reserved-memory="" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570948 2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570952 2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570955 2584 flags.go:64] FLAG: --rotate-certificates="false" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570957 2584 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570960 2584 flags.go:64] FLAG: --runonce="false" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570963 2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570966 2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570969 2584 flags.go:64] FLAG: --seccomp-default="false" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570972 2584 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 20 09:57:14.680620 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570975 2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570978 2584 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570983 2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570986 2584 flags.go:64] FLAG: --storage-driver-password="root" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570989 2584 flags.go:64] FLAG: --storage-driver-secure="false" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570991 2584 flags.go:64] FLAG: --storage-driver-table="stats" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570994 2584 flags.go:64] FLAG: --storage-driver-user="root" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.570997 2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.571000 2584 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.571003 2584 flags.go:64] FLAG: --system-cgroups="" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.571006 2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.571011 2584 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.571014 2584 flags.go:64] FLAG: --tls-cert-file="" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.571017 2584 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.571021 2584 flags.go:64] FLAG: --tls-min-version="" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.571024 2584 flags.go:64] FLAG: --tls-private-key-file="" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.571027 2584 flags.go:64] FLAG: --topology-manager-policy="none" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.571029 2584 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.571032 2584 flags.go:64] FLAG: --topology-manager-scope="container" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.571035 2584 flags.go:64] FLAG: --v="2" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.571039 2584 flags.go:64] FLAG: --version="false" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.571048 2584 flags.go:64] FLAG: --vmodule="" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.571052 2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.571057 2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571172 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:57:14.854339 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571176 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:57:14.858363 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571179 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:57:14.858363 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571183 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:57:14.858363 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571186 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:57:14.858363 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571190 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:57:14.858363 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571192 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:57:14.858363 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571195 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:57:14.858363 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571198 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:57:14.858363 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571201 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:57:14.858363 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571205 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:57:14.858363 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571207 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:57:14.858363 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571210 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:57:14.858363 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571212 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:57:14.858363 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571215 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:57:14.858363 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571218 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:57:14.858363 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571221 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:57:14.858363 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571224 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:57:14.858363 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571226 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:57:14.858363 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571229 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:57:14.858363 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571232 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:57:14.858363 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571234 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:57:14.870893 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571237 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:57:14.870893 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571240 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:57:14.870893 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571242 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:57:14.870893 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571245 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:57:14.870893 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571247 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:57:14.870893 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571250 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:57:14.870893 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571253 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:57:14.870893 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571255 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:57:14.870893 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571259 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:57:14.870893 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571263 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:57:14.870893 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571269 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:57:14.870893 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571272 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:57:14.870893 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571274 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:57:14.870893 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571277 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:57:14.870893 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571279 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:57:14.870893 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571282 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:57:14.870893 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571285 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:57:14.870893 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571287 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:57:14.870893 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571290 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:57:14.870893 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571293 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:57:14.871970 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571297 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:57:14.871970 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571299 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:57:14.871970 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571302 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:57:14.871970 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571305 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:57:14.871970 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571307 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:57:14.871970 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571310 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:57:14.871970 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571312 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:57:14.871970 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571315 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:57:14.871970 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571317 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:57:14.871970 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571320 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:57:14.871970 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571323 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:57:14.871970 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571326 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:57:14.871970 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571329 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:57:14.871970 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571333 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:57:14.871970 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571336 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:57:14.871970 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571339 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:57:14.871970 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571342 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:57:14.871970 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571345 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:57:14.871970 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571348 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:57:14.876292 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571351 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:57:14.876292 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571355 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:57:14.876292 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571360 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:57:14.876292 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571363 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:57:14.876292 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571366 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:57:14.876292 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571368 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:57:14.876292 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571371 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:57:14.876292 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571373 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:57:14.876292 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571376 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:57:14.876292 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571378 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:57:14.876292 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571381 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:57:14.876292 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571383 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:57:14.876292 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571386 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:57:14.876292 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571390 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:57:14.876292 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571393 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:57:14.876292 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571395 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:57:14.876292 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571398 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:57:14.876292 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571401 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:57:14.876292 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571403 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:57:14.876914 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571406 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:57:14.876914 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571408 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:57:14.876914 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571411 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:57:14.876914 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571413 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:57:14.876914 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571416 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:57:14.876914 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571420 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:57:14.876914 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571423 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:57:14.876914 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571426 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:57:14.876914 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571429 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:57:14.876914 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571432 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:57:14.876914 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571435 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:57:14.876914 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571438 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:57:14.876914 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571440 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:57:14.876914 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571443 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:57:14.876914 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571445 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:57:14.876914 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571449 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:57:14.876914 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571452 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:57:14.876914 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571455 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:57:14.876914 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.571457 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:57:14.877602 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.572148 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 09:57:14.877602 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.581072 2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 20 09:57:14.877602 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.581091 2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 20 09:57:14.877602 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.581115 2584 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 20 09:57:14.877602 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.581124 2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 20 09:57:14.877602 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581198 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:57:14.877602 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581205 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:57:14.877602 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581210 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:57:14.877602 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581215 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:57:14.877602 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581219 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:57:14.877602 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581223 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:57:14.877602 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581227 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:57:14.877602 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581231 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:57:14.877602 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581235 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:57:14.878122 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581240 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:57:14.878122 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581244 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:57:14.878122 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581248 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:57:14.878122 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581252 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:57:14.878122 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581256 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:57:14.878122 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581260 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:57:14.878122 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581263 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:57:14.878122 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581267 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:57:14.878122 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581271 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:57:14.878122 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581276 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:57:14.878122 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581281 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:57:14.878122 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581286 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:57:14.878122 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581290 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:57:14.878122 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581294 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:57:14.878122 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581299 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:57:14.878122 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581304 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:57:14.878122 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581308 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:57:14.878122 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581312 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:57:14.878122 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581319 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:57:14.879146 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581325 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:57:14.879146 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581331 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:57:14.879146 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581335 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:57:14.879146 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581340 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:57:14.879146 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581344 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:57:14.879146 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581347 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:57:14.879146 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581352 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:57:14.879146 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581355 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:57:14.879146 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581359 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:57:14.879146 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581364 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:57:14.879146 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581366 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:57:14.879146 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581370 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:57:14.879146 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581374 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:57:14.879146 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581377 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:57:14.879146 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581381 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:57:14.879146 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581384 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:57:14.879146 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581387 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:57:14.879146 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581389 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:57:14.879146 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581393 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:57:14.879146 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581396 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:57:14.883319 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581398 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:57:14.883319 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581401 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:57:14.883319 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581405 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:57:14.883319 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581408 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:57:14.883319 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581410 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:57:14.883319 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581414 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:57:14.883319 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581418 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:57:14.883319 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581421 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:57:14.883319 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581423 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:57:14.883319 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581427 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:57:14.883319 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581430 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:57:14.883319 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581434 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:57:14.883319 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581438 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:57:14.883319 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581443 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:57:14.883319 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581446 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:57:14.883319 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581450 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:57:14.883319 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581453 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:57:14.883319 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581457 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:57:14.883319 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581460 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:57:14.883926 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581464 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:57:14.883926 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581467 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:57:14.883926 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581470 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:57:14.883926 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581475 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:57:14.883926 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581477 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:57:14.883926 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581480 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:57:14.883926 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581484 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:57:14.883926 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581487 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:57:14.883926 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581489 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:57:14.883926 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581492 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:57:14.883926 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581495 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:57:14.883926 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581498 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:57:14.883926 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581501 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:57:14.883926 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581504 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:57:14.883926 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581508 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:57:14.883926 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581510 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:57:14.883926 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581513 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:57:14.883926 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581516 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:57:14.883926 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581520 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:57:14.883926 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581523 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:57:14.884550 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581525 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:57:14.884550 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581528 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:57:14.884550 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581548 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:57:14.884550 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581554 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:57:14.884550 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581558 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:57:14.884550 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581562 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:57:14.884550 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581564 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:57:14.884550 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581567 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:57:14.884550 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581570 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:57:14.884550 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581572 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:57:14.884550 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581576 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:57:14.884550 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581579 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:57:14.884550 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.581584 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 09:57:14.884550 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581714 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:57:14.885096 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581719 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:57:14.885096 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581723 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:57:14.885096 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581726 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:57:14.885096 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581729 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:57:14.885096 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581733 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:57:14.885096 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581736 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:57:14.885096 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581739 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:57:14.885096 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581742 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:57:14.885096 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581746 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:57:14.885096 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581749 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:57:14.885096 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581753 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:57:14.885096 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581757 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:57:14.885096 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581760 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:57:14.885096 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581762 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:57:14.885096 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581765 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:57:14.885096 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581768 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:57:14.885096 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581771 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:57:14.885096 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581774 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:57:14.885096 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581777 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:57:14.885096 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581780 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:57:14.885704 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581782 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:57:14.885704 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581785 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:57:14.885704 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581789 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:57:14.885704 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581794 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:57:14.885704 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581798 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:57:14.885704 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581802 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:57:14.885704 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581806 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:57:14.885704 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581809 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:57:14.885704 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581813 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:57:14.885704 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581816 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:57:14.885704 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581819 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:57:14.885704 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581822 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:57:14.885704 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581827 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:57:14.885704 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581829 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:57:14.885704 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581832 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:57:14.885704 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581835 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:57:14.885704 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581838 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:57:14.885704 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581841 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:57:14.885704 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581843 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:57:14.886259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581847 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:57:14.886259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581850 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:57:14.886259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581853 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:57:14.886259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581859 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:57:14.886259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581862 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:57:14.886259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581865 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:57:14.886259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581868 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:57:14.886259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581871 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:57:14.886259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581874 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:57:14.886259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581876 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:57:14.886259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581879 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:57:14.886259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581883 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:57:14.886259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581886 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:57:14.886259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581889 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:57:14.886259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581892 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:57:14.886259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581894 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:57:14.886259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581898 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:57:14.886259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581901 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:57:14.886259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581903 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:57:14.886259 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581906 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:57:14.887026 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581908 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:57:14.887026 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581911 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:57:14.887026 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581913 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:57:14.887026 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581916 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:57:14.887026 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581918 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:57:14.887026 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581921 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:57:14.887026 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581923 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:57:14.887026 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581926 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:57:14.887026 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581928 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:57:14.887026 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581931 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:57:14.887026 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581933 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:57:14.887026 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581936 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:57:14.887026 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581938 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:57:14.887026 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581941 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:57:14.887026 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581943 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:57:14.887026 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581947 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:57:14.887026 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581951 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:57:14.887026 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581954 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:57:14.887026 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581957 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:57:14.966743 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581960 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:57:14.966743 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581962 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:57:14.966743 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581965 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:57:14.966743 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581967 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:57:14.966743 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581970 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:57:14.966743 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581973 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:57:14.966743 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581975 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:57:14.966743 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581978 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:57:14.966743 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581980 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:57:14.966743 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581984 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:57:14.966743 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581988 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:57:14.966743 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581990 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:57:14.966743 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581994 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:57:14.966743 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.581998 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:57:14.966743 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.582001 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:57:14.966743 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.582003 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:57:14.966743 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.582006 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:57:14.966743 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.582008 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:57:14.966743 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.582011 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:57:14.966743 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:14.582014 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:57:14.968324 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.582019 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 09:57:14.968324 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.582128 2584 server.go:962] "Client rotation is on, will bootstrap in background" Jul 20 09:57:14.968324 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.584349 2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 20 09:57:14.968324 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.585921 2584 server.go:1019] "Starting client certificate rotation" Jul 20 09:57:14.968324 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.586013 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 09:57:14.968324 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.586050 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 09:57:14.968324 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.588699 2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 09:57:14.968324 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.589828 2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 09:57:14.968324 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.603319 2584 log.go:25] "Validated CRI v1 runtime API" Jul 20 09:57:14.968324 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.605509 2584 log.go:25] "Validated CRI v1 image API" Jul 20 09:57:14.968324 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.607047 2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 20 09:57:14.968324 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.609698 2584 fs.go:135] Filesystem UUIDs: map[1b000cbf-9e13-49e0-9d87-3a0af241c2df:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c46bae44-4921-4bc4-8835-7ff0fcc78d0b:/dev/nvme0n1p4] Jul 20 09:57:14.968833 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.609713 2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 20 09:57:14.970149 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.616049 2584 manager.go:216] Machine: {Timestamp:2026-07-20 09:57:14.61461464 +0000 UTC m=+0.372439522 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099132 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec256da0c6c87919df30e9eb955fd8c6 SystemUUID:ec256da0-c6c8-7919-df30-e9eb955fd8c6 BootID:ce74b3ed-6ce8-499d-801c-7fbe9d5496f9 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9c:af:d4:d8:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9c:af:d4:d8:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:cb:fd:93:54:9a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 20 09:57:14.970149 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.616150 2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 20 09:57:14.970149 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.616225 2584 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 20 09:57:14.970149 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.620043 2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 20 09:57:14.970149 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.620071 2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-23.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 20 09:57:14.970149 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.620935 2584 topology_manager.go:138] "Creating topology manager with none policy" Jul 20 09:57:14.970149 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.620944 2584 container_manager_linux.go:309] "Creating device plugin manager" Jul 20 09:57:14.970149 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.620951 2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.621852 2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.623753 2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.625345 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.629143 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.629289 2584 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.629322 2584 kubelet.go:486] "Attempting to sync node with API server" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.629336 2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.629355 2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.629368 2584 kubelet.go:398] "Adding apiserver pod source" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.629385 2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.629829 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.629845 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.632317 2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.634921 2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.634949 2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.636947 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.636960 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.638149 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.638159 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.638171 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.638178 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.638190 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.638197 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.638204 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.638210 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.638228 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.638233 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.639856 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.639865 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:14.642513 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:14.642513 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.643060 2584 server.go:1268] "Started kubelet" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.643149 2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.643270 2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.643308 2584 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.647397 2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.647847 2584 server.go:310] "Adding debug handlers to kubelet server" Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.650263 2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-23.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 20 09:57:14.970850 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:14.653685 2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:14.650299 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-23.ec2.internal.18c3f6fadadd2c4e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-23.ec2.internal,UID:ip-10-0-142-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-23.ec2.internal,},FirstTimestamp:2026-07-20 09:57:14.643033166 +0000 UTC m=+0.400858049,LastTimestamp:2026-07-20 09:57:14.643033166 +0000 UTC m=+0.400858049,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-23.ec2.internal,}" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.658602 2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.658705 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:14.658717 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-23.ec2.internal\" not found" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.659336 2584 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.659352 2584 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.659399 2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.659472 2584 reconstruct.go:97] "Volume reconstruction finished" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.659478 2584 reconciler.go:29] "Reconciler: start to sync state" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.660417 2584 factory.go:153] Registering CRI-O factory Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.660430 2584 factory.go:223] Registration of the crio container factory successfully Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.660479 2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.660487 2584 factory.go:55] Registering systemd factory Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.660492 2584 factory.go:223] Registration of the systemd container factory successfully Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.660513 2584 factory.go:103] Registering Raw factory Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.660529 2584 manager.go:1196] Started watching for new ooms in manager Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.660886 2584 manager.go:349] Starting recovery of all containers Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:14.663505 2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:14.663691 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.665213 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qr792" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.668576 2584 manager.go:354] Recovery completed Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.672895 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.675981 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.676015 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.676030 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.677062 2584 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.677071 2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.677090 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.677104 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.678597 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.678638 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.678651 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:57:14.971877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.680625 2584 policy_none.go:49] "None policy: Start" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.680638 2584 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.680649 2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.680818 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qr792" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.683510 2584 policy_none.go:47] "Start" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:14.687050 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-23.ec2.internal.18c3f6fadcd4280d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-23.ec2.internal,UID:ip-10-0-142-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-23.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-23.ec2.internal,},FirstTimestamp:2026-07-20 09:57:14.675996685 +0000 UTC m=+0.433821571,LastTimestamp:2026-07-20 09:57:14.675996685 +0000 UTC m=+0.433821571,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-23.ec2.internal,}" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.725246 2584 manager.go:337] "Starting Device Plugin manager" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:14.725291 2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.725303 2584 server.go:87] "Starting device plugin registration server" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.725619 2584 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.725631 2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.725731 2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.725893 2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.725904 2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:14.726302 2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:14.726359 2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-23.ec2.internal\" not found" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.803390 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.804593 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.804635 2584 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.804660 2584 kubelet.go:2448] "Starting kubelet main sync loop" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:14.804701 2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.807340 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.826643 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.830155 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.830182 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.830191 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.830214 2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-23.ec2.internal" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.841227 2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-23.ec2.internal" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:14.841246 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-23.ec2.internal\": node \"ip-10-0-142-23.ec2.internal\" not found" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:14.858236 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-23.ec2.internal\" not found" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.905771 2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal"] Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.906001 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:57:14.972898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.906937 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:57:14.973936 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.906965 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:57:14.973936 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.906976 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:57:14.973936 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.908216 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:57:14.973936 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.908317 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal" Jul 20 09:57:14.973936 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.908342 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:57:14.973936 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.909562 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:57:14.973936 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.909562 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:57:14.973936 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.909585 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:57:14.973936 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.909608 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:57:14.973936 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.909607 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:57:14.973936 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.909628 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:57:14.973936 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.910824 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal" Jul 20 09:57:14.973936 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.910857 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:57:14.973936 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.912790 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:57:14.973936 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.912824 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:57:14.973936 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:14.912840 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:57:15.086854 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:15.012123 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-23.ec2.internal\" not found" Jul 20 09:57:15.086854 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:15.033510 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-23.ec2.internal\" not found" node="ip-10-0-142-23.ec2.internal" Jul 20 09:57:15.086854 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:15.038436 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-23.ec2.internal\" not found" node="ip-10-0-142-23.ec2.internal" Jul 20 09:57:15.157792 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:15.113183 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-23.ec2.internal\" not found" Jul 20 09:57:15.157792 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.113247 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7dbc931812107e2ef10eec95f02730cc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal\" (UID: \"7dbc931812107e2ef10eec95f02730cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal" Jul 20 09:57:15.157792 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.113301 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7dbc931812107e2ef10eec95f02730cc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal\" (UID: \"7dbc931812107e2ef10eec95f02730cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal" Jul 20 09:57:15.157792 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.113325 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d159dfd7e8915df45f4573e327fe646c-config\") pod \"kube-apiserver-proxy-ip-10-0-142-23.ec2.internal\" (UID: \"d159dfd7e8915df45f4573e327fe646c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal" Jul 20 09:57:15.380274 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:15.333216 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-23.ec2.internal\" not found" Jul 20 09:57:15.380274 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.333251 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d159dfd7e8915df45f4573e327fe646c-config\") pod \"kube-apiserver-proxy-ip-10-0-142-23.ec2.internal\" (UID: \"d159dfd7e8915df45f4573e327fe646c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal" Jul 20 09:57:15.380274 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.333286 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7dbc931812107e2ef10eec95f02730cc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal\" (UID: \"7dbc931812107e2ef10eec95f02730cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal" Jul 20 09:57:15.380274 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.333327 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7dbc931812107e2ef10eec95f02730cc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal\" (UID: \"7dbc931812107e2ef10eec95f02730cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal" Jul 20 09:57:15.380274 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.333354 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d159dfd7e8915df45f4573e327fe646c-config\") pod \"kube-apiserver-proxy-ip-10-0-142-23.ec2.internal\" (UID: \"d159dfd7e8915df45f4573e327fe646c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal" Jul 20 09:57:15.380274 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.333365 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7dbc931812107e2ef10eec95f02730cc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal\" (UID: \"7dbc931812107e2ef10eec95f02730cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal" Jul 20 09:57:15.380274 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.333374 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7dbc931812107e2ef10eec95f02730cc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal\" (UID: \"7dbc931812107e2ef10eec95f02730cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal" Jul 20 09:57:15.380274 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.336551 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal" Jul 20 09:57:15.380274 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.340561 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal" Jul 20 09:57:15.530291 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:15.433926 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-23.ec2.internal\" not found" Jul 20 09:57:15.713631 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:15.535965 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-23.ec2.internal\" not found" Jul 20 09:57:15.713631 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.586075 2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 20 09:57:15.713631 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.586236 2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 09:57:15.713631 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:15.636588 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-23.ec2.internal\" not found" Jul 20 09:57:15.713631 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.686827 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 09:52:15 +0000 UTC" deadline="2028-05-01 03:19:09.051700564 +0000 UTC" Jul 20 09:57:15.713631 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.686860 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15617h21m53.36484543s" Jul 20 09:57:15.713631 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.701585 2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:57:15.868264 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.760606 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal" Jul 20 09:57:15.868264 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.765779 2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:57:15.868264 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.779670 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 09:57:15.868264 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.781720 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal" Jul 20 09:57:15.868264 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.799069 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 09:57:15.933877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:15.933844 2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:57:16.061454 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:16.061415 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dbc931812107e2ef10eec95f02730cc.slice/crio-aa1ab28e08f019d89950fd6b109d3aa02dccd6ebb1f5657ac342d87c3a2754b0 WatchSource:0}: Error finding container aa1ab28e08f019d89950fd6b109d3aa02dccd6ebb1f5657ac342d87c3a2754b0: Status 404 returned error can't find the container with id aa1ab28e08f019d89950fd6b109d3aa02dccd6ebb1f5657ac342d87c3a2754b0 Jul 20 09:57:16.061983 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:16.061960 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd159dfd7e8915df45f4573e327fe646c.slice/crio-4dbcd0c62187ddbe6bb07250b19a08e076fa73d2a4cb6c47fa6f936cd63cf51c WatchSource:0}: Error finding container 4dbcd0c62187ddbe6bb07250b19a08e076fa73d2a4cb6c47fa6f936cd63cf51c: Status 404 returned error can't find the container with id 4dbcd0c62187ddbe6bb07250b19a08e076fa73d2a4cb6c47fa6f936cd63cf51c Jul 20 09:57:16.066311 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.066292 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 09:57:16.633017 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.632971 2584 apiserver.go:52] "Watching apiserver" Jul 20 09:57:16.644642 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.644338 2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 20 09:57:16.645694 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.645645 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-ndwhk","openshift-ovn-kubernetes/ovnkube-node-nmnb2","kube-system/konnectivity-agent-rlg4l","openshift-dns/node-resolver-s6shl","openshift-image-registry/node-ca-2mf8j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal","openshift-multus/network-metrics-daemon-gx8gs","openshift-network-diagnostics/network-check-target-dvtzz","kube-system/global-pull-secret-syncer-jb6t4","kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc","openshift-cluster-node-tuning-operator/tuned-c7jvr","openshift-multus/multus-additional-cni-plugins-h2xdk","openshift-multus/multus-phtmd"] Jul 20 09:57:16.647651 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.647602 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:16.647767 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:16.647717 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gx8gs" podUID="cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f" Jul 20 09:57:16.649621 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.649360 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.650547 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.650507 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rlg4l" Jul 20 09:57:16.651763 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.651727 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s6shl" Jul 20 09:57:16.652512 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.652492 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 20 09:57:16.652655 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.652633 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vf5zw\"" Jul 20 09:57:16.652841 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.652821 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2mf8j" Jul 20 09:57:16.652968 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.652950 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 20 09:57:16.653182 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.653164 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 20 09:57:16.653411 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.653394 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 20 09:57:16.653486 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.653452 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 20 09:57:16.653938 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.653921 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.654024 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.653948 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 20 09:57:16.654236 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.654217 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z4ghz\"" Jul 20 09:57:16.654440 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.654425 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 20 09:57:16.654685 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.654660 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 20 09:57:16.654842 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.654824 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 20 09:57:16.655026 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.655009 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:16.655103 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:16.655078 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6t4" podUID="ed82fcf6-9e23-4480-ab33-68ca1d46dfaf" Jul 20 09:57:16.655172 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.655153 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mm4tq\"" Jul 20 09:57:16.655684 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.655656 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 20 09:57:16.655991 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.655971 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9swpg\"" Jul 20 09:57:16.656296 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.656277 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 20 09:57:16.656662 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.656641 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ndwhk" Jul 20 09:57:16.657204 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.657181 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 20 09:57:16.657402 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.657383 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-v7mmm\"" Jul 20 09:57:16.657589 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.657570 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 20 09:57:16.657936 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.657913 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.659079 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.659057 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:16.659176 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:16.659153 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvtzz" podUID="7d66f714-a387-4064-a9b6-95fb006c732a" Jul 20 09:57:16.659721 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.659523 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 20 09:57:16.659721 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.659538 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dcw9f\"" Jul 20 09:57:16.659721 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.659679 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:57:16.659915 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.659823 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 20 09:57:16.660481 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.660461 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 20 09:57:16.660929 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.660911 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.661493 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.661471 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 20 09:57:16.661575 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.661560 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 20 09:57:16.661762 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.661740 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 20 09:57:16.661839 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.661758 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-h5cmc\"" Jul 20 09:57:16.661927 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.661908 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 20 09:57:16.661986 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.661963 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 20 09:57:16.662035 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.661994 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.662361 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.662258 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 20 09:57:16.664272 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.664243 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 20 09:57:16.664483 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.664457 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 20 09:57:16.665710 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.665690 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7vgkq\"" Jul 20 09:57:16.666005 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.665986 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 20 09:57:16.666421 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.666402 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 20 09:57:16.667054 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.667033 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:57:16.667281 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.667261 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b669x\"" Jul 20 09:57:16.681226 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.681194 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 09:57:16.701397 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.701353 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7hhf9" Jul 20 09:57:16.716255 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.716229 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7hhf9" Jul 20 09:57:16.750200 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750172 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln8zb\" (UniqueName: \"kubernetes.io/projected/dcff7929-ba73-40b0-96ab-f83447015d94-kube-api-access-ln8zb\") pod \"node-resolver-s6shl\" (UID: \"dcff7929-ba73-40b0-96ab-f83447015d94\") " pod="openshift-dns/node-resolver-s6shl" Jul 20 09:57:16.750338 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750217 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3731182-2536-4d68-bbba-b082e162e6b9-cni-binary-copy\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.750338 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750247 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-host-run-k8s-cni-cncf-io\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.750338 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750273 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-host-var-lib-kubelet\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.750338 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750298 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-run-netns\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.750338 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750323 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-hostroot\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.750615 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750346 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-multus-conf-dir\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.750615 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750394 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-run-ovn\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.750615 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750426 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-node-log\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.750615 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750455 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-cnibin\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.750615 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750481 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-os-release\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.750615 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750509 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-cnibin\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.750615 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750532 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-host-run-netns\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.750615 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750571 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-system-cni-dir\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.750615 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750604 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-kubelet-config\") pod \"global-pull-secret-syncer-jb6t4\" (UID: \"ed82fcf6-9e23-4480-ab33-68ca1d46dfaf\") " pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:16.751068 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750629 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dcff7929-ba73-40b0-96ab-f83447015d94-hosts-file\") pod \"node-resolver-s6shl\" (UID: \"dcff7929-ba73-40b0-96ab-f83447015d94\") " pod="openshift-dns/node-resolver-s6shl" Jul 20 09:57:16.751068 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750654 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-multus-socket-dir-parent\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.751068 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750684 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-dbus\") pod \"global-pull-secret-syncer-jb6t4\" (UID: \"ed82fcf6-9e23-4480-ab33-68ca1d46dfaf\") " pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:16.751068 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750711 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9t7g\" (UniqueName: \"kubernetes.io/projected/4c045356-44fb-4116-97c9-1a9897f93447-kube-api-access-j9t7g\") pod \"iptables-alerter-ndwhk\" (UID: \"4c045356-44fb-4116-97c9-1a9897f93447\") " pod="openshift-network-operator/iptables-alerter-ndwhk" Jul 20 09:57:16.751068 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750747 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/86768e19-4658-495c-86fc-f84ff0660953-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.751068 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750775 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/86768e19-4658-495c-86fc-f84ff0660953-device-dir\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.751068 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750799 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs\") pod \"network-metrics-daemon-gx8gs\" (UID: \"cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f\") " pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:16.751068 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750826 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.751068 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750853 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7gqj\" (UniqueName: \"kubernetes.io/projected/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-kube-api-access-h7gqj\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.751068 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750884 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-host-var-lib-cni-bin\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.751068 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750908 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdtwk\" (UniqueName: \"kubernetes.io/projected/d3731182-2536-4d68-bbba-b082e162e6b9-kube-api-access-kdtwk\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.751068 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750934 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v888s\" (UniqueName: \"kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s\") pod \"network-check-target-dvtzz\" (UID: \"7d66f714-a387-4064-a9b6-95fb006c732a\") " pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:16.751068 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750968 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-cni-binary-copy\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.751719 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.750994 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-etc-kubernetes\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.751719 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751017 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-log-socket\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.751719 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751068 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj4kr\" (UniqueName: \"kubernetes.io/projected/86768e19-4658-495c-86fc-f84ff0660953-kube-api-access-cj4kr\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.751719 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751093 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/45c3ada5-0fc6-47ad-b198-45040191642e-serviceca\") pod \"node-ca-2mf8j\" (UID: \"45c3ada5-0fc6-47ad-b198-45040191642e\") " pod="openshift-image-registry/node-ca-2mf8j" Jul 20 09:57:16.751719 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751120 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d3731182-2536-4d68-bbba-b082e162e6b9-multus-daemon-config\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.751719 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751145 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-cni-netd\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.751719 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751180 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.751719 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751226 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c045356-44fb-4116-97c9-1a9897f93447-iptables-alerter-script\") pod \"iptables-alerter-ndwhk\" (UID: \"4c045356-44fb-4116-97c9-1a9897f93447\") " pod="openshift-network-operator/iptables-alerter-ndwhk" Jul 20 09:57:16.751719 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751252 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.751719 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751278 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fafee4ad-5222-403d-980f-5f9f21422ced-agent-certs\") pod \"konnectivity-agent-rlg4l\" (UID: \"fafee4ad-5222-403d-980f-5f9f21422ced\") " pod="kube-system/konnectivity-agent-rlg4l" Jul 20 09:57:16.751719 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751302 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-os-release\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.751719 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751335 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-host-var-lib-cni-multus\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.751719 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751359 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-host-run-multus-certs\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.752285 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751393 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret\") pod \"global-pull-secret-syncer-jb6t4\" (UID: \"ed82fcf6-9e23-4480-ab33-68ca1d46dfaf\") " pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:16.752285 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751417 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-systemd-units\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.752285 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751441 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-run-systemd\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.752285 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751463 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b77339f6-cf2e-4381-991d-af590d424ed0-ovnkube-config\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.752285 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751488 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6v6k\" (UniqueName: \"kubernetes.io/projected/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-kube-api-access-j6v6k\") pod \"network-metrics-daemon-gx8gs\" (UID: \"cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f\") " pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:16.752285 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751525 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.752285 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751586 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fafee4ad-5222-403d-980f-5f9f21422ced-konnectivity-ca\") pod \"konnectivity-agent-rlg4l\" (UID: \"fafee4ad-5222-403d-980f-5f9f21422ced\") " pod="kube-system/konnectivity-agent-rlg4l" Jul 20 09:57:16.752285 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751620 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-run-ovn-kubernetes\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.752285 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751644 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcff7929-ba73-40b0-96ab-f83447015d94-tmp-dir\") pod \"node-resolver-s6shl\" (UID: \"dcff7929-ba73-40b0-96ab-f83447015d94\") " pod="openshift-dns/node-resolver-s6shl" Jul 20 09:57:16.752285 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751668 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c045356-44fb-4116-97c9-1a9897f93447-host-slash\") pod \"iptables-alerter-ndwhk\" (UID: \"4c045356-44fb-4116-97c9-1a9897f93447\") " pod="openshift-network-operator/iptables-alerter-ndwhk" Jul 20 09:57:16.752285 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751692 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-system-cni-dir\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.752285 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751715 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-kubelet\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.752285 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751740 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-slash\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.752873 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751765 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-var-lib-openvswitch\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.752873 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751789 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45c3ada5-0fc6-47ad-b198-45040191642e-host\") pod \"node-ca-2mf8j\" (UID: \"45c3ada5-0fc6-47ad-b198-45040191642e\") " pod="openshift-image-registry/node-ca-2mf8j" Jul 20 09:57:16.752873 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751823 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v52nw\" (UniqueName: \"kubernetes.io/projected/45c3ada5-0fc6-47ad-b198-45040191642e-kube-api-access-v52nw\") pod \"node-ca-2mf8j\" (UID: \"45c3ada5-0fc6-47ad-b198-45040191642e\") " pod="openshift-image-registry/node-ca-2mf8j" Jul 20 09:57:16.752873 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751864 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-cni-bin\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.752873 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751895 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/86768e19-4658-495c-86fc-f84ff0660953-socket-dir\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.752873 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751923 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/86768e19-4658-495c-86fc-f84ff0660953-registration-dir\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.752873 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751952 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-etc-openvswitch\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.752873 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.751988 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b77339f6-cf2e-4381-991d-af590d424ed0-ovn-node-metrics-cert\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.752873 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.752011 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/86768e19-4658-495c-86fc-f84ff0660953-etc-selinux\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.752873 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.752052 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/86768e19-4658-495c-86fc-f84ff0660953-sys-fs\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.752873 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.752093 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-multus-cni-dir\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.752873 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.752119 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fzm4\" (UniqueName: \"kubernetes.io/projected/b77339f6-cf2e-4381-991d-af590d424ed0-kube-api-access-9fzm4\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.752873 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.752146 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-run-openvswitch\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.753541 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.752170 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b77339f6-cf2e-4381-991d-af590d424ed0-env-overrides\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.753541 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.752202 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b77339f6-cf2e-4381-991d-af590d424ed0-ovnkube-script-lib\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.760519 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.760474 2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 20 09:57:16.812635 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.812565 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal" event={"ID":"d159dfd7e8915df45f4573e327fe646c","Type":"ContainerStarted","Data":"4dbcd0c62187ddbe6bb07250b19a08e076fa73d2a4cb6c47fa6f936cd63cf51c"} Jul 20 09:57:16.815158 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.815125 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal" event={"ID":"7dbc931812107e2ef10eec95f02730cc","Type":"ContainerStarted","Data":"aa1ab28e08f019d89950fd6b109d3aa02dccd6ebb1f5657ac342d87c3a2754b0"} Jul 20 09:57:16.853163 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.853127 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-kubelet-config\") pod \"global-pull-secret-syncer-jb6t4\" (UID: \"ed82fcf6-9e23-4480-ab33-68ca1d46dfaf\") " pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:16.853341 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.853180 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-sysconfig\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.853341 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.853202 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-host\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.853341 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.853233 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dcff7929-ba73-40b0-96ab-f83447015d94-hosts-file\") pod \"node-resolver-s6shl\" (UID: \"dcff7929-ba73-40b0-96ab-f83447015d94\") " pod="openshift-dns/node-resolver-s6shl" Jul 20 09:57:16.853341 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.853244 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-kubelet-config\") pod \"global-pull-secret-syncer-jb6t4\" (UID: \"ed82fcf6-9e23-4480-ab33-68ca1d46dfaf\") " pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:16.853341 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.853329 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-multus-socket-dir-parent\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.853615 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.853369 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg9pb\" (UniqueName: \"kubernetes.io/projected/1855f72b-9815-46c5-9598-8527e45d7ed7-kube-api-access-pg9pb\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.853615 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.853426 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-dbus\") pod \"global-pull-secret-syncer-jb6t4\" (UID: \"ed82fcf6-9e23-4480-ab33-68ca1d46dfaf\") " pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:16.853615 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.853453 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9t7g\" (UniqueName: \"kubernetes.io/projected/4c045356-44fb-4116-97c9-1a9897f93447-kube-api-access-j9t7g\") pod \"iptables-alerter-ndwhk\" (UID: \"4c045356-44fb-4116-97c9-1a9897f93447\") " pod="openshift-network-operator/iptables-alerter-ndwhk" Jul 20 09:57:16.853615 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.853480 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/86768e19-4658-495c-86fc-f84ff0660953-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.853615 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.853371 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dcff7929-ba73-40b0-96ab-f83447015d94-hosts-file\") pod \"node-resolver-s6shl\" (UID: \"dcff7929-ba73-40b0-96ab-f83447015d94\") " pod="openshift-dns/node-resolver-s6shl" Jul 20 09:57:16.853615 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.853504 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/86768e19-4658-495c-86fc-f84ff0660953-device-dir\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.853615 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.853499 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-multus-socket-dir-parent\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.853963 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.853597 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/86768e19-4658-495c-86fc-f84ff0660953-device-dir\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.853963 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.853671 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/86768e19-4658-495c-86fc-f84ff0660953-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.853963 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.853674 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs\") pod \"network-metrics-daemon-gx8gs\" (UID: \"cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f\") " pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:16.853963 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.853688 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-dbus\") pod \"global-pull-secret-syncer-jb6t4\" (UID: \"ed82fcf6-9e23-4480-ab33-68ca1d46dfaf\") " pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:16.853963 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:16.853792 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:16.853963 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.853794 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.853963 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:16.853885 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs podName:cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f nodeName:}" failed. No retries permitted until 2026-07-20 09:57:17.353854842 +0000 UTC m=+3.111679728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs") pod "network-metrics-daemon-gx8gs" (UID: "cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:16.854335 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.853984 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-sys\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.854335 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854150 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7gqj\" (UniqueName: \"kubernetes.io/projected/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-kube-api-access-h7gqj\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.854335 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854200 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-host-var-lib-cni-bin\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.854335 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854253 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdtwk\" (UniqueName: \"kubernetes.io/projected/d3731182-2536-4d68-bbba-b082e162e6b9-kube-api-access-kdtwk\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.854335 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854281 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v888s\" (UniqueName: \"kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s\") pod \"network-check-target-dvtzz\" (UID: \"7d66f714-a387-4064-a9b6-95fb006c732a\") " pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:16.854335 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854288 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-host-var-lib-cni-bin\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.854660 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854336 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-cni-binary-copy\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.854660 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854383 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-etc-kubernetes\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.854660 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854412 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-modprobe-d\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.854660 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854442 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-log-socket\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.854660 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854484 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj4kr\" (UniqueName: \"kubernetes.io/projected/86768e19-4658-495c-86fc-f84ff0660953-kube-api-access-cj4kr\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.854660 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854494 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.854660 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854511 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/45c3ada5-0fc6-47ad-b198-45040191642e-serviceca\") pod \"node-ca-2mf8j\" (UID: \"45c3ada5-0fc6-47ad-b198-45040191642e\") " pod="openshift-image-registry/node-ca-2mf8j" Jul 20 09:57:16.854660 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854535 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d3731182-2536-4d68-bbba-b082e162e6b9-multus-daemon-config\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.854660 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854578 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-lib-modules\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.855114 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854664 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-cni-netd\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.855114 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854704 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-etc-kubernetes\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.855114 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854706 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.855114 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854747 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-log-socket\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.855114 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854742 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c045356-44fb-4116-97c9-1a9897f93447-iptables-alerter-script\") pod \"iptables-alerter-ndwhk\" (UID: \"4c045356-44fb-4116-97c9-1a9897f93447\") " pod="openshift-network-operator/iptables-alerter-ndwhk" Jul 20 09:57:16.855114 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854781 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.855114 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854806 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fafee4ad-5222-403d-980f-5f9f21422ced-agent-certs\") pod \"konnectivity-agent-rlg4l\" (UID: \"fafee4ad-5222-403d-980f-5f9f21422ced\") " pod="kube-system/konnectivity-agent-rlg4l" Jul 20 09:57:16.855114 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854829 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-os-release\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.855114 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854853 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-host-var-lib-cni-multus\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.855114 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.854878 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-host-run-multus-certs\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.855114 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855030 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.855684 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855356 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-cni-binary-copy\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.855684 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855376 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d3731182-2536-4d68-bbba-b082e162e6b9-multus-daemon-config\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.855684 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855381 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.855684 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855419 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-cni-netd\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.855684 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855451 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-host-var-lib-cni-multus\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.855684 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855466 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-host-run-multus-certs\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.855684 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855375 2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 20 09:57:16.855684 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855488 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret\") pod \"global-pull-secret-syncer-jb6t4\" (UID: \"ed82fcf6-9e23-4480-ab33-68ca1d46dfaf\") " pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:16.855684 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855535 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-systemd-units\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.855684 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855580 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-run-systemd\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.855684 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855607 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b77339f6-cf2e-4381-991d-af590d424ed0-ovnkube-config\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.856236 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855691 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6v6k\" (UniqueName: \"kubernetes.io/projected/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-kube-api-access-j6v6k\") pod \"network-metrics-daemon-gx8gs\" (UID: \"cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f\") " pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:16.856236 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855783 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-kubernetes\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.856236 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855809 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-sysctl-conf\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.856236 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855840 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.856236 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855866 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fafee4ad-5222-403d-980f-5f9f21422ced-konnectivity-ca\") pod \"konnectivity-agent-rlg4l\" (UID: \"fafee4ad-5222-403d-980f-5f9f21422ced\") " pod="kube-system/konnectivity-agent-rlg4l" Jul 20 09:57:16.856236 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855917 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-run-ovn-kubernetes\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.856236 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855965 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c045356-44fb-4116-97c9-1a9897f93447-iptables-alerter-script\") pod \"iptables-alerter-ndwhk\" (UID: \"4c045356-44fb-4116-97c9-1a9897f93447\") " pod="openshift-network-operator/iptables-alerter-ndwhk" Jul 20 09:57:16.856236 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855981 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcff7929-ba73-40b0-96ab-f83447015d94-tmp-dir\") pod \"node-resolver-s6shl\" (UID: \"dcff7929-ba73-40b0-96ab-f83447015d94\") " pod="openshift-dns/node-resolver-s6shl" Jul 20 09:57:16.856236 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856036 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c045356-44fb-4116-97c9-1a9897f93447-host-slash\") pod \"iptables-alerter-ndwhk\" (UID: \"4c045356-44fb-4116-97c9-1a9897f93447\") " pod="openshift-network-operator/iptables-alerter-ndwhk" Jul 20 09:57:16.856236 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856066 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-system-cni-dir\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.856236 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856104 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-systemd\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.856236 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856125 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/45c3ada5-0fc6-47ad-b198-45040191642e-serviceca\") pod \"node-ca-2mf8j\" (UID: \"45c3ada5-0fc6-47ad-b198-45040191642e\") " pod="openshift-image-registry/node-ca-2mf8j" Jul 20 09:57:16.856236 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856141 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-tuned\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.856236 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856175 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-run-systemd\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.856950 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856345 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-kubelet\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.856950 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856428 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-systemd-units\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.856950 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:16.856480 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:16.856950 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856510 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fafee4ad-5222-403d-980f-5f9f21422ced-konnectivity-ca\") pod \"konnectivity-agent-rlg4l\" (UID: \"fafee4ad-5222-403d-980f-5f9f21422ced\") " pod="kube-system/konnectivity-agent-rlg4l" Jul 20 09:57:16.856950 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:16.856567 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret podName:ed82fcf6-9e23-4480-ab33-68ca1d46dfaf nodeName:}" failed. No retries permitted until 2026-07-20 09:57:17.356532212 +0000 UTC m=+3.114357088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret") pod "global-pull-secret-syncer-jb6t4" (UID: "ed82fcf6-9e23-4480-ab33-68ca1d46dfaf") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:16.856950 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856613 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-run-ovn-kubernetes\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.856950 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856656 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-system-cni-dir\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.856950 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856713 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c045356-44fb-4116-97c9-1a9897f93447-host-slash\") pod \"iptables-alerter-ndwhk\" (UID: \"4c045356-44fb-4116-97c9-1a9897f93447\") " pod="openshift-network-operator/iptables-alerter-ndwhk" Jul 20 09:57:16.856950 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856753 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-slash\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.856950 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856797 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-var-lib-openvswitch\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.856950 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856805 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcff7929-ba73-40b0-96ab-f83447015d94-tmp-dir\") pod \"node-resolver-s6shl\" (UID: \"dcff7929-ba73-40b0-96ab-f83447015d94\") " pod="openshift-dns/node-resolver-s6shl" Jul 20 09:57:16.856950 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856823 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45c3ada5-0fc6-47ad-b198-45040191642e-host\") pod \"node-ca-2mf8j\" (UID: \"45c3ada5-0fc6-47ad-b198-45040191642e\") " pod="openshift-image-registry/node-ca-2mf8j" Jul 20 09:57:16.856950 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.855469 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-os-release\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.856950 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856858 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v52nw\" (UniqueName: \"kubernetes.io/projected/45c3ada5-0fc6-47ad-b198-45040191642e-kube-api-access-v52nw\") pod \"node-ca-2mf8j\" (UID: \"45c3ada5-0fc6-47ad-b198-45040191642e\") " pod="openshift-image-registry/node-ca-2mf8j" Jul 20 09:57:16.857732 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856851 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b77339f6-cf2e-4381-991d-af590d424ed0-ovnkube-config\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.857732 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856902 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-kubelet\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.857732 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856902 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-cni-bin\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.857732 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856942 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/86768e19-4658-495c-86fc-f84ff0660953-socket-dir\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.857732 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856978 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.857732 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856993 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/86768e19-4658-495c-86fc-f84ff0660953-registration-dir\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.857732 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.856906 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45c3ada5-0fc6-47ad-b198-45040191642e-host\") pod \"node-ca-2mf8j\" (UID: \"45c3ada5-0fc6-47ad-b198-45040191642e\") " pod="openshift-image-registry/node-ca-2mf8j" Jul 20 09:57:16.857732 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857036 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-slash\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.857732 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857057 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/86768e19-4658-495c-86fc-f84ff0660953-registration-dir\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.857732 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857063 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-var-lib-openvswitch\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.857732 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857068 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-etc-openvswitch\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.857732 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857108 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-etc-openvswitch\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.857732 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857119 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-cni-bin\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.857732 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857149 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/86768e19-4658-495c-86fc-f84ff0660953-socket-dir\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.858454 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857150 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b77339f6-cf2e-4381-991d-af590d424ed0-ovn-node-metrics-cert\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.858454 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857192 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/86768e19-4658-495c-86fc-f84ff0660953-etc-selinux\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.858454 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857236 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/86768e19-4658-495c-86fc-f84ff0660953-sys-fs\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.858454 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857284 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-multus-cni-dir\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.858454 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857319 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-sysctl-d\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.858454 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857384 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-multus-cni-dir\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.858454 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857396 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1855f72b-9815-46c5-9598-8527e45d7ed7-tmp\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.858454 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857438 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/86768e19-4658-495c-86fc-f84ff0660953-sys-fs\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.858454 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857440 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fzm4\" (UniqueName: \"kubernetes.io/projected/b77339f6-cf2e-4381-991d-af590d424ed0-kube-api-access-9fzm4\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.858454 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857471 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-run-openvswitch\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.858454 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857578 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b77339f6-cf2e-4381-991d-af590d424ed0-env-overrides\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.858454 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857608 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b77339f6-cf2e-4381-991d-af590d424ed0-ovnkube-script-lib\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.858454 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857678 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-run-openvswitch\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.858454 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857698 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln8zb\" (UniqueName: \"kubernetes.io/projected/dcff7929-ba73-40b0-96ab-f83447015d94-kube-api-access-ln8zb\") pod \"node-resolver-s6shl\" (UID: \"dcff7929-ba73-40b0-96ab-f83447015d94\") " pod="openshift-dns/node-resolver-s6shl" Jul 20 09:57:16.859181 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.857892 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/86768e19-4658-495c-86fc-f84ff0660953-etc-selinux\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.859181 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858029 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3731182-2536-4d68-bbba-b082e162e6b9-cni-binary-copy\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.859181 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858060 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b77339f6-cf2e-4381-991d-af590d424ed0-env-overrides\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.859181 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858074 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-host-run-k8s-cni-cncf-io\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.859181 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858093 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b77339f6-cf2e-4381-991d-af590d424ed0-ovnkube-script-lib\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.859181 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858162 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-host-run-k8s-cni-cncf-io\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.859181 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858165 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-host-var-lib-kubelet\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.859181 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858124 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-host-var-lib-kubelet\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.859181 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858227 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-var-lib-kubelet\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.859181 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858293 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-run-netns\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.859181 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858335 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-host-run-netns\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.859181 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858366 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-hostroot\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.859181 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858399 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-multus-conf-dir\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.859181 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858425 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-run\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.859181 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858465 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-run-ovn\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.860013 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858465 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-multus-conf-dir\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.860013 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858498 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-hostroot\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.860013 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858554 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-node-log\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.860013 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858586 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3731182-2536-4d68-bbba-b082e162e6b9-cni-binary-copy\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.860013 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858602 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-cnibin\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.860013 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858648 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-run-ovn\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.860013 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858686 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-os-release\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.860013 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858709 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-cnibin\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.860013 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858749 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b77339f6-cf2e-4381-991d-af590d424ed0-node-log\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.860013 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858802 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-host-run-netns\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.860013 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858837 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-system-cni-dir\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.860013 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858838 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-os-release\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.860013 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858879 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-cnibin\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.860013 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858976 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-cnibin\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.860013 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.858989 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-system-cni-dir\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.860837 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.859034 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3731182-2536-4d68-bbba-b082e162e6b9-host-run-netns\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.860837 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.860102 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fafee4ad-5222-403d-980f-5f9f21422ced-agent-certs\") pod \"konnectivity-agent-rlg4l\" (UID: \"fafee4ad-5222-403d-980f-5f9f21422ced\") " pod="kube-system/konnectivity-agent-rlg4l" Jul 20 09:57:16.861220 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.861188 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b77339f6-cf2e-4381-991d-af590d424ed0-ovn-node-metrics-cert\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.899688 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:16.899612 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:57:16.899688 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:16.899645 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:57:16.899688 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:16.899661 2584 projected.go:196] Error preparing data for projected volume kube-api-access-v888s for pod openshift-network-diagnostics/network-check-target-dvtzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:16.899960 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:16.899721 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s podName:7d66f714-a387-4064-a9b6-95fb006c732a nodeName:}" failed. No retries permitted until 2026-07-20 09:57:17.399704378 +0000 UTC m=+3.157529252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-v888s" (UniqueName: "kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s") pod "network-check-target-dvtzz" (UID: "7d66f714-a387-4064-a9b6-95fb006c732a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:16.900552 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.900359 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:57:16.901746 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.901720 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7gqj\" (UniqueName: \"kubernetes.io/projected/d6a09d1a-3a7b-43c6-9dbf-382dc473bc64-kube-api-access-h7gqj\") pod \"multus-additional-cni-plugins-h2xdk\" (UID: \"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64\") " pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.902897 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.902865 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9t7g\" (UniqueName: \"kubernetes.io/projected/4c045356-44fb-4116-97c9-1a9897f93447-kube-api-access-j9t7g\") pod \"iptables-alerter-ndwhk\" (UID: \"4c045356-44fb-4116-97c9-1a9897f93447\") " pod="openshift-network-operator/iptables-alerter-ndwhk" Jul 20 09:57:16.906136 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.906101 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdtwk\" (UniqueName: \"kubernetes.io/projected/d3731182-2536-4d68-bbba-b082e162e6b9-kube-api-access-kdtwk\") pod \"multus-phtmd\" (UID: \"d3731182-2536-4d68-bbba-b082e162e6b9\") " pod="openshift-multus/multus-phtmd" Jul 20 09:57:16.916102 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.916078 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln8zb\" (UniqueName: \"kubernetes.io/projected/dcff7929-ba73-40b0-96ab-f83447015d94-kube-api-access-ln8zb\") pod \"node-resolver-s6shl\" (UID: \"dcff7929-ba73-40b0-96ab-f83447015d94\") " pod="openshift-dns/node-resolver-s6shl" Jul 20 09:57:16.919931 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.919911 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6v6k\" (UniqueName: \"kubernetes.io/projected/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-kube-api-access-j6v6k\") pod \"network-metrics-daemon-gx8gs\" (UID: \"cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f\") " pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:16.927650 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.927627 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v52nw\" (UniqueName: \"kubernetes.io/projected/45c3ada5-0fc6-47ad-b198-45040191642e-kube-api-access-v52nw\") pod \"node-ca-2mf8j\" (UID: \"45c3ada5-0fc6-47ad-b198-45040191642e\") " pod="openshift-image-registry/node-ca-2mf8j" Jul 20 09:57:16.936011 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.935984 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj4kr\" (UniqueName: \"kubernetes.io/projected/86768e19-4658-495c-86fc-f84ff0660953-kube-api-access-cj4kr\") pod \"aws-ebs-csi-driver-node-sl6hc\" (UID: \"86768e19-4658-495c-86fc-f84ff0660953\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:16.938833 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.938806 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fzm4\" (UniqueName: \"kubernetes.io/projected/b77339f6-cf2e-4381-991d-af590d424ed0-kube-api-access-9fzm4\") pod \"ovnkube-node-nmnb2\" (UID: \"b77339f6-cf2e-4381-991d-af590d424ed0\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:16.959349 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959318 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1855f72b-9815-46c5-9598-8527e45d7ed7-tmp\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.959499 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959367 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-var-lib-kubelet\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.959499 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959393 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-run\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.959499 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959424 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-sysconfig\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.959499 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959441 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-host\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.959499 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959460 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg9pb\" (UniqueName: \"kubernetes.io/projected/1855f72b-9815-46c5-9598-8527e45d7ed7-kube-api-access-pg9pb\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.959499 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959467 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-var-lib-kubelet\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.959499 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959494 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-sys\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.959894 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959533 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-modprobe-d\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.959894 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959606 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-host\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.959894 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959606 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-run\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.959894 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959676 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-lib-modules\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.959894 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959693 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-modprobe-d\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.959894 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959742 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-kubernetes\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.959894 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959680 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-sysconfig\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.959894 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959769 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-sysctl-conf\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.959894 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959744 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-sys\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.959894 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959835 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-lib-modules\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.959894 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959832 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-systemd\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.959894 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959879 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-tuned\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.960450 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959921 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-sysctl-d\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.960450 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.959991 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-kubernetes\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.960450 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.960048 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-systemd\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.960450 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.960067 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-sysctl-d\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.960450 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.960193 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-sysctl-conf\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.962296 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.962101 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1855f72b-9815-46c5-9598-8527e45d7ed7-tmp\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.962917 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.962891 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1855f72b-9815-46c5-9598-8527e45d7ed7-etc-tuned\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.967898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.967874 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h2xdk" Jul 20 09:57:16.970139 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.969806 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg9pb\" (UniqueName: \"kubernetes.io/projected/1855f72b-9815-46c5-9598-8527e45d7ed7-kube-api-access-pg9pb\") pod \"tuned-c7jvr\" (UID: \"1855f72b-9815-46c5-9598-8527e45d7ed7\") " pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:16.978303 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.978257 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ndwhk" Jul 20 09:57:16.989672 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.989644 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rlg4l" Jul 20 09:57:16.997732 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:16.997708 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s6shl" Jul 20 09:57:17.007131 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:17.007107 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2mf8j" Jul 20 09:57:17.015752 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:17.015733 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-phtmd" Jul 20 09:57:17.024793 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:17.024770 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:17.032955 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:17.032938 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" Jul 20 09:57:17.038654 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:17.038630 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" Jul 20 09:57:17.362893 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:17.362793 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs\") pod \"network-metrics-daemon-gx8gs\" (UID: \"cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f\") " pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:17.362893 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:17.362858 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret\") pod \"global-pull-secret-syncer-jb6t4\" (UID: \"ed82fcf6-9e23-4480-ab33-68ca1d46dfaf\") " pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:17.363135 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:17.362970 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:17.363135 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:17.363034 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret podName:ed82fcf6-9e23-4480-ab33-68ca1d46dfaf nodeName:}" failed. No retries permitted until 2026-07-20 09:57:18.363015382 +0000 UTC m=+4.120840252 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret") pod "global-pull-secret-syncer-jb6t4" (UID: "ed82fcf6-9e23-4480-ab33-68ca1d46dfaf") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:17.363135 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:17.362972 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:17.363135 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:17.363135 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs podName:cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f nodeName:}" failed. No retries permitted until 2026-07-20 09:57:18.363118344 +0000 UTC m=+4.120943214 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs") pod "network-metrics-daemon-gx8gs" (UID: "cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:17.463961 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:17.463918 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v888s\" (UniqueName: \"kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s\") pod \"network-check-target-dvtzz\" (UID: \"7d66f714-a387-4064-a9b6-95fb006c732a\") " pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:17.464157 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:17.464101 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:57:17.464157 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:17.464127 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:57:17.464157 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:17.464138 2584 projected.go:196] Error preparing data for projected volume kube-api-access-v888s for pod openshift-network-diagnostics/network-check-target-dvtzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:17.464328 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:17.464202 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s podName:7d66f714-a387-4064-a9b6-95fb006c732a nodeName:}" failed. No retries permitted until 2026-07-20 09:57:18.464183724 +0000 UTC m=+4.222008619 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-v888s" (UniqueName: "kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s") pod "network-check-target-dvtzz" (UID: "7d66f714-a387-4064-a9b6-95fb006c732a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:17.718871 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:17.718764 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 09:52:17 +0000 UTC" deadline="2028-04-29 16:27:58.073341924 +0000 UTC" Jul 20 09:57:17.718871 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:17.718810 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15582h30m40.354537608s" Jul 20 09:57:17.805915 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:17.805868 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:17.806074 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:17.805880 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:17.806074 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:17.806012 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gx8gs" podUID="cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f" Jul 20 09:57:17.806074 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:17.806046 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvtzz" podUID="7d66f714-a387-4064-a9b6-95fb006c732a" Jul 20 09:57:17.996602 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:17.996572 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45c3ada5_0fc6_47ad_b198_45040191642e.slice/crio-ee6ad72b01cce4b3f9ae5d6d658ba66f83001b4007b6c9df51a7e7393a596f94 WatchSource:0}: Error finding container ee6ad72b01cce4b3f9ae5d6d658ba66f83001b4007b6c9df51a7e7393a596f94: Status 404 returned error can't find the container with id ee6ad72b01cce4b3f9ae5d6d658ba66f83001b4007b6c9df51a7e7393a596f94 Jul 20 09:57:17.997381 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:17.997356 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfafee4ad_5222_403d_980f_5f9f21422ced.slice/crio-0ed0a04d63ea3a1f71cc1f60fcfb29e861ace001001d6ae02984370cae7a5806 WatchSource:0}: Error finding container 0ed0a04d63ea3a1f71cc1f60fcfb29e861ace001001d6ae02984370cae7a5806: Status 404 returned error can't find the container with id 0ed0a04d63ea3a1f71cc1f60fcfb29e861ace001001d6ae02984370cae7a5806 Jul 20 09:57:18.003067 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:18.002937 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a09d1a_3a7b_43c6_9dbf_382dc473bc64.slice/crio-f7ef122392b802467ad70fa812faeb94a370a2ee9ae190ad314abb319e0a3e10 WatchSource:0}: Error finding container f7ef122392b802467ad70fa812faeb94a370a2ee9ae190ad314abb319e0a3e10: Status 404 returned error can't find the container with id f7ef122392b802467ad70fa812faeb94a370a2ee9ae190ad314abb319e0a3e10 Jul 20 09:57:18.003760 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:18.003696 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c045356_44fb_4116_97c9_1a9897f93447.slice/crio-72e0cf82b9d0dfe51735fa693f305646408b33368032d1a7be56964b9657473f WatchSource:0}: Error finding container 72e0cf82b9d0dfe51735fa693f305646408b33368032d1a7be56964b9657473f: Status 404 returned error can't find the container with id 72e0cf82b9d0dfe51735fa693f305646408b33368032d1a7be56964b9657473f Jul 20 09:57:18.006216 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:18.006188 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb77339f6_cf2e_4381_991d_af590d424ed0.slice/crio-26f141cd6a7c93acad5a97656c64572bf522aa63a6dc166e4e6d313dcc377118 WatchSource:0}: Error finding container 26f141cd6a7c93acad5a97656c64572bf522aa63a6dc166e4e6d313dcc377118: Status 404 returned error can't find the container with id 26f141cd6a7c93acad5a97656c64572bf522aa63a6dc166e4e6d313dcc377118 Jul 20 09:57:18.006606 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:18.006503 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcff7929_ba73_40b0_96ab_f83447015d94.slice/crio-d27d684e1fe4a40e5fe6dccafa0f0aec952fedd1d653d1171028ae4da0ef1383 WatchSource:0}: Error finding container d27d684e1fe4a40e5fe6dccafa0f0aec952fedd1d653d1171028ae4da0ef1383: Status 404 returned error can't find the container with id d27d684e1fe4a40e5fe6dccafa0f0aec952fedd1d653d1171028ae4da0ef1383 Jul 20 09:57:18.370686 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:18.370442 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret\") pod \"global-pull-secret-syncer-jb6t4\" (UID: \"ed82fcf6-9e23-4480-ab33-68ca1d46dfaf\") " pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:18.370872 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:18.370731 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs\") pod \"network-metrics-daemon-gx8gs\" (UID: \"cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f\") " pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:18.370872 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:18.370666 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:18.370872 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:18.370832 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:18.370872 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:18.370867 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret podName:ed82fcf6-9e23-4480-ab33-68ca1d46dfaf nodeName:}" failed. No retries permitted until 2026-07-20 09:57:20.370813465 +0000 UTC m=+6.128638337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret") pod "global-pull-secret-syncer-jb6t4" (UID: "ed82fcf6-9e23-4480-ab33-68ca1d46dfaf") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:18.371053 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:18.370889 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs podName:cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f nodeName:}" failed. No retries permitted until 2026-07-20 09:57:20.370878748 +0000 UTC m=+6.128703619 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs") pod "network-metrics-daemon-gx8gs" (UID: "cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:18.471639 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:18.471584 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v888s\" (UniqueName: \"kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s\") pod \"network-check-target-dvtzz\" (UID: \"7d66f714-a387-4064-a9b6-95fb006c732a\") " pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:18.471903 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:18.471878 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:57:18.471998 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:18.471914 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:57:18.471998 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:18.471930 2584 projected.go:196] Error preparing data for projected volume kube-api-access-v888s for pod openshift-network-diagnostics/network-check-target-dvtzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:18.471998 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:18.471996 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s podName:7d66f714-a387-4064-a9b6-95fb006c732a nodeName:}" failed. No retries permitted until 2026-07-20 09:57:20.471973986 +0000 UTC m=+6.229798878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-v888s" (UniqueName: "kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s") pod "network-check-target-dvtzz" (UID: "7d66f714-a387-4064-a9b6-95fb006c732a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:18.719864 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:18.719736 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 09:52:17 +0000 UTC" deadline="2028-01-08 14:15:05.371042731 +0000 UTC" Jul 20 09:57:18.719864 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:18.719778 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12892h17m46.651269396s" Jul 20 09:57:18.808056 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:18.808023 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:18.808239 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:18.808163 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6t4" podUID="ed82fcf6-9e23-4480-ab33-68ca1d46dfaf" Jul 20 09:57:18.851355 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:18.851284 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2mf8j" event={"ID":"45c3ada5-0fc6-47ad-b198-45040191642e","Type":"ContainerStarted","Data":"ee6ad72b01cce4b3f9ae5d6d658ba66f83001b4007b6c9df51a7e7393a596f94"} Jul 20 09:57:18.863237 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:18.863201 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-phtmd" event={"ID":"d3731182-2536-4d68-bbba-b082e162e6b9","Type":"ContainerStarted","Data":"feea7eeb95df7170f8771160bf3e2e2be15e33d1961852fa95affaa07304a3de"} Jul 20 09:57:18.866078 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:18.866020 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" event={"ID":"1855f72b-9815-46c5-9598-8527e45d7ed7","Type":"ContainerStarted","Data":"7471292662d4bfeef9d6e17c59ecb9615cc7c5f55eaba24f5ce9b88329d3eb1e"} Jul 20 09:57:18.874712 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:18.874588 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s6shl" event={"ID":"dcff7929-ba73-40b0-96ab-f83447015d94","Type":"ContainerStarted","Data":"d27d684e1fe4a40e5fe6dccafa0f0aec952fedd1d653d1171028ae4da0ef1383"} Jul 20 09:57:18.887567 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:18.887536 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rlg4l" event={"ID":"fafee4ad-5222-403d-980f-5f9f21422ced","Type":"ContainerStarted","Data":"0ed0a04d63ea3a1f71cc1f60fcfb29e861ace001001d6ae02984370cae7a5806"} Jul 20 09:57:18.895968 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:18.895938 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal" event={"ID":"d159dfd7e8915df45f4573e327fe646c","Type":"ContainerStarted","Data":"dae39115444a5515c945ca757820b1d102ac09b332e237c61e192e0480b8b991"} Jul 20 09:57:18.914137 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:18.914099 2584 generic.go:356] "Generic (PLEG): container finished" podID="7dbc931812107e2ef10eec95f02730cc" containerID="fc692b9961dce798420c1f4c9586cb10a9d80d4ddbbc05f6c872ba082998ccc0" exitCode=0 Jul 20 09:57:18.914311 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:18.914198 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal" event={"ID":"7dbc931812107e2ef10eec95f02730cc","Type":"ContainerDied","Data":"fc692b9961dce798420c1f4c9586cb10a9d80d4ddbbc05f6c872ba082998ccc0"} Jul 20 09:57:18.929646 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:18.929573 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" event={"ID":"b77339f6-cf2e-4381-991d-af590d424ed0","Type":"ContainerStarted","Data":"26f141cd6a7c93acad5a97656c64572bf522aa63a6dc166e4e6d313dcc377118"} Jul 20 09:57:18.938306 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:18.938246 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal" podStartSLOduration=2.9382238960000002 podStartE2EDuration="2.938223896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:18.915829946 +0000 UTC m=+4.673654842" watchObservedRunningTime="2026-07-20 09:57:18.938223896 +0000 UTC m=+4.696048795" Jul 20 09:57:18.938821 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:18.938791 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ndwhk" event={"ID":"4c045356-44fb-4116-97c9-1a9897f93447","Type":"ContainerStarted","Data":"72e0cf82b9d0dfe51735fa693f305646408b33368032d1a7be56964b9657473f"} Jul 20 09:57:18.942211 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:18.942167 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2xdk" event={"ID":"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64","Type":"ContainerStarted","Data":"f7ef122392b802467ad70fa812faeb94a370a2ee9ae190ad314abb319e0a3e10"} Jul 20 09:57:18.955204 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:18.955104 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" event={"ID":"86768e19-4658-495c-86fc-f84ff0660953","Type":"ContainerStarted","Data":"2eec8f51ad349e6f5489166f4a981745c9584a3d70298939f44dd7cb1029cc9b"} Jul 20 09:57:19.807790 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:19.807751 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:19.808323 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:19.807889 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvtzz" podUID="7d66f714-a387-4064-a9b6-95fb006c732a" Jul 20 09:57:19.808323 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:19.807979 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:19.808323 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:19.808070 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gx8gs" podUID="cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f" Jul 20 09:57:19.982451 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:19.982352 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal" event={"ID":"7dbc931812107e2ef10eec95f02730cc","Type":"ContainerStarted","Data":"0efd8e986cf64c4b59104507f1a00cee28f6cac9ff0c2aa4b527df9634079a86"} Jul 20 09:57:20.392072 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:20.391971 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret\") pod \"global-pull-secret-syncer-jb6t4\" (UID: \"ed82fcf6-9e23-4480-ab33-68ca1d46dfaf\") " pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:20.392235 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:20.392074 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs\") pod \"network-metrics-daemon-gx8gs\" (UID: \"cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f\") " pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:20.392316 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:20.392241 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:20.392316 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:20.392311 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs podName:cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f nodeName:}" failed. No retries permitted until 2026-07-20 09:57:24.392290661 +0000 UTC m=+10.150115536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs") pod "network-metrics-daemon-gx8gs" (UID: "cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:20.394543 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:20.392751 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:20.394543 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:20.392822 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret podName:ed82fcf6-9e23-4480-ab33-68ca1d46dfaf nodeName:}" failed. No retries permitted until 2026-07-20 09:57:24.392805639 +0000 UTC m=+10.150630520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret") pod "global-pull-secret-syncer-jb6t4" (UID: "ed82fcf6-9e23-4480-ab33-68ca1d46dfaf") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:20.492501 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:20.492457 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v888s\" (UniqueName: \"kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s\") pod \"network-check-target-dvtzz\" (UID: \"7d66f714-a387-4064-a9b6-95fb006c732a\") " pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:20.492774 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:20.492757 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:57:20.492851 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:20.492782 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:57:20.492851 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:20.492796 2584 projected.go:196] Error preparing data for projected volume kube-api-access-v888s for pod openshift-network-diagnostics/network-check-target-dvtzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:20.492942 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:20.492859 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s podName:7d66f714-a387-4064-a9b6-95fb006c732a nodeName:}" failed. No retries permitted until 2026-07-20 09:57:24.492839071 +0000 UTC m=+10.250663957 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v888s" (UniqueName: "kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s") pod "network-check-target-dvtzz" (UID: "7d66f714-a387-4064-a9b6-95fb006c732a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:20.805309 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:20.805209 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:20.805509 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:20.805375 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6t4" podUID="ed82fcf6-9e23-4480-ab33-68ca1d46dfaf" Jul 20 09:57:21.805326 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:21.805004 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:21.805326 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:21.805165 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gx8gs" podUID="cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f" Jul 20 09:57:21.805326 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:21.805177 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:21.805326 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:21.805279 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvtzz" podUID="7d66f714-a387-4064-a9b6-95fb006c732a" Jul 20 09:57:22.805253 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:22.805217 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:22.805444 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:22.805346 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6t4" podUID="ed82fcf6-9e23-4480-ab33-68ca1d46dfaf" Jul 20 09:57:23.805371 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:23.805338 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:23.805565 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:23.805477 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvtzz" podUID="7d66f714-a387-4064-a9b6-95fb006c732a" Jul 20 09:57:23.805866 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:23.805804 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:23.805988 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:23.805951 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gx8gs" podUID="cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f" Jul 20 09:57:24.425583 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:24.425550 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret\") pod \"global-pull-secret-syncer-jb6t4\" (UID: \"ed82fcf6-9e23-4480-ab33-68ca1d46dfaf\") " pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:24.425780 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:24.425630 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs\") pod \"network-metrics-daemon-gx8gs\" (UID: \"cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f\") " pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:24.425780 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:24.425658 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:24.425780 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:24.425732 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret podName:ed82fcf6-9e23-4480-ab33-68ca1d46dfaf nodeName:}" failed. No retries permitted until 2026-07-20 09:57:32.42571127 +0000 UTC m=+18.183536147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret") pod "global-pull-secret-syncer-jb6t4" (UID: "ed82fcf6-9e23-4480-ab33-68ca1d46dfaf") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:24.425780 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:24.425738 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:24.425953 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:24.425789 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs podName:cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f nodeName:}" failed. No retries permitted until 2026-07-20 09:57:32.425773642 +0000 UTC m=+18.183598527 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs") pod "network-metrics-daemon-gx8gs" (UID: "cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:24.526730 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:24.526693 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v888s\" (UniqueName: \"kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s\") pod \"network-check-target-dvtzz\" (UID: \"7d66f714-a387-4064-a9b6-95fb006c732a\") " pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:24.526900 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:24.526883 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:57:24.526964 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:24.526911 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:57:24.526964 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:24.526926 2584 projected.go:196] Error preparing data for projected volume kube-api-access-v888s for pod openshift-network-diagnostics/network-check-target-dvtzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:24.527038 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:24.527009 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s podName:7d66f714-a387-4064-a9b6-95fb006c732a nodeName:}" failed. No retries permitted until 2026-07-20 09:57:32.526989393 +0000 UTC m=+18.284814286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-v888s" (UniqueName: "kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s") pod "network-check-target-dvtzz" (UID: "7d66f714-a387-4064-a9b6-95fb006c732a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:24.806260 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:24.806179 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:24.806720 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:24.806283 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6t4" podUID="ed82fcf6-9e23-4480-ab33-68ca1d46dfaf" Jul 20 09:57:25.805632 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:25.805598 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:25.805799 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:25.805599 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:25.805799 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:25.805711 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvtzz" podUID="7d66f714-a387-4064-a9b6-95fb006c732a" Jul 20 09:57:25.805872 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:25.805812 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gx8gs" podUID="cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f" Jul 20 09:57:26.806732 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:26.806697 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:26.807203 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:26.806834 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6t4" podUID="ed82fcf6-9e23-4480-ab33-68ca1d46dfaf" Jul 20 09:57:27.805032 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:27.804995 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:27.805218 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:27.805114 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvtzz" podUID="7d66f714-a387-4064-a9b6-95fb006c732a" Jul 20 09:57:27.805279 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:27.805181 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:27.805376 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:27.805342 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gx8gs" podUID="cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f" Jul 20 09:57:28.805127 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:28.805097 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:28.805521 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:28.805246 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6t4" podUID="ed82fcf6-9e23-4480-ab33-68ca1d46dfaf" Jul 20 09:57:29.805004 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:29.804968 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:29.805004 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:29.805007 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:29.805559 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:29.805104 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gx8gs" podUID="cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f" Jul 20 09:57:29.805559 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:29.805225 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvtzz" podUID="7d66f714-a387-4064-a9b6-95fb006c732a" Jul 20 09:57:30.805894 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:30.805847 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:30.806296 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:30.805992 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6t4" podUID="ed82fcf6-9e23-4480-ab33-68ca1d46dfaf" Jul 20 09:57:31.804877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:31.804840 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:31.804877 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:31.804875 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:31.805124 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:31.804965 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvtzz" podUID="7d66f714-a387-4064-a9b6-95fb006c732a" Jul 20 09:57:31.805183 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:31.805115 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gx8gs" podUID="cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f" Jul 20 09:57:32.483215 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:32.483176 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs\") pod \"network-metrics-daemon-gx8gs\" (UID: \"cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f\") " pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:32.483679 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:32.483230 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret\") pod \"global-pull-secret-syncer-jb6t4\" (UID: \"ed82fcf6-9e23-4480-ab33-68ca1d46dfaf\") " pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:32.483679 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:32.483322 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:32.483679 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:32.483356 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:32.483679 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:32.483385 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret podName:ed82fcf6-9e23-4480-ab33-68ca1d46dfaf nodeName:}" failed. No retries permitted until 2026-07-20 09:57:48.483370619 +0000 UTC m=+34.241195488 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret") pod "global-pull-secret-syncer-jb6t4" (UID: "ed82fcf6-9e23-4480-ab33-68ca1d46dfaf") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:32.483679 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:32.483407 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs podName:cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f nodeName:}" failed. No retries permitted until 2026-07-20 09:57:48.483394411 +0000 UTC m=+34.241219283 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs") pod "network-metrics-daemon-gx8gs" (UID: "cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:32.584314 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:32.584273 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v888s\" (UniqueName: \"kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s\") pod \"network-check-target-dvtzz\" (UID: \"7d66f714-a387-4064-a9b6-95fb006c732a\") " pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:32.584556 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:32.584478 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:57:32.584556 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:32.584505 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:57:32.584556 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:32.584518 2584 projected.go:196] Error preparing data for projected volume kube-api-access-v888s for pod openshift-network-diagnostics/network-check-target-dvtzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:32.584725 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:32.584601 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s podName:7d66f714-a387-4064-a9b6-95fb006c732a nodeName:}" failed. No retries permitted until 2026-07-20 09:57:48.584581842 +0000 UTC m=+34.342406726 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-v888s" (UniqueName: "kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s") pod "network-check-target-dvtzz" (UID: "7d66f714-a387-4064-a9b6-95fb006c732a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:32.805085 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:32.804988 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:32.805251 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:32.805129 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6t4" podUID="ed82fcf6-9e23-4480-ab33-68ca1d46dfaf" Jul 20 09:57:33.805614 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:33.805564 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:33.806065 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:33.805564 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:33.806065 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:33.805709 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvtzz" podUID="7d66f714-a387-4064-a9b6-95fb006c732a" Jul 20 09:57:33.806065 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:33.805832 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gx8gs" podUID="cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f" Jul 20 09:57:34.806079 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:34.806047 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:34.806480 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:34.806137 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6t4" podUID="ed82fcf6-9e23-4480-ab33-68ca1d46dfaf" Jul 20 09:57:35.804886 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:35.804844 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:35.805053 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:35.804966 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gx8gs" podUID="cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f" Jul 20 09:57:35.805053 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:35.805021 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:35.805142 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:35.805124 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvtzz" podUID="7d66f714-a387-4064-a9b6-95fb006c732a" Jul 20 09:57:36.805546 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:36.805498 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:36.805922 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:36.805649 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6t4" podUID="ed82fcf6-9e23-4480-ab33-68ca1d46dfaf" Jul 20 09:57:37.805490 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:37.805206 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:37.805606 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:37.805210 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:37.805606 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:37.805596 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvtzz" podUID="7d66f714-a387-4064-a9b6-95fb006c732a" Jul 20 09:57:37.806403 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:37.805643 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gx8gs" podUID="cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f" Jul 20 09:57:38.024547 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.024455 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" event={"ID":"b77339f6-cf2e-4381-991d-af590d424ed0","Type":"ContainerStarted","Data":"0e42112999f9d19c7a4728ae3bfb62a2fc0cbe53fbe5e09c7dce121d20c2b8aa"} Jul 20 09:57:38.024704 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.024556 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" event={"ID":"b77339f6-cf2e-4381-991d-af590d424ed0","Type":"ContainerStarted","Data":"2c4cb490a93152d4fb4d1e165d152b6575f12626f1c718084e4c7c0640b76af9"} Jul 20 09:57:38.024704 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.024590 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" event={"ID":"b77339f6-cf2e-4381-991d-af590d424ed0","Type":"ContainerStarted","Data":"ac791a353c760392607e6b7ed0f140f9fd377e1d1e20a108ade34db06d3b8883"} Jul 20 09:57:38.024704 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.024634 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" event={"ID":"b77339f6-cf2e-4381-991d-af590d424ed0","Type":"ContainerStarted","Data":"f8ffd2ff84f314e0b3f575ade762bd9efd426329fad1b74aee38a726788c4744"} Jul 20 09:57:38.024704 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.024680 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" event={"ID":"b77339f6-cf2e-4381-991d-af590d424ed0","Type":"ContainerStarted","Data":"fd3a2441eb0bdbbd75b012a947656171cfaf77e226515228535613233d9fc31b"} Jul 20 09:57:38.024909 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.024720 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" event={"ID":"b77339f6-cf2e-4381-991d-af590d424ed0","Type":"ContainerStarted","Data":"d2a898fe5c404130fe149b5eb2dbac633c97795601e667922dc371db65f3f0f3"} Jul 20 09:57:38.026083 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.026039 2584 generic.go:356] "Generic (PLEG): container finished" podID="d6a09d1a-3a7b-43c6-9dbf-382dc473bc64" containerID="c637d104bd6f1dc582d2083cccfab9e133384d3f2ba910493b42cce0d7c4e07f" exitCode=0 Jul 20 09:57:38.026208 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.026135 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2xdk" event={"ID":"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64","Type":"ContainerDied","Data":"c637d104bd6f1dc582d2083cccfab9e133384d3f2ba910493b42cce0d7c4e07f"} Jul 20 09:57:38.028058 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.027764 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" event={"ID":"86768e19-4658-495c-86fc-f84ff0660953","Type":"ContainerStarted","Data":"de200da5a60b6769ce48df30da7d4fc8d9e00dff11fe828c572e9d02121ae08e"} Jul 20 09:57:38.029435 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.029416 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2mf8j" event={"ID":"45c3ada5-0fc6-47ad-b198-45040191642e","Type":"ContainerStarted","Data":"19dc00536a1ea70dc1462bb5a287a2295d0bb34836566cd86a0fac42e4802d13"} Jul 20 09:57:38.031161 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.031136 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-phtmd" event={"ID":"d3731182-2536-4d68-bbba-b082e162e6b9","Type":"ContainerStarted","Data":"9c861ef4264e36c6c1ad5384c723d078d09231a61a670decf6febb0b4de99287"} Jul 20 09:57:38.032886 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.032857 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" event={"ID":"1855f72b-9815-46c5-9598-8527e45d7ed7","Type":"ContainerStarted","Data":"d378e3cc7dcefa0f07835838f7c9223cc418e56705e5b435e0f4236760683b19"} Jul 20 09:57:38.034383 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.034361 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s6shl" event={"ID":"dcff7929-ba73-40b0-96ab-f83447015d94","Type":"ContainerStarted","Data":"2d8581095e4f6cef4fd5fd2d0f2a790cc9498551e34e9ec38abf688cddcf78ec"} Jul 20 09:57:38.036064 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.036045 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rlg4l" event={"ID":"fafee4ad-5222-403d-980f-5f9f21422ced","Type":"ContainerStarted","Data":"d8636a4013bafdd8af500f1877caecba81c29e27896ddb0c5548a56230dae56e"} Jul 20 09:57:38.093983 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.093929 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal" podStartSLOduration=22.093912378 podStartE2EDuration="22.093912378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:20.004951799 +0000 UTC m=+5.762776695" watchObservedRunningTime="2026-07-20 09:57:38.093912378 +0000 UTC m=+23.851737270" Jul 20 09:57:38.184901 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.184852 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s6shl" podStartSLOduration=3.98664814 podStartE2EDuration="23.184838553s" totalImagesPullingTime="19.198190413s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:38.13599415 +0000 UTC m=+23.893819041" watchObservedRunningTime="2026-07-20 09:57:38.184838553 +0000 UTC m=+23.942663444" Jul 20 09:57:38.185060 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.184923 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2mf8j" podStartSLOduration=12.429493758 podStartE2EDuration="23.184918912s" totalImagesPullingTime="10.755425154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:38.184493573 +0000 UTC m=+23.942318464" watchObservedRunningTime="2026-07-20 09:57:38.184918912 +0000 UTC m=+23.942743804" Jul 20 09:57:38.269255 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.269197 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rlg4l" podStartSLOduration=4.061024687 podStartE2EDuration="23.269176076s" totalImagesPullingTime="19.208151389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:38.269052276 +0000 UTC m=+24.026877168" watchObservedRunningTime="2026-07-20 09:57:38.269176076 +0000 UTC m=+24.027000970" Jul 20 09:57:38.269770 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.269737 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c7jvr" podStartSLOduration=4.070050476 podStartE2EDuration="23.269724946s" totalImagesPullingTime="19.19967447s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:38.220031613 +0000 UTC m=+23.977856506" watchObservedRunningTime="2026-07-20 09:57:38.269724946 +0000 UTC m=+24.027549840" Jul 20 09:57:38.310454 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.310358 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-phtmd" podStartSLOduration=4.087935013 podStartE2EDuration="23.310340543s" totalImagesPullingTime="19.22240553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:38.309362452 +0000 UTC m=+24.067187342" watchObservedRunningTime="2026-07-20 09:57:38.310340543 +0000 UTC m=+24.068165439" Jul 20 09:57:38.751419 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.751398 2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 20 09:57:38.805616 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:38.805580 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:38.806172 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:38.805720 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6t4" podUID="ed82fcf6-9e23-4480-ab33-68ca1d46dfaf" Jul 20 09:57:39.039794 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:39.039705 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ndwhk" event={"ID":"4c045356-44fb-4116-97c9-1a9897f93447","Type":"ContainerStarted","Data":"c68edae1415a4fbde5320505552f745d62bd72a8616a1b6f116f0c93c0397c48"} Jul 20 09:57:39.042097 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:39.042066 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" event={"ID":"86768e19-4658-495c-86fc-f84ff0660953","Type":"ContainerStarted","Data":"29a034eb0297f13702d393fc304819dc737356539bf01f91165048f8c0c269a7"} Jul 20 09:57:39.060471 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:39.060421 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ndwhk" podStartSLOduration=4.859892608 podStartE2EDuration="24.060407986s" totalImagesPullingTime="19.200515378s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:39.060097203 +0000 UTC m=+24.817922096" watchObservedRunningTime="2026-07-20 09:57:39.060407986 +0000 UTC m=+24.818232876" Jul 20 09:57:39.742582 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:39.742454 2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T09:57:38.751414381Z","UUID":"64d55bf5-aadb-4282-b539-733167c91ed9","Handler":null,"Name":"","Endpoint":""} Jul 20 09:57:39.744902 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:39.744878 2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 20 09:57:39.745028 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:39.744938 2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 20 09:57:39.805688 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:39.805661 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:39.806117 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:39.805697 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:39.806117 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:39.805795 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gx8gs" podUID="cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f" Jul 20 09:57:39.806117 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:39.805942 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvtzz" podUID="7d66f714-a387-4064-a9b6-95fb006c732a" Jul 20 09:57:40.470008 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:40.469929 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rlg4l" Jul 20 09:57:40.470612 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:40.470594 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rlg4l" Jul 20 09:57:40.806029 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:40.805950 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:40.807103 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:40.806088 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6t4" podUID="ed82fcf6-9e23-4480-ab33-68ca1d46dfaf" Jul 20 09:57:41.010318 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:41.010071 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rlg4l" Jul 20 09:57:41.010636 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:41.010619 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rlg4l" Jul 20 09:57:41.051011 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:41.050978 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" event={"ID":"b77339f6-cf2e-4381-991d-af590d424ed0","Type":"ContainerStarted","Data":"81eba370d94c44d1133a16a684cf8e62a8d0a7afbacc2926e39c800b5e7a77a1"} Jul 20 09:57:41.053291 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:41.053262 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" event={"ID":"86768e19-4658-495c-86fc-f84ff0660953","Type":"ContainerStarted","Data":"69074c21dc9ccfa97a6e22e66c7a29cf7a45b15541b92f37c597f6b6366e9277"} Jul 20 09:57:41.077135 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:41.077046 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sl6hc" podStartSLOduration=4.404965184 podStartE2EDuration="26.077030769s" totalImagesPullingTime="21.672065585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:41.07642593 +0000 UTC m=+26.834250823" watchObservedRunningTime="2026-07-20 09:57:41.077030769 +0000 UTC m=+26.834855659" Jul 20 09:57:41.805336 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:41.805300 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:41.805594 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:41.805433 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvtzz" podUID="7d66f714-a387-4064-a9b6-95fb006c732a" Jul 20 09:57:41.805594 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:41.805502 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:41.805721 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:41.805649 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gx8gs" podUID="cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f" Jul 20 09:57:42.805375 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:42.805187 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:42.806166 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:42.805472 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6t4" podUID="ed82fcf6-9e23-4480-ab33-68ca1d46dfaf" Jul 20 09:57:43.060883 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:43.060766 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" event={"ID":"b77339f6-cf2e-4381-991d-af590d424ed0","Type":"ContainerStarted","Data":"9be84da660fe6cc1f782622e7a75839cb38520b5e91ced1fc58c0634038a205a"} Jul 20 09:57:43.061071 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:43.061052 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:43.061152 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:43.061115 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:43.061202 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:43.061165 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:43.062831 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:43.062801 2584 generic.go:356] "Generic (PLEG): container finished" podID="d6a09d1a-3a7b-43c6-9dbf-382dc473bc64" containerID="6047fe9565b87c617abfb994af268c2c7e74caa9493effc6698efd3766b6db12" exitCode=0 Jul 20 09:57:43.062969 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:43.062857 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2xdk" event={"ID":"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64","Type":"ContainerDied","Data":"6047fe9565b87c617abfb994af268c2c7e74caa9493effc6698efd3766b6db12"} Jul 20 09:57:43.077281 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:43.077260 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:43.077382 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:43.077360 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:57:43.093894 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:43.093854 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" podStartSLOduration=8.824161212 podStartE2EDuration="28.093840602s" totalImagesPullingTime="19.26967939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:43.092164555 +0000 UTC m=+28.849989445" watchObservedRunningTime="2026-07-20 09:57:43.093840602 +0000 UTC m=+28.851665507" Jul 20 09:57:43.805264 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:43.805229 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:43.805480 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:43.805245 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:43.805480 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:43.805367 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gx8gs" podUID="cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f" Jul 20 09:57:43.805480 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:43.805395 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvtzz" podUID="7d66f714-a387-4064-a9b6-95fb006c732a" Jul 20 09:57:44.331501 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:44.331469 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jb6t4"] Jul 20 09:57:44.331666 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:44.331639 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:44.331794 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:44.331768 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6t4" podUID="ed82fcf6-9e23-4480-ab33-68ca1d46dfaf" Jul 20 09:57:44.334549 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:44.334502 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dvtzz"] Jul 20 09:57:44.334646 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:44.334611 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:44.334708 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:44.334692 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvtzz" podUID="7d66f714-a387-4064-a9b6-95fb006c732a" Jul 20 09:57:44.335647 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:44.335624 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gx8gs"] Jul 20 09:57:44.335756 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:44.335699 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:44.335815 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:44.335798 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gx8gs" podUID="cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f" Jul 20 09:57:45.069206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:45.069177 2584 generic.go:356] "Generic (PLEG): container finished" podID="d6a09d1a-3a7b-43c6-9dbf-382dc473bc64" containerID="9473733187fe8b635362540f50010862180c6ddb362cbbabed9afde0945a0575" exitCode=0 Jul 20 09:57:45.069608 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:45.069255 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2xdk" event={"ID":"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64","Type":"ContainerDied","Data":"9473733187fe8b635362540f50010862180c6ddb362cbbabed9afde0945a0575"} Jul 20 09:57:45.805358 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:45.805318 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:45.805525 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:45.805366 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:45.805525 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:45.805411 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:45.805525 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:45.805423 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvtzz" podUID="7d66f714-a387-4064-a9b6-95fb006c732a" Jul 20 09:57:45.805525 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:45.805482 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6t4" podUID="ed82fcf6-9e23-4480-ab33-68ca1d46dfaf" Jul 20 09:57:45.805688 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:45.805579 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gx8gs" podUID="cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f" Jul 20 09:57:46.073530 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:46.073451 2584 generic.go:356] "Generic (PLEG): container finished" podID="d6a09d1a-3a7b-43c6-9dbf-382dc473bc64" containerID="c3112cbacabf6fef1dabb10e3ba4b47a56a3241390bab1c01a1efb6fdb7e7470" exitCode=0 Jul 20 09:57:46.073530 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:46.073510 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2xdk" event={"ID":"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64","Type":"ContainerDied","Data":"c3112cbacabf6fef1dabb10e3ba4b47a56a3241390bab1c01a1efb6fdb7e7470"} Jul 20 09:57:47.805097 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:47.805061 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:47.805097 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:47.805101 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:47.805726 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:47.805066 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:47.805726 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:47.805173 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvtzz" podUID="7d66f714-a387-4064-a9b6-95fb006c732a" Jul 20 09:57:47.805726 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:47.805255 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gx8gs" podUID="cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f" Jul 20 09:57:47.805726 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:47.805335 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6t4" podUID="ed82fcf6-9e23-4480-ab33-68ca1d46dfaf" Jul 20 09:57:48.498118 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:48.498086 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret\") pod \"global-pull-secret-syncer-jb6t4\" (UID: \"ed82fcf6-9e23-4480-ab33-68ca1d46dfaf\") " pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:48.498300 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:48.498135 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs\") pod \"network-metrics-daemon-gx8gs\" (UID: \"cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f\") " pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:48.498300 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:48.498249 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:48.498300 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:48.498286 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:48.498469 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:48.498320 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret podName:ed82fcf6-9e23-4480-ab33-68ca1d46dfaf nodeName:}" failed. No retries permitted until 2026-07-20 09:58:20.498299126 +0000 UTC m=+66.256123995 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret") pod "global-pull-secret-syncer-jb6t4" (UID: "ed82fcf6-9e23-4480-ab33-68ca1d46dfaf") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:48.498469 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:48.498339 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs podName:cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f nodeName:}" failed. No retries permitted until 2026-07-20 09:58:20.498329817 +0000 UTC m=+66.256154688 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs") pod "network-metrics-daemon-gx8gs" (UID: "cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:48.598563 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:48.598511 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v888s\" (UniqueName: \"kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s\") pod \"network-check-target-dvtzz\" (UID: \"7d66f714-a387-4064-a9b6-95fb006c732a\") " pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:48.598712 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:48.598664 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:57:48.598712 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:48.598686 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:57:48.598712 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:48.598695 2584 projected.go:196] Error preparing data for projected volume kube-api-access-v888s for pod openshift-network-diagnostics/network-check-target-dvtzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:48.598807 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:48.598746 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s podName:7d66f714-a387-4064-a9b6-95fb006c732a nodeName:}" failed. No retries permitted until 2026-07-20 09:58:20.598730635 +0000 UTC m=+66.356555504 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-v888s" (UniqueName: "kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s") pod "network-check-target-dvtzz" (UID: "7d66f714-a387-4064-a9b6-95fb006c732a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:49.805801 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:49.805753 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:49.805801 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:49.805779 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:49.805801 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:49.805803 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:49.806566 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:49.805899 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvtzz" podUID="7d66f714-a387-4064-a9b6-95fb006c732a" Jul 20 09:57:49.806566 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:49.806172 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gx8gs" podUID="cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f" Jul 20 09:57:49.806566 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:49.806386 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jb6t4" podUID="ed82fcf6-9e23-4480-ab33-68ca1d46dfaf" Jul 20 09:57:51.031548 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.031520 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeReady" Jul 20 09:57:51.032094 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.031670 2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 20 09:57:51.082485 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.082454 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vw52w"] Jul 20 09:57:51.084474 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.084451 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ckr5n"] Jul 20 09:57:51.084622 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.084585 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vw52w" Jul 20 09:57:51.086224 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.086204 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ckr5n" Jul 20 09:57:51.087089 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.087065 2584 generic.go:356] "Generic (PLEG): container finished" podID="d6a09d1a-3a7b-43c6-9dbf-382dc473bc64" containerID="eba269eb9720525a43da54449cbe81e8d5ed4860433d23d483fbf00b807427e5" exitCode=0 Jul 20 09:57:51.087194 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.087120 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2xdk" event={"ID":"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64","Type":"ContainerDied","Data":"eba269eb9720525a43da54449cbe81e8d5ed4860433d23d483fbf00b807427e5"} Jul 20 09:57:51.087252 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.087196 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 20 09:57:51.087503 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.087487 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7r5mf\"" Jul 20 09:57:51.087597 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.087580 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 20 09:57:51.088682 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.088665 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mjpn5\"" Jul 20 09:57:51.088781 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.088703 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 20 09:57:51.088952 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.088930 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 20 09:57:51.089054 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.089038 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 20 09:57:51.096152 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.096124 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ckr5n"] Jul 20 09:57:51.100786 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.100330 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vw52w"] Jul 20 09:57:51.217206 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.217176 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb4gn\" (UniqueName: \"kubernetes.io/projected/ff533437-340c-4587-98de-04091941072f-kube-api-access-xb4gn\") pod \"dns-default-vw52w\" (UID: \"ff533437-340c-4587-98de-04091941072f\") " pod="openshift-dns/dns-default-vw52w" Jul 20 09:57:51.217346 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.217242 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67690331-05ca-4498-bc34-96466d9078ee-cert\") pod \"ingress-canary-ckr5n\" (UID: \"67690331-05ca-4498-bc34-96466d9078ee\") " pod="openshift-ingress-canary/ingress-canary-ckr5n" Jul 20 09:57:51.217346 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.217276 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls\") pod \"dns-default-vw52w\" (UID: \"ff533437-340c-4587-98de-04091941072f\") " pod="openshift-dns/dns-default-vw52w" Jul 20 09:57:51.217346 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.217317 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff533437-340c-4587-98de-04091941072f-tmp-dir\") pod \"dns-default-vw52w\" (UID: \"ff533437-340c-4587-98de-04091941072f\") " pod="openshift-dns/dns-default-vw52w" Jul 20 09:57:51.217504 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.217397 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ff533437-340c-4587-98de-04091941072f-config-volume\") pod \"dns-default-vw52w\" (UID: \"ff533437-340c-4587-98de-04091941072f\") " pod="openshift-dns/dns-default-vw52w" Jul 20 09:57:51.217504 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.217424 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxhxj\" (UniqueName: \"kubernetes.io/projected/67690331-05ca-4498-bc34-96466d9078ee-kube-api-access-zxhxj\") pod \"ingress-canary-ckr5n\" (UID: \"67690331-05ca-4498-bc34-96466d9078ee\") " pod="openshift-ingress-canary/ingress-canary-ckr5n" Jul 20 09:57:51.318559 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.318437 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb4gn\" (UniqueName: \"kubernetes.io/projected/ff533437-340c-4587-98de-04091941072f-kube-api-access-xb4gn\") pod \"dns-default-vw52w\" (UID: \"ff533437-340c-4587-98de-04091941072f\") " pod="openshift-dns/dns-default-vw52w" Jul 20 09:57:51.318559 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.318519 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67690331-05ca-4498-bc34-96466d9078ee-cert\") pod \"ingress-canary-ckr5n\" (UID: \"67690331-05ca-4498-bc34-96466d9078ee\") " pod="openshift-ingress-canary/ingress-canary-ckr5n" Jul 20 09:57:51.318758 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.318564 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls\") pod \"dns-default-vw52w\" (UID: \"ff533437-340c-4587-98de-04091941072f\") " pod="openshift-dns/dns-default-vw52w" Jul 20 09:57:51.318758 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.318598 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff533437-340c-4587-98de-04091941072f-tmp-dir\") pod \"dns-default-vw52w\" (UID: \"ff533437-340c-4587-98de-04091941072f\") " pod="openshift-dns/dns-default-vw52w" Jul 20 09:57:51.318758 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.318651 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ff533437-340c-4587-98de-04091941072f-config-volume\") pod \"dns-default-vw52w\" (UID: \"ff533437-340c-4587-98de-04091941072f\") " pod="openshift-dns/dns-default-vw52w" Jul 20 09:57:51.318758 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.318680 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhxj\" (UniqueName: \"kubernetes.io/projected/67690331-05ca-4498-bc34-96466d9078ee-kube-api-access-zxhxj\") pod \"ingress-canary-ckr5n\" (UID: \"67690331-05ca-4498-bc34-96466d9078ee\") " pod="openshift-ingress-canary/ingress-canary-ckr5n" Jul 20 09:57:51.318758 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:51.318733 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:57:51.318980 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:51.318820 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls podName:ff533437-340c-4587-98de-04091941072f nodeName:}" failed. No retries permitted until 2026-07-20 09:57:51.818798895 +0000 UTC m=+37.576623765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls") pod "dns-default-vw52w" (UID: "ff533437-340c-4587-98de-04091941072f") : secret "dns-default-metrics-tls" not found Jul 20 09:57:51.319026 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.319006 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff533437-340c-4587-98de-04091941072f-tmp-dir\") pod \"dns-default-vw52w\" (UID: \"ff533437-340c-4587-98de-04091941072f\") " pod="openshift-dns/dns-default-vw52w" Jul 20 09:57:51.319284 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.319265 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ff533437-340c-4587-98de-04091941072f-config-volume\") pod \"dns-default-vw52w\" (UID: \"ff533437-340c-4587-98de-04091941072f\") " pod="openshift-dns/dns-default-vw52w" Jul 20 09:57:51.322805 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.322783 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67690331-05ca-4498-bc34-96466d9078ee-cert\") pod \"ingress-canary-ckr5n\" (UID: \"67690331-05ca-4498-bc34-96466d9078ee\") " pod="openshift-ingress-canary/ingress-canary-ckr5n" Jul 20 09:57:51.329650 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.329629 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxhxj\" (UniqueName: \"kubernetes.io/projected/67690331-05ca-4498-bc34-96466d9078ee-kube-api-access-zxhxj\") pod \"ingress-canary-ckr5n\" (UID: \"67690331-05ca-4498-bc34-96466d9078ee\") " pod="openshift-ingress-canary/ingress-canary-ckr5n" Jul 20 09:57:51.329936 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.329918 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb4gn\" (UniqueName: \"kubernetes.io/projected/ff533437-340c-4587-98de-04091941072f-kube-api-access-xb4gn\") pod \"dns-default-vw52w\" (UID: \"ff533437-340c-4587-98de-04091941072f\") " pod="openshift-dns/dns-default-vw52w" Jul 20 09:57:51.402332 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.402302 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ckr5n" Jul 20 09:57:51.528564 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.528358 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ckr5n"] Jul 20 09:57:51.532018 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:57:51.531996 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67690331_05ca_4498_bc34_96466d9078ee.slice/crio-3ae1bf5ac55480534b57ffd38ce9958e54547623568a18a7805dad1759a05334 WatchSource:0}: Error finding container 3ae1bf5ac55480534b57ffd38ce9958e54547623568a18a7805dad1759a05334: Status 404 returned error can't find the container with id 3ae1bf5ac55480534b57ffd38ce9958e54547623568a18a7805dad1759a05334 Jul 20 09:57:51.805494 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.805364 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:57:51.805494 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.805394 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:57:51.805713 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.805401 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:57:51.808766 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.808738 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 09:57:51.808972 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.808955 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q8hvk\"" Jul 20 09:57:51.808972 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.808964 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fk8qt\"" Jul 20 09:57:51.809097 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.808971 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 09:57:51.809097 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.808964 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 09:57:51.809972 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.809954 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 09:57:51.822647 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:51.822624 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls\") pod \"dns-default-vw52w\" (UID: \"ff533437-340c-4587-98de-04091941072f\") " pod="openshift-dns/dns-default-vw52w" Jul 20 09:57:51.822730 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:51.822718 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:57:51.822800 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:51.822790 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls podName:ff533437-340c-4587-98de-04091941072f nodeName:}" failed. No retries permitted until 2026-07-20 09:57:52.822772733 +0000 UTC m=+38.580597605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls") pod "dns-default-vw52w" (UID: "ff533437-340c-4587-98de-04091941072f") : secret "dns-default-metrics-tls" not found Jul 20 09:57:52.091204 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:52.091110 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ckr5n" event={"ID":"67690331-05ca-4498-bc34-96466d9078ee","Type":"ContainerStarted","Data":"3ae1bf5ac55480534b57ffd38ce9958e54547623568a18a7805dad1759a05334"} Jul 20 09:57:52.094772 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:52.094733 2584 generic.go:356] "Generic (PLEG): container finished" podID="d6a09d1a-3a7b-43c6-9dbf-382dc473bc64" containerID="cfa7e54601fec4c7a8240e40573304f62bc98801625102e11e22211338aeef86" exitCode=0 Jul 20 09:57:52.094898 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:52.094783 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2xdk" event={"ID":"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64","Type":"ContainerDied","Data":"cfa7e54601fec4c7a8240e40573304f62bc98801625102e11e22211338aeef86"} Jul 20 09:57:52.830198 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:52.830167 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls\") pod \"dns-default-vw52w\" (UID: \"ff533437-340c-4587-98de-04091941072f\") " pod="openshift-dns/dns-default-vw52w" Jul 20 09:57:52.830378 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:52.830333 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:57:52.830448 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:52.830409 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls podName:ff533437-340c-4587-98de-04091941072f nodeName:}" failed. No retries permitted until 2026-07-20 09:57:54.830390058 +0000 UTC m=+40.588214950 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls") pod "dns-default-vw52w" (UID: "ff533437-340c-4587-98de-04091941072f") : secret "dns-default-metrics-tls" not found Jul 20 09:57:53.102354 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:53.102100 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h2xdk" event={"ID":"d6a09d1a-3a7b-43c6-9dbf-382dc473bc64","Type":"ContainerStarted","Data":"d9b2dac988844072077fca6817b1aead4b5b33dc597aa63850a8a048a9593fab"} Jul 20 09:57:53.129523 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:53.129458 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h2xdk" podStartSLOduration=8.347639146 podStartE2EDuration="38.129283219s" totalImagesPullingTime="29.781644073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:53.127425718 +0000 UTC m=+38.885250611" watchObservedRunningTime="2026-07-20 09:57:53.129283219 +0000 UTC m=+38.887108110" Jul 20 09:57:54.105735 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:54.105694 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ckr5n" event={"ID":"67690331-05ca-4498-bc34-96466d9078ee","Type":"ContainerStarted","Data":"84e6849a25eca1108c501aea85768bb97dbdfa0ae7a8d909e7c85e45b7070b3d"} Jul 20 09:57:54.846371 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:54.846332 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls\") pod \"dns-default-vw52w\" (UID: \"ff533437-340c-4587-98de-04091941072f\") " pod="openshift-dns/dns-default-vw52w" Jul 20 09:57:54.846564 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:54.846481 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:57:54.846564 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:54.846559 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls podName:ff533437-340c-4587-98de-04091941072f nodeName:}" failed. No retries permitted until 2026-07-20 09:57:58.846526217 +0000 UTC m=+44.604351086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls") pod "dns-default-vw52w" (UID: "ff533437-340c-4587-98de-04091941072f") : secret "dns-default-metrics-tls" not found Jul 20 09:57:58.879062 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:57:58.879021 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls\") pod \"dns-default-vw52w\" (UID: \"ff533437-340c-4587-98de-04091941072f\") " pod="openshift-dns/dns-default-vw52w" Jul 20 09:57:58.879508 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:58.879142 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:57:58.879508 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:57:58.879209 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls podName:ff533437-340c-4587-98de-04091941072f nodeName:}" failed. No retries permitted until 2026-07-20 09:58:06.8791942 +0000 UTC m=+52.637019069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls") pod "dns-default-vw52w" (UID: "ff533437-340c-4587-98de-04091941072f") : secret "dns-default-metrics-tls" not found Jul 20 09:58:06.935368 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:06.935326 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls\") pod \"dns-default-vw52w\" (UID: \"ff533437-340c-4587-98de-04091941072f\") " pod="openshift-dns/dns-default-vw52w" Jul 20 09:58:06.935858 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:06.935492 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:58:06.935858 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:06.935579 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls podName:ff533437-340c-4587-98de-04091941072f nodeName:}" failed. No retries permitted until 2026-07-20 09:58:22.935563225 +0000 UTC m=+68.693388093 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls") pod "dns-default-vw52w" (UID: "ff533437-340c-4587-98de-04091941072f") : secret "dns-default-metrics-tls" not found Jul 20 09:58:15.079504 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:15.079476 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmnb2" Jul 20 09:58:15.109448 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:15.109372 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ckr5n" podStartSLOduration=22.051328709 podStartE2EDuration="24.109356453s" totalImagesPullingTime="2.058027744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:57:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:54.136784984 +0000 UTC m=+39.894609874" watchObservedRunningTime="2026-07-20 09:58:15.109356453 +0000 UTC m=+60.867181344" Jul 20 09:58:20.535756 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:20.535715 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs\") pod \"network-metrics-daemon-gx8gs\" (UID: \"cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f\") " pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:58:20.536257 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:20.535779 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret\") pod \"global-pull-secret-syncer-jb6t4\" (UID: \"ed82fcf6-9e23-4480-ab33-68ca1d46dfaf\") " pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:58:20.538872 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:20.538855 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 09:58:20.538941 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:20.538895 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 09:58:20.546409 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:20.546386 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 20 09:58:20.546515 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:20.546445 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs podName:cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f nodeName:}" failed. No retries permitted until 2026-07-20 09:59:24.546428857 +0000 UTC m=+130.304253725 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs") pod "network-metrics-daemon-gx8gs" (UID: "cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f") : secret "metrics-daemon-secret" not found Jul 20 09:58:20.550018 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:20.549994 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ed82fcf6-9e23-4480-ab33-68ca1d46dfaf-original-pull-secret\") pod \"global-pull-secret-syncer-jb6t4\" (UID: \"ed82fcf6-9e23-4480-ab33-68ca1d46dfaf\") " pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:58:20.615242 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:20.615201 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jb6t4" Jul 20 09:58:20.636271 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:20.636242 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v888s\" (UniqueName: \"kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s\") pod \"network-check-target-dvtzz\" (UID: \"7d66f714-a387-4064-a9b6-95fb006c732a\") " pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:58:20.639471 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:20.639453 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 09:58:20.650023 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:20.649998 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 09:58:20.660122 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:20.660092 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v888s\" (UniqueName: \"kubernetes.io/projected/7d66f714-a387-4064-a9b6-95fb006c732a-kube-api-access-v888s\") pod \"network-check-target-dvtzz\" (UID: \"7d66f714-a387-4064-a9b6-95fb006c732a\") " pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:58:20.735236 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:20.735165 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jb6t4"] Jul 20 09:58:20.739471 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:58:20.739444 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded82fcf6_9e23_4480_ab33_68ca1d46dfaf.slice/crio-f21734c9e423c6c0e27c9f75cb56d40a7fd6c63cae48ce2e44750f1bbe5e2d0e WatchSource:0}: Error finding container f21734c9e423c6c0e27c9f75cb56d40a7fd6c63cae48ce2e44750f1bbe5e2d0e: Status 404 returned error can't find the container with id f21734c9e423c6c0e27c9f75cb56d40a7fd6c63cae48ce2e44750f1bbe5e2d0e Jul 20 09:58:20.925286 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:20.925207 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fk8qt\"" Jul 20 09:58:20.930668 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:20.930651 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:58:21.050581 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:21.050555 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dvtzz"] Jul 20 09:58:21.052844 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:58:21.052819 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d66f714_a387_4064_a9b6_95fb006c732a.slice/crio-c440ae406728ec10127efc449df424ad161cbac23a6c52384861d3be781caca5 WatchSource:0}: Error finding container c440ae406728ec10127efc449df424ad161cbac23a6c52384861d3be781caca5: Status 404 returned error can't find the container with id c440ae406728ec10127efc449df424ad161cbac23a6c52384861d3be781caca5 Jul 20 09:58:21.167848 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:21.167809 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dvtzz" event={"ID":"7d66f714-a387-4064-a9b6-95fb006c732a","Type":"ContainerStarted","Data":"c440ae406728ec10127efc449df424ad161cbac23a6c52384861d3be781caca5"} Jul 20 09:58:21.168874 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:21.168852 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jb6t4" event={"ID":"ed82fcf6-9e23-4480-ab33-68ca1d46dfaf","Type":"ContainerStarted","Data":"f21734c9e423c6c0e27c9f75cb56d40a7fd6c63cae48ce2e44750f1bbe5e2d0e"} Jul 20 09:58:22.951989 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:22.951947 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls\") pod \"dns-default-vw52w\" (UID: \"ff533437-340c-4587-98de-04091941072f\") " pod="openshift-dns/dns-default-vw52w" Jul 20 09:58:22.952431 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:22.952155 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:58:22.952431 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:22.952242 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls podName:ff533437-340c-4587-98de-04091941072f nodeName:}" failed. No retries permitted until 2026-07-20 09:58:54.952219447 +0000 UTC m=+100.710044335 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls") pod "dns-default-vw52w" (UID: "ff533437-340c-4587-98de-04091941072f") : secret "dns-default-metrics-tls" not found Jul 20 09:58:23.525110 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.525074 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb"] Jul 20 09:58:23.542329 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.542296 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb" Jul 20 09:58:23.543914 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.543880 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb"] Jul 20 09:58:23.546126 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.546091 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 20 09:58:23.546260 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.546205 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 20 09:58:23.546406 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.546382 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4h92j\"" Jul 20 09:58:23.549011 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.548988 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 20 09:58:23.549138 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.549032 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 20 09:58:23.651267 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.651237 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-999d75578-sn452"] Jul 20 09:58:23.658455 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.658420 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gnhqb\" (UID: \"842b54d2-d9e9-40fc-b879-9f0a9eb80998\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb" Jul 20 09:58:23.658646 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.658464 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4s8s\" (UniqueName: \"kubernetes.io/projected/842b54d2-d9e9-40fc-b879-9f0a9eb80998-kube-api-access-s4s8s\") pod \"cluster-monitoring-operator-76cf8966f8-gnhqb\" (UID: \"842b54d2-d9e9-40fc-b879-9f0a9eb80998\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb" Jul 20 09:58:23.658646 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.658605 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/842b54d2-d9e9-40fc-b879-9f0a9eb80998-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-gnhqb\" (UID: \"842b54d2-d9e9-40fc-b879-9f0a9eb80998\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb" Jul 20 09:58:23.675945 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.675915 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-999d75578-sn452"] Jul 20 09:58:23.676098 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.676030 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:23.678715 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.678692 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-n8ggl\"" Jul 20 09:58:23.679054 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.679028 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 20 09:58:23.679162 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.679139 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 20 09:58:23.679871 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.679851 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 20 09:58:23.679981 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.679923 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 20 09:58:23.680051 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.680012 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 20 09:58:23.680139 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.680120 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 20 09:58:23.759439 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.759401 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/842b54d2-d9e9-40fc-b879-9f0a9eb80998-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-gnhqb\" (UID: \"842b54d2-d9e9-40fc-b879-9f0a9eb80998\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb" Jul 20 09:58:23.759439 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.759442 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gnhqb\" (UID: \"842b54d2-d9e9-40fc-b879-9f0a9eb80998\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb" Jul 20 09:58:23.759693 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.759463 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4s8s\" (UniqueName: \"kubernetes.io/projected/842b54d2-d9e9-40fc-b879-9f0a9eb80998-kube-api-access-s4s8s\") pod \"cluster-monitoring-operator-76cf8966f8-gnhqb\" (UID: \"842b54d2-d9e9-40fc-b879-9f0a9eb80998\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb" Jul 20 09:58:23.759693 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:23.759602 2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 09:58:23.759693 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:23.759679 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls podName:842b54d2-d9e9-40fc-b879-9f0a9eb80998 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:24.259658284 +0000 UTC m=+70.017483155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-gnhqb" (UID: "842b54d2-d9e9-40fc-b879-9f0a9eb80998") : secret "cluster-monitoring-operator-tls" not found Jul 20 09:58:23.760243 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.760218 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/842b54d2-d9e9-40fc-b879-9f0a9eb80998-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-gnhqb\" (UID: \"842b54d2-d9e9-40fc-b879-9f0a9eb80998\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb" Jul 20 09:58:23.772358 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.772324 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4s8s\" (UniqueName: \"kubernetes.io/projected/842b54d2-d9e9-40fc-b879-9f0a9eb80998-kube-api-access-s4s8s\") pod \"cluster-monitoring-operator-76cf8966f8-gnhqb\" (UID: \"842b54d2-d9e9-40fc-b879-9f0a9eb80998\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb" Jul 20 09:58:23.860413 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.860324 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:23.860413 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.860393 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-default-certificate\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:23.860616 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.860440 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-stats-auth\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:23.860616 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.860575 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mskbl\" (UniqueName: \"kubernetes.io/projected/0804cfeb-f931-49da-ad64-d62bcd2f8503-kube-api-access-mskbl\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:23.860698 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.860653 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:23.961893 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.961850 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mskbl\" (UniqueName: \"kubernetes.io/projected/0804cfeb-f931-49da-ad64-d62bcd2f8503-kube-api-access-mskbl\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:23.962351 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.961927 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:23.962351 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.961976 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:23.962351 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:23.962102 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 09:58:23.962351 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.962116 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-default-certificate\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:23.962351 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:23.962165 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs podName:0804cfeb-f931-49da-ad64-d62bcd2f8503 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:24.462148841 +0000 UTC m=+70.219973710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs") pod "router-default-999d75578-sn452" (UID: "0804cfeb-f931-49da-ad64-d62bcd2f8503") : secret "router-metrics-certs-default" not found Jul 20 09:58:23.962351 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.962187 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-stats-auth\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:23.962351 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:23.962226 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle podName:0804cfeb-f931-49da-ad64-d62bcd2f8503 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:24.462218983 +0000 UTC m=+70.220043851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle") pod "router-default-999d75578-sn452" (UID: "0804cfeb-f931-49da-ad64-d62bcd2f8503") : configmap references non-existent config key: service-ca.crt Jul 20 09:58:23.965099 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.965073 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-stats-auth\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:23.965237 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.965080 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-default-certificate\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:23.975728 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:23.975700 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mskbl\" (UniqueName: \"kubernetes.io/projected/0804cfeb-f931-49da-ad64-d62bcd2f8503-kube-api-access-mskbl\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:24.265154 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:24.265111 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gnhqb\" (UID: \"842b54d2-d9e9-40fc-b879-9f0a9eb80998\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb" Jul 20 09:58:24.265309 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:24.265274 2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 09:58:24.265367 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:24.265346 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls podName:842b54d2-d9e9-40fc-b879-9f0a9eb80998 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:25.265331648 +0000 UTC m=+71.023156522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-gnhqb" (UID: "842b54d2-d9e9-40fc-b879-9f0a9eb80998") : secret "cluster-monitoring-operator-tls" not found Jul 20 09:58:24.467280 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:24.467234 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:24.467463 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:24.467308 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:24.467463 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:24.467456 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 09:58:24.467613 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:24.467458 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle podName:0804cfeb-f931-49da-ad64-d62bcd2f8503 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:25.467435997 +0000 UTC m=+71.225260869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle") pod "router-default-999d75578-sn452" (UID: "0804cfeb-f931-49da-ad64-d62bcd2f8503") : configmap references non-existent config key: service-ca.crt Jul 20 09:58:24.467613 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:24.467523 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs podName:0804cfeb-f931-49da-ad64-d62bcd2f8503 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:25.467503443 +0000 UTC m=+71.225328316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs") pod "router-default-999d75578-sn452" (UID: "0804cfeb-f931-49da-ad64-d62bcd2f8503") : secret "router-metrics-certs-default" not found Jul 20 09:58:25.272612 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:25.272566 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gnhqb\" (UID: \"842b54d2-d9e9-40fc-b879-9f0a9eb80998\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb" Jul 20 09:58:25.273086 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:25.273062 2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 09:58:25.273164 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:25.273154 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls podName:842b54d2-d9e9-40fc-b879-9f0a9eb80998 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:27.273133426 +0000 UTC m=+73.030958312 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-gnhqb" (UID: "842b54d2-d9e9-40fc-b879-9f0a9eb80998") : secret "cluster-monitoring-operator-tls" not found Jul 20 09:58:25.475027 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:25.474981 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:25.475197 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:25.475047 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:25.475197 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:25.475154 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 09:58:25.475275 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:25.475226 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs podName:0804cfeb-f931-49da-ad64-d62bcd2f8503 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:27.475209923 +0000 UTC m=+73.233034792 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs") pod "router-default-999d75578-sn452" (UID: "0804cfeb-f931-49da-ad64-d62bcd2f8503") : secret "router-metrics-certs-default" not found Jul 20 09:58:25.475275 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:25.475242 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle podName:0804cfeb-f931-49da-ad64-d62bcd2f8503 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:27.475236463 +0000 UTC m=+73.233061332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle") pod "router-default-999d75578-sn452" (UID: "0804cfeb-f931-49da-ad64-d62bcd2f8503") : configmap references non-existent config key: service-ca.crt Jul 20 09:58:26.184646 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:26.184553 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dvtzz" event={"ID":"7d66f714-a387-4064-a9b6-95fb006c732a","Type":"ContainerStarted","Data":"d44e4d162cc1dbbad550d41ab79aad18ee58cbe4ea3b29786988514b287cc7fa"} Jul 20 09:58:26.184871 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:26.184687 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:58:26.185852 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:26.185821 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jb6t4" event={"ID":"ed82fcf6-9e23-4480-ab33-68ca1d46dfaf","Type":"ContainerStarted","Data":"fc3ee4143b31109f291a9212bd5ab67da18cf1b653f5cfb837587633e895c3ec"} Jul 20 09:58:26.227763 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:26.227706 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dvtzz" podStartSLOduration=66.43995153 podStartE2EDuration="1m11.2276893s" totalImagesPullingTime="4.78773777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:26.203334408 +0000 UTC m=+71.961159302" watchObservedRunningTime="2026-07-20 09:58:26.2276893 +0000 UTC m=+71.985514266" Jul 20 09:58:26.227942 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:26.227899 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jb6t4" podStartSLOduration=66.115664599 podStartE2EDuration="1m11.227889971s" totalImagesPullingTime="5.112225372s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:26.227096383 +0000 UTC m=+71.984921273" watchObservedRunningTime="2026-07-20 09:58:26.227889971 +0000 UTC m=+71.985714864" Jul 20 09:58:27.288023 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.287972 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gnhqb\" (UID: \"842b54d2-d9e9-40fc-b879-9f0a9eb80998\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb" Jul 20 09:58:27.288477 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:27.288125 2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 09:58:27.288477 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:27.288193 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls podName:842b54d2-d9e9-40fc-b879-9f0a9eb80998 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:31.288172148 +0000 UTC m=+77.045997016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-gnhqb" (UID: "842b54d2-d9e9-40fc-b879-9f0a9eb80998") : secret "cluster-monitoring-operator-tls" not found Jul 20 09:58:27.489692 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.489645 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:27.489692 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.489706 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:27.489941 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:27.489800 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 09:58:27.489941 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:27.489848 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle podName:0804cfeb-f931-49da-ad64-d62bcd2f8503 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:31.489835995 +0000 UTC m=+77.247660864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle") pod "router-default-999d75578-sn452" (UID: "0804cfeb-f931-49da-ad64-d62bcd2f8503") : configmap references non-existent config key: service-ca.crt Jul 20 09:58:27.489941 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:27.489864 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs podName:0804cfeb-f931-49da-ad64-d62bcd2f8503 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:31.489856879 +0000 UTC m=+77.247681748 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs") pod "router-default-999d75578-sn452" (UID: "0804cfeb-f931-49da-ad64-d62bcd2f8503") : secret "router-metrics-certs-default" not found Jul 20 09:58:27.571220 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.571142 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-spn8c"] Jul 20 09:58:27.572963 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.572946 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:27.576318 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.576297 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 20 09:58:27.577019 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.577000 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 20 09:58:27.577767 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.577747 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 20 09:58:27.577767 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.577758 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 20 09:58:27.577925 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.577763 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pkkvc\"" Jul 20 09:58:27.590818 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.590793 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1175aa8c-e324-496a-a96f-146cd4d65de4-crio-socket\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:27.590920 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.590842 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:27.590920 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.590860 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwgkm\" (UniqueName: \"kubernetes.io/projected/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-api-access-zwgkm\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:27.591013 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.590921 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:27.591013 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.590945 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1175aa8c-e324-496a-a96f-146cd4d65de4-data-volume\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:27.597007 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.596984 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-spn8c"] Jul 20 09:58:27.691276 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.691237 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1175aa8c-e324-496a-a96f-146cd4d65de4-data-volume\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:27.691276 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.691283 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1175aa8c-e324-496a-a96f-146cd4d65de4-crio-socket\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:27.691526 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.691371 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1175aa8c-e324-496a-a96f-146cd4d65de4-crio-socket\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:27.691526 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.691402 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:27.691526 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.691423 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwgkm\" (UniqueName: \"kubernetes.io/projected/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-api-access-zwgkm\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:27.691704 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:27.691518 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:58:27.691704 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:27.691607 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls podName:1175aa8c-e324-496a-a96f-146cd4d65de4 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:28.191586666 +0000 UTC m=+73.949411556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-spn8c" (UID: "1175aa8c-e324-496a-a96f-146cd4d65de4") : secret "insights-runtime-extractor-tls" not found Jul 20 09:58:27.691704 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.691641 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:27.691704 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.691656 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1175aa8c-e324-496a-a96f-146cd4d65de4-data-volume\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:27.691837 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:27.691708 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 09:58:27.691837 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:27.691746 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-rbac-proxy-cm podName:1175aa8c-e324-496a-a96f-146cd4d65de4 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:28.191735586 +0000 UTC m=+73.949560481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-spn8c" (UID: "1175aa8c-e324-496a-a96f-146cd4d65de4") : configmap "kube-rbac-proxy" not found Jul 20 09:58:27.701361 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:27.701345 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwgkm\" (UniqueName: \"kubernetes.io/projected/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-api-access-zwgkm\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:28.195365 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:28.195330 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:28.195584 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:28.195393 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:28.195584 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:28.195461 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 09:58:28.195584 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:28.195493 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:58:28.195584 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:28.195561 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-rbac-proxy-cm podName:1175aa8c-e324-496a-a96f-146cd4d65de4 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:29.195525604 +0000 UTC m=+74.953350476 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-spn8c" (UID: "1175aa8c-e324-496a-a96f-146cd4d65de4") : configmap "kube-rbac-proxy" not found Jul 20 09:58:28.195584 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:28.195582 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls podName:1175aa8c-e324-496a-a96f-146cd4d65de4 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:29.195573174 +0000 UTC m=+74.953398042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-spn8c" (UID: "1175aa8c-e324-496a-a96f-146cd4d65de4") : secret "insights-runtime-extractor-tls" not found Jul 20 09:58:29.203341 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:29.203310 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:29.203842 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:29.203377 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:29.203842 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:29.203445 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 09:58:29.203842 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:29.203456 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:58:29.203842 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:29.203564 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-rbac-proxy-cm podName:1175aa8c-e324-496a-a96f-146cd4d65de4 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:31.203518817 +0000 UTC m=+76.961343687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-spn8c" (UID: "1175aa8c-e324-496a-a96f-146cd4d65de4") : configmap "kube-rbac-proxy" not found Jul 20 09:58:29.203842 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:29.203603 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls podName:1175aa8c-e324-496a-a96f-146cd4d65de4 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:31.203591004 +0000 UTC m=+76.961415873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-spn8c" (UID: "1175aa8c-e324-496a-a96f-146cd4d65de4") : secret "insights-runtime-extractor-tls" not found Jul 20 09:58:29.560760 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:29.560734 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s6shl_dcff7929-ba73-40b0-96ab-f83447015d94/dns-node-resolver/0.log" Jul 20 09:58:30.161282 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:30.161256 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2mf8j_45c3ada5-0fc6-47ad-b198-45040191642e/node-ca/0.log" Jul 20 09:58:31.161828 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:31.161800 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ckr5n_67690331-05ca-4498-bc34-96466d9078ee/serve-healthcheck-canary/0.log" Jul 20 09:58:31.219916 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:31.219889 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:31.220069 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:31.219954 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:31.220069 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:31.220024 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 09:58:31.220069 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:31.220030 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:58:31.220161 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:31.220073 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-rbac-proxy-cm podName:1175aa8c-e324-496a-a96f-146cd4d65de4 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:35.220060345 +0000 UTC m=+80.977885214 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-spn8c" (UID: "1175aa8c-e324-496a-a96f-146cd4d65de4") : configmap "kube-rbac-proxy" not found Jul 20 09:58:31.220161 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:31.220086 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls podName:1175aa8c-e324-496a-a96f-146cd4d65de4 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:35.220079755 +0000 UTC m=+80.977904624 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-spn8c" (UID: "1175aa8c-e324-496a-a96f-146cd4d65de4") : secret "insights-runtime-extractor-tls" not found Jul 20 09:58:31.320419 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:31.320372 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gnhqb\" (UID: \"842b54d2-d9e9-40fc-b879-9f0a9eb80998\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb" Jul 20 09:58:31.320578 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:31.320516 2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 09:58:31.320613 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:31.320601 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls podName:842b54d2-d9e9-40fc-b879-9f0a9eb80998 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:39.320584718 +0000 UTC m=+85.078409587 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-gnhqb" (UID: "842b54d2-d9e9-40fc-b879-9f0a9eb80998") : secret "cluster-monitoring-operator-tls" not found Jul 20 09:58:31.522366 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:31.522333 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:31.522487 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:31.522426 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:31.522524 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:31.522494 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle podName:0804cfeb-f931-49da-ad64-d62bcd2f8503 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:39.522477519 +0000 UTC m=+85.280302389 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle") pod "router-default-999d75578-sn452" (UID: "0804cfeb-f931-49da-ad64-d62bcd2f8503") : configmap references non-existent config key: service-ca.crt Jul 20 09:58:31.522586 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:31.522522 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 09:58:31.522586 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:31.522581 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs podName:0804cfeb-f931-49da-ad64-d62bcd2f8503 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:39.522569019 +0000 UTC m=+85.280393888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs") pod "router-default-999d75578-sn452" (UID: "0804cfeb-f931-49da-ad64-d62bcd2f8503") : secret "router-metrics-certs-default" not found Jul 20 09:58:33.633220 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.633179 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-pqsvb"] Jul 20 09:58:33.635260 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.635244 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" Jul 20 09:58:33.638288 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.638260 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 20 09:58:33.638814 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.638792 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 20 09:58:33.639794 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.639777 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 20 09:58:33.643300 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.643280 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:58:33.644925 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.644907 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fkf8c\"" Jul 20 09:58:33.645393 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.645371 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 20 09:58:33.647612 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.647590 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-pqsvb"] Jul 20 09:58:33.739135 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.739100 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a0f88a7-90c0-44ad-9922-4cfd2b371e0d-serving-cert\") pod \"console-operator-565b7b569d-pqsvb\" (UID: \"1a0f88a7-90c0-44ad-9922-4cfd2b371e0d\") " pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" Jul 20 09:58:33.739135 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.739139 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a0f88a7-90c0-44ad-9922-4cfd2b371e0d-config\") pod \"console-operator-565b7b569d-pqsvb\" (UID: \"1a0f88a7-90c0-44ad-9922-4cfd2b371e0d\") " pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" Jul 20 09:58:33.739363 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.739192 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1a0f88a7-90c0-44ad-9922-4cfd2b371e0d-trusted-ca\") pod \"console-operator-565b7b569d-pqsvb\" (UID: \"1a0f88a7-90c0-44ad-9922-4cfd2b371e0d\") " pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" Jul 20 09:58:33.739363 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.739293 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwz9k\" (UniqueName: \"kubernetes.io/projected/1a0f88a7-90c0-44ad-9922-4cfd2b371e0d-kube-api-access-vwz9k\") pod \"console-operator-565b7b569d-pqsvb\" (UID: \"1a0f88a7-90c0-44ad-9922-4cfd2b371e0d\") " pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" Jul 20 09:58:33.840237 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.840189 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1a0f88a7-90c0-44ad-9922-4cfd2b371e0d-trusted-ca\") pod \"console-operator-565b7b569d-pqsvb\" (UID: \"1a0f88a7-90c0-44ad-9922-4cfd2b371e0d\") " pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" Jul 20 09:58:33.840355 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.840287 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwz9k\" (UniqueName: \"kubernetes.io/projected/1a0f88a7-90c0-44ad-9922-4cfd2b371e0d-kube-api-access-vwz9k\") pod \"console-operator-565b7b569d-pqsvb\" (UID: \"1a0f88a7-90c0-44ad-9922-4cfd2b371e0d\") " pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" Jul 20 09:58:33.840355 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.840319 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a0f88a7-90c0-44ad-9922-4cfd2b371e0d-serving-cert\") pod \"console-operator-565b7b569d-pqsvb\" (UID: \"1a0f88a7-90c0-44ad-9922-4cfd2b371e0d\") " pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" Jul 20 09:58:33.840355 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.840338 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a0f88a7-90c0-44ad-9922-4cfd2b371e0d-config\") pod \"console-operator-565b7b569d-pqsvb\" (UID: \"1a0f88a7-90c0-44ad-9922-4cfd2b371e0d\") " pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" Jul 20 09:58:33.841029 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.841003 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a0f88a7-90c0-44ad-9922-4cfd2b371e0d-config\") pod \"console-operator-565b7b569d-pqsvb\" (UID: \"1a0f88a7-90c0-44ad-9922-4cfd2b371e0d\") " pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" Jul 20 09:58:33.841444 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.841420 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1a0f88a7-90c0-44ad-9922-4cfd2b371e0d-trusted-ca\") pod \"console-operator-565b7b569d-pqsvb\" (UID: \"1a0f88a7-90c0-44ad-9922-4cfd2b371e0d\") " pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" Jul 20 09:58:33.842714 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.842694 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a0f88a7-90c0-44ad-9922-4cfd2b371e0d-serving-cert\") pod \"console-operator-565b7b569d-pqsvb\" (UID: \"1a0f88a7-90c0-44ad-9922-4cfd2b371e0d\") " pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" Jul 20 09:58:33.849990 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.849964 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwz9k\" (UniqueName: \"kubernetes.io/projected/1a0f88a7-90c0-44ad-9922-4cfd2b371e0d-kube-api-access-vwz9k\") pod \"console-operator-565b7b569d-pqsvb\" (UID: \"1a0f88a7-90c0-44ad-9922-4cfd2b371e0d\") " pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" Jul 20 09:58:33.944321 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:33.944224 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" Jul 20 09:58:34.073066 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:34.073031 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-pqsvb"] Jul 20 09:58:34.076052 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:58:34.076027 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a0f88a7_90c0_44ad_9922_4cfd2b371e0d.slice/crio-049457e61b388c1d6751dcf0643685f78546eae26dcf7f89e211d7172708ff8e WatchSource:0}: Error finding container 049457e61b388c1d6751dcf0643685f78546eae26dcf7f89e211d7172708ff8e: Status 404 returned error can't find the container with id 049457e61b388c1d6751dcf0643685f78546eae26dcf7f89e211d7172708ff8e Jul 20 09:58:34.205792 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:34.205705 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" event={"ID":"1a0f88a7-90c0-44ad-9922-4cfd2b371e0d","Type":"ContainerStarted","Data":"049457e61b388c1d6751dcf0643685f78546eae26dcf7f89e211d7172708ff8e"} Jul 20 09:58:35.254191 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:35.254148 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:35.254639 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:35.254317 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:35.254639 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:35.254326 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:58:35.254639 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:35.254422 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 09:58:35.254639 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:35.254446 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls podName:1175aa8c-e324-496a-a96f-146cd4d65de4 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:43.25442284 +0000 UTC m=+89.012247714 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-spn8c" (UID: "1175aa8c-e324-496a-a96f-146cd4d65de4") : secret "insights-runtime-extractor-tls" not found Jul 20 09:58:35.254639 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:35.254478 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-rbac-proxy-cm podName:1175aa8c-e324-496a-a96f-146cd4d65de4 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:43.25446137 +0000 UTC m=+89.012286256 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-spn8c" (UID: "1175aa8c-e324-496a-a96f-146cd4d65de4") : configmap "kube-rbac-proxy" not found Jul 20 09:58:36.212211 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:36.212176 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/0.log" Jul 20 09:58:36.212377 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:36.212221 2584 generic.go:356] "Generic (PLEG): container finished" podID="1a0f88a7-90c0-44ad-9922-4cfd2b371e0d" containerID="85fb95b01108a4017eef95544cd93122e9b9f850585ad477ce4cdf8d55be7e25" exitCode=255 Jul 20 09:58:36.212377 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:36.212261 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" event={"ID":"1a0f88a7-90c0-44ad-9922-4cfd2b371e0d","Type":"ContainerDied","Data":"85fb95b01108a4017eef95544cd93122e9b9f850585ad477ce4cdf8d55be7e25"} Jul 20 09:58:36.212509 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:36.212494 2584 scope.go:117] "RemoveContainer" containerID="85fb95b01108a4017eef95544cd93122e9b9f850585ad477ce4cdf8d55be7e25" Jul 20 09:58:37.216088 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:37.215967 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 09:58:37.216493 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:37.216390 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/0.log" Jul 20 09:58:37.216493 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:37.216425 2584 generic.go:356] "Generic (PLEG): container finished" podID="1a0f88a7-90c0-44ad-9922-4cfd2b371e0d" containerID="f8813fffc573ac4be59f12690a32e3ac9d4325735a475fd56499cfe62fec857b" exitCode=255 Jul 20 09:58:37.216493 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:37.216480 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" event={"ID":"1a0f88a7-90c0-44ad-9922-4cfd2b371e0d","Type":"ContainerDied","Data":"f8813fffc573ac4be59f12690a32e3ac9d4325735a475fd56499cfe62fec857b"} Jul 20 09:58:37.216626 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:37.216526 2584 scope.go:117] "RemoveContainer" containerID="85fb95b01108a4017eef95544cd93122e9b9f850585ad477ce4cdf8d55be7e25" Jul 20 09:58:37.216741 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:37.216724 2584 scope.go:117] "RemoveContainer" containerID="f8813fffc573ac4be59f12690a32e3ac9d4325735a475fd56499cfe62fec857b" Jul 20 09:58:37.216919 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:37.216892 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-pqsvb_openshift-console-operator(1a0f88a7-90c0-44ad-9922-4cfd2b371e0d)\"" pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" podUID="1a0f88a7-90c0-44ad-9922-4cfd2b371e0d" Jul 20 09:58:37.613229 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:37.613197 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmzv4"] Jul 20 09:58:37.617468 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:37.617451 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmzv4" Jul 20 09:58:37.629703 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:37.629679 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8grnc\"" Jul 20 09:58:37.629957 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:37.629943 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 20 09:58:37.633021 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:37.633005 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 20 09:58:37.640232 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:37.640199 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmzv4"] Jul 20 09:58:37.674849 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:37.674815 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxk7r\" (UniqueName: \"kubernetes.io/projected/90ab6ed5-a750-4bbf-b007-80991b42a435-kube-api-access-sxk7r\") pod \"migrator-7cc9c7ffd7-lmzv4\" (UID: \"90ab6ed5-a750-4bbf-b007-80991b42a435\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmzv4" Jul 20 09:58:37.776128 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:37.776089 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxk7r\" (UniqueName: \"kubernetes.io/projected/90ab6ed5-a750-4bbf-b007-80991b42a435-kube-api-access-sxk7r\") pod \"migrator-7cc9c7ffd7-lmzv4\" (UID: \"90ab6ed5-a750-4bbf-b007-80991b42a435\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmzv4" Jul 20 09:58:37.796650 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:37.796617 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxk7r\" (UniqueName: \"kubernetes.io/projected/90ab6ed5-a750-4bbf-b007-80991b42a435-kube-api-access-sxk7r\") pod \"migrator-7cc9c7ffd7-lmzv4\" (UID: \"90ab6ed5-a750-4bbf-b007-80991b42a435\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmzv4" Jul 20 09:58:37.929213 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:37.929126 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmzv4" Jul 20 09:58:38.055277 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:38.055252 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmzv4"] Jul 20 09:58:38.056883 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:58:38.056857 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ab6ed5_a750_4bbf_b007_80991b42a435.slice/crio-0d4c0066c049f08cbb0f17db8bed5936c27b59c872eefd863ee5e29a6e823d4f WatchSource:0}: Error finding container 0d4c0066c049f08cbb0f17db8bed5936c27b59c872eefd863ee5e29a6e823d4f: Status 404 returned error can't find the container with id 0d4c0066c049f08cbb0f17db8bed5936c27b59c872eefd863ee5e29a6e823d4f Jul 20 09:58:38.220334 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:38.220259 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 09:58:38.220743 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:38.220654 2584 scope.go:117] "RemoveContainer" containerID="f8813fffc573ac4be59f12690a32e3ac9d4325735a475fd56499cfe62fec857b" Jul 20 09:58:38.220846 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:38.220823 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-pqsvb_openshift-console-operator(1a0f88a7-90c0-44ad-9922-4cfd2b371e0d)\"" pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" podUID="1a0f88a7-90c0-44ad-9922-4cfd2b371e0d" Jul 20 09:58:38.221480 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:38.221450 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmzv4" event={"ID":"90ab6ed5-a750-4bbf-b007-80991b42a435","Type":"ContainerStarted","Data":"0d4c0066c049f08cbb0f17db8bed5936c27b59c872eefd863ee5e29a6e823d4f"} Jul 20 09:58:39.226569 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:39.226516 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmzv4" event={"ID":"90ab6ed5-a750-4bbf-b007-80991b42a435","Type":"ContainerStarted","Data":"1b65e48770d7ba1a1666208a9eb25e9ab568f8d5dee0bac707711dc7f74ea9e9"} Jul 20 09:58:39.226927 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:39.226589 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmzv4" event={"ID":"90ab6ed5-a750-4bbf-b007-80991b42a435","Type":"ContainerStarted","Data":"ae201ffb7b30c802aa35d0d0e9f5aa4f1d4bb7400c0be7ea4d1d7fa5bcc7fc15"} Jul 20 09:58:39.264713 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:39.264661 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmzv4" podStartSLOduration=1.2815512980000001 podStartE2EDuration="2.264644028s" totalImagesPullingTime="983.09273ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:39.264048301 +0000 UTC m=+85.021873193" watchObservedRunningTime="2026-07-20 09:58:39.264644028 +0000 UTC m=+85.022468918" Jul 20 09:58:39.391028 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:39.390938 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gnhqb\" (UID: \"842b54d2-d9e9-40fc-b879-9f0a9eb80998\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb" Jul 20 09:58:39.391173 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:39.391086 2584 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 20 09:58:39.391173 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:39.391156 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls podName:842b54d2-d9e9-40fc-b879-9f0a9eb80998 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:55.391140049 +0000 UTC m=+101.148964918 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-gnhqb" (UID: "842b54d2-d9e9-40fc-b879-9f0a9eb80998") : secret "cluster-monitoring-operator-tls" not found Jul 20 09:58:39.593225 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:39.593185 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:39.593225 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:39.593235 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:39.593470 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:39.593352 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 20 09:58:39.593470 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:39.593356 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle podName:0804cfeb-f931-49da-ad64-d62bcd2f8503 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:55.593341761 +0000 UTC m=+101.351166633 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle") pod "router-default-999d75578-sn452" (UID: "0804cfeb-f931-49da-ad64-d62bcd2f8503") : configmap references non-existent config key: service-ca.crt Jul 20 09:58:39.593470 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:39.593428 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs podName:0804cfeb-f931-49da-ad64-d62bcd2f8503 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:55.593411258 +0000 UTC m=+101.351236140 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs") pod "router-default-999d75578-sn452" (UID: "0804cfeb-f931-49da-ad64-d62bcd2f8503") : secret "router-metrics-certs-default" not found Jul 20 09:58:43.322866 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:43.322821 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:43.323344 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:43.322895 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:43.323344 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:43.323010 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:58:43.323344 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:43.323073 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls podName:1175aa8c-e324-496a-a96f-146cd4d65de4 nodeName:}" failed. No retries permitted until 2026-07-20 09:58:59.323058767 +0000 UTC m=+105.080883636 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-spn8c" (UID: "1175aa8c-e324-496a-a96f-146cd4d65de4") : secret "insights-runtime-extractor-tls" not found Jul 20 09:58:43.323344 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:43.323329 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1175aa8c-e324-496a-a96f-146cd4d65de4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:43.945160 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:43.945123 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" Jul 20 09:58:43.945335 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:43.945181 2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" Jul 20 09:58:43.945508 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:43.945498 2584 scope.go:117] "RemoveContainer" containerID="f8813fffc573ac4be59f12690a32e3ac9d4325735a475fd56499cfe62fec857b" Jul 20 09:58:43.945720 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:58:43.945699 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-pqsvb_openshift-console-operator(1a0f88a7-90c0-44ad-9922-4cfd2b371e0d)\"" pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" podUID="1a0f88a7-90c0-44ad-9922-4cfd2b371e0d" Jul 20 09:58:55.014550 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:55.014482 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls\") pod \"dns-default-vw52w\" (UID: \"ff533437-340c-4587-98de-04091941072f\") " pod="openshift-dns/dns-default-vw52w" Jul 20 09:58:55.016734 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:55.016712 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff533437-340c-4587-98de-04091941072f-metrics-tls\") pod \"dns-default-vw52w\" (UID: \"ff533437-340c-4587-98de-04091941072f\") " pod="openshift-dns/dns-default-vw52w" Jul 20 09:58:55.299144 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:55.299063 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7r5mf\"" Jul 20 09:58:55.306581 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:55.306564 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vw52w" Jul 20 09:58:55.418249 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:55.418213 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gnhqb\" (UID: \"842b54d2-d9e9-40fc-b879-9f0a9eb80998\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb" Jul 20 09:58:55.420478 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:55.420446 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/842b54d2-d9e9-40fc-b879-9f0a9eb80998-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-gnhqb\" (UID: \"842b54d2-d9e9-40fc-b879-9f0a9eb80998\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb" Jul 20 09:58:55.448227 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:55.448199 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vw52w"] Jul 20 09:58:55.451222 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:58:55.451193 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff533437_340c_4587_98de_04091941072f.slice/crio-817ab327e4563c77bea6368f5f27ebdcc616f2f7c958e36dd42eadc8fc638123 WatchSource:0}: Error finding container 817ab327e4563c77bea6368f5f27ebdcc616f2f7c958e36dd42eadc8fc638123: Status 404 returned error can't find the container with id 817ab327e4563c77bea6368f5f27ebdcc616f2f7c958e36dd42eadc8fc638123 Jul 20 09:58:55.619703 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:55.619609 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:55.619838 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:55.619807 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:55.620280 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:55.620252 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0804cfeb-f931-49da-ad64-d62bcd2f8503-service-ca-bundle\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:55.622060 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:55.622042 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0804cfeb-f931-49da-ad64-d62bcd2f8503-metrics-certs\") pod \"router-default-999d75578-sn452\" (UID: \"0804cfeb-f931-49da-ad64-d62bcd2f8503\") " pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:55.653101 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:55.653065 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb" Jul 20 09:58:55.774763 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:55.774732 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb"] Jul 20 09:58:55.777271 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:58:55.777244 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod842b54d2_d9e9_40fc_b879_9f0a9eb80998.slice/crio-1fc609a18f0e8cddbf0a0fdb7e5e70b754a1e3180735ac8143972bddb5de5c3f WatchSource:0}: Error finding container 1fc609a18f0e8cddbf0a0fdb7e5e70b754a1e3180735ac8143972bddb5de5c3f: Status 404 returned error can't find the container with id 1fc609a18f0e8cddbf0a0fdb7e5e70b754a1e3180735ac8143972bddb5de5c3f Jul 20 09:58:55.786384 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:55.786367 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:55.925484 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:55.925406 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-999d75578-sn452"] Jul 20 09:58:55.928500 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:58:55.928469 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0804cfeb_f931_49da_ad64_d62bcd2f8503.slice/crio-78d9c744f4c25f36a1de4e4f3be08dfb51e0672d0da475577f6fea4d7b5d527b WatchSource:0}: Error finding container 78d9c744f4c25f36a1de4e4f3be08dfb51e0672d0da475577f6fea4d7b5d527b: Status 404 returned error can't find the container with id 78d9c744f4c25f36a1de4e4f3be08dfb51e0672d0da475577f6fea4d7b5d527b Jul 20 09:58:56.283131 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:56.282630 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-999d75578-sn452" event={"ID":"0804cfeb-f931-49da-ad64-d62bcd2f8503","Type":"ContainerStarted","Data":"2f489227ee5bcd1fee9359d4756dea9072c922260580e29942310a08f2b731b8"} Jul 20 09:58:56.283131 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:56.282688 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-999d75578-sn452" event={"ID":"0804cfeb-f931-49da-ad64-d62bcd2f8503","Type":"ContainerStarted","Data":"78d9c744f4c25f36a1de4e4f3be08dfb51e0672d0da475577f6fea4d7b5d527b"} Jul 20 09:58:56.284554 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:56.284513 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vw52w" event={"ID":"ff533437-340c-4587-98de-04091941072f","Type":"ContainerStarted","Data":"817ab327e4563c77bea6368f5f27ebdcc616f2f7c958e36dd42eadc8fc638123"} Jul 20 09:58:56.285783 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:56.285757 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb" event={"ID":"842b54d2-d9e9-40fc-b879-9f0a9eb80998","Type":"ContainerStarted","Data":"1fc609a18f0e8cddbf0a0fdb7e5e70b754a1e3180735ac8143972bddb5de5c3f"} Jul 20 09:58:56.304594 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:56.304529 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-999d75578-sn452" podStartSLOduration=33.304509614 podStartE2EDuration="33.304509614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:58:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:56.303136704 +0000 UTC m=+102.060961596" watchObservedRunningTime="2026-07-20 09:58:56.304509614 +0000 UTC m=+102.062334505" Jul 20 09:58:56.787193 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:56.787155 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:56.790829 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:56.790635 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:56.805413 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:56.805382 2584 scope.go:117] "RemoveContainer" containerID="f8813fffc573ac4be59f12690a32e3ac9d4325735a475fd56499cfe62fec857b" Jul 20 09:58:57.191262 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:57.191187 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dvtzz" Jul 20 09:58:57.291004 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:57.290972 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:57.292665 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:57.292639 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-999d75578-sn452" Jul 20 09:58:58.296142 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:58.296091 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vw52w" event={"ID":"ff533437-340c-4587-98de-04091941072f","Type":"ContainerStarted","Data":"3d3135a19e13b7975f5135f72ac65c323005934d427dc2f2bf368921bd82c707"} Jul 20 09:58:58.296612 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:58.296157 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vw52w" event={"ID":"ff533437-340c-4587-98de-04091941072f","Type":"ContainerStarted","Data":"5bee947c40c96fc585364b135ce5742de00b40c0f6b432c0b64fbb7c529ee0f1"} Jul 20 09:58:58.296612 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:58.296205 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vw52w" Jul 20 09:58:58.298019 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:58.298000 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 09:58:58.298128 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:58.298078 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" event={"ID":"1a0f88a7-90c0-44ad-9922-4cfd2b371e0d","Type":"ContainerStarted","Data":"22b30f6338fe3b6b757a25db5220a3c9252fa389e8074af16ffb0da9bed5c9ec"} Jul 20 09:58:58.298325 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:58.298299 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" Jul 20 09:58:58.300032 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:58.300006 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb" event={"ID":"842b54d2-d9e9-40fc-b879-9f0a9eb80998","Type":"ContainerStarted","Data":"6b852b9d61c3064261bc89267832a9dd4b72685aa3c0b1e3f3bcfc4b2d5d8391"} Jul 20 09:58:58.315118 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:58.315073 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vw52w" podStartSLOduration=65.278744663 podStartE2EDuration="1m7.315059331s" totalImagesPullingTime="2.036314668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:57:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:58.314842283 +0000 UTC m=+104.072667176" watchObservedRunningTime="2026-07-20 09:58:58.315059331 +0000 UTC m=+104.072884224" Jul 20 09:58:58.332592 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:58.332523 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-gnhqb" podStartSLOduration=33.622682669 podStartE2EDuration="35.332505002s" totalImagesPullingTime="1.709822333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:58.331575435 +0000 UTC m=+104.089400326" watchObservedRunningTime="2026-07-20 09:58:58.332505002 +0000 UTC m=+104.090329894" Jul 20 09:58:58.350370 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:58.350327 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" podStartSLOduration=23.781762646 podStartE2EDuration="25.350313113s" totalImagesPullingTime="1.568550467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:58.349772747 +0000 UTC m=+104.107597639" watchObservedRunningTime="2026-07-20 09:58:58.350313113 +0000 UTC m=+104.108138055" Jul 20 09:58:58.791253 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:58.791216 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-pqsvb" Jul 20 09:58:59.352496 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:59.352458 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:59.354774 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:59.354753 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1175aa8c-e324-496a-a96f-146cd4d65de4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-spn8c\" (UID: \"1175aa8c-e324-496a-a96f-146cd4d65de4\") " pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:59.382305 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:59.382267 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-spn8c" Jul 20 09:58:59.533634 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:58:59.533597 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-spn8c"] Jul 20 09:58:59.536900 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:58:59.536875 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1175aa8c_e324_496a_a96f_146cd4d65de4.slice/crio-8451c4c7df66e9c712b278f07e8b976ba59b6f264787dcf4e23fb80ba115920b WatchSource:0}: Error finding container 8451c4c7df66e9c712b278f07e8b976ba59b6f264787dcf4e23fb80ba115920b: Status 404 returned error can't find the container with id 8451c4c7df66e9c712b278f07e8b976ba59b6f264787dcf4e23fb80ba115920b Jul 20 09:59:00.310289 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:00.310247 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-spn8c" event={"ID":"1175aa8c-e324-496a-a96f-146cd4d65de4","Type":"ContainerStarted","Data":"8451c4c7df66e9c712b278f07e8b976ba59b6f264787dcf4e23fb80ba115920b"} Jul 20 09:59:03.105026 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.104993 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7454d87f88-2jwtz"] Jul 20 09:59:03.120395 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.120365 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.125688 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.125659 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 20 09:59:03.126272 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.126248 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m6fz5\"" Jul 20 09:59:03.126889 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.126709 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 20 09:59:03.126889 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.126775 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 20 09:59:03.126889 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.126834 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7454d87f88-2jwtz"] Jul 20 09:59:03.140571 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.140522 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 20 09:59:03.150770 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.150734 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-7dgrt"] Jul 20 09:59:03.154753 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.154729 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-7dgrt" Jul 20 09:59:03.160084 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.160061 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-mct7j\"" Jul 20 09:59:03.175812 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.175789 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-7dgrt"] Jul 20 09:59:03.285977 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.285898 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tckj\" (UniqueName: \"kubernetes.io/projected/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-kube-api-access-7tckj\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.285977 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.285939 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-registry-certificates\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.285977 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.285975 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfs6k\" (UniqueName: \"kubernetes.io/projected/b51212bd-b9d6-498a-abf2-90e242002526-kube-api-access-tfs6k\") pod \"network-check-source-7bc5b6bf85-7dgrt\" (UID: \"b51212bd-b9d6-498a-abf2-90e242002526\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-7dgrt" Jul 20 09:59:03.286225 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.286025 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-ca-trust-extracted\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.286225 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.286101 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-registry-tls\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.286225 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.286120 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-bound-sa-token\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.286225 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.286162 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-installation-pull-secrets\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.286415 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.286221 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-trusted-ca\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.286415 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.286275 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-image-registry-private-configuration\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.386919 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.386887 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tckj\" (UniqueName: \"kubernetes.io/projected/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-kube-api-access-7tckj\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.386919 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.386922 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-registry-certificates\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.387161 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.386952 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfs6k\" (UniqueName: \"kubernetes.io/projected/b51212bd-b9d6-498a-abf2-90e242002526-kube-api-access-tfs6k\") pod \"network-check-source-7bc5b6bf85-7dgrt\" (UID: \"b51212bd-b9d6-498a-abf2-90e242002526\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-7dgrt" Jul 20 09:59:03.387161 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.386985 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-ca-trust-extracted\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.387161 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.387009 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-registry-tls\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.387316 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.387288 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-bound-sa-token\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.387399 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.387370 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-installation-pull-secrets\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.387399 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.387385 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-ca-trust-extracted\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.387503 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.387412 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-trusted-ca\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.387503 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.387453 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-image-registry-private-configuration\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.387896 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.387840 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-registry-certificates\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.388406 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.388372 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-trusted-ca\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.390038 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.390012 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-image-registry-private-configuration\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.390133 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.390118 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-installation-pull-secrets\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.390289 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.390259 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-registry-tls\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.398952 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.398925 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfs6k\" (UniqueName: \"kubernetes.io/projected/b51212bd-b9d6-498a-abf2-90e242002526-kube-api-access-tfs6k\") pod \"network-check-source-7bc5b6bf85-7dgrt\" (UID: \"b51212bd-b9d6-498a-abf2-90e242002526\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-7dgrt" Jul 20 09:59:03.399123 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.399104 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tckj\" (UniqueName: \"kubernetes.io/projected/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-kube-api-access-7tckj\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.399320 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.399258 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfa25a95-6dfd-43a6-83e4-02984ae58a0c-bound-sa-token\") pod \"image-registry-7454d87f88-2jwtz\" (UID: \"bfa25a95-6dfd-43a6-83e4-02984ae58a0c\") " pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.432285 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.432254 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:03.465861 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:03.465810 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-7dgrt" Jul 20 09:59:04.433237 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:04.433215 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-7dgrt"] Jul 20 09:59:04.436316 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:59:04.436281 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb51212bd_b9d6_498a_abf2_90e242002526.slice/crio-fbbeea17a04c1b7b495852ae9c07d2634ca1ccb56b59bdb273cdcfc6dcc2e38b WatchSource:0}: Error finding container fbbeea17a04c1b7b495852ae9c07d2634ca1ccb56b59bdb273cdcfc6dcc2e38b: Status 404 returned error can't find the container with id fbbeea17a04c1b7b495852ae9c07d2634ca1ccb56b59bdb273cdcfc6dcc2e38b Jul 20 09:59:04.461357 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:04.461334 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7454d87f88-2jwtz"] Jul 20 09:59:04.465348 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:59:04.465317 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfa25a95_6dfd_43a6_83e4_02984ae58a0c.slice/crio-98a88d55901e6056c82e5e6a9184a0bd13f1d8617a6b98c8970ab3f73a6685b1 WatchSource:0}: Error finding container 98a88d55901e6056c82e5e6a9184a0bd13f1d8617a6b98c8970ab3f73a6685b1: Status 404 returned error can't find the container with id 98a88d55901e6056c82e5e6a9184a0bd13f1d8617a6b98c8970ab3f73a6685b1 Jul 20 09:59:05.333567 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:05.333108 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-7dgrt" event={"ID":"b51212bd-b9d6-498a-abf2-90e242002526","Type":"ContainerStarted","Data":"4b4e7fad2a0cc0d9ee2112ccb548709a1a4be9bff56821dba4c38170655d352f"} Jul 20 09:59:05.333567 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:05.333170 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-7dgrt" event={"ID":"b51212bd-b9d6-498a-abf2-90e242002526","Type":"ContainerStarted","Data":"fbbeea17a04c1b7b495852ae9c07d2634ca1ccb56b59bdb273cdcfc6dcc2e38b"} Jul 20 09:59:05.335856 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:05.335324 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" event={"ID":"bfa25a95-6dfd-43a6-83e4-02984ae58a0c","Type":"ContainerStarted","Data":"15d9fd120d3829ea8b16fd70f438edab459043134e40bc2d53e3576cec711a5f"} Jul 20 09:59:05.335856 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:05.335377 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" event={"ID":"bfa25a95-6dfd-43a6-83e4-02984ae58a0c","Type":"ContainerStarted","Data":"98a88d55901e6056c82e5e6a9184a0bd13f1d8617a6b98c8970ab3f73a6685b1"} Jul 20 09:59:05.335856 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:05.335681 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:05.337303 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:05.337271 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-spn8c" event={"ID":"1175aa8c-e324-496a-a96f-146cd4d65de4","Type":"ContainerStarted","Data":"5118dcda562f96acd685283faec6cd07b58fe8dc870913b79d0a1f13e0b80865"} Jul 20 09:59:05.367180 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:05.366828 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-7dgrt" podStartSLOduration=2.366808089 podStartE2EDuration="2.366808089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:05.365134026 +0000 UTC m=+111.122958919" watchObservedRunningTime="2026-07-20 09:59:05.366808089 +0000 UTC m=+111.124632981" Jul 20 09:59:05.400666 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:05.400604 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" podStartSLOduration=2.400583694 podStartE2EDuration="2.400583694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:05.399886893 +0000 UTC m=+111.157711785" watchObservedRunningTime="2026-07-20 09:59:05.400583694 +0000 UTC m=+111.158408586" Jul 20 09:59:08.305587 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:08.305559 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vw52w" Jul 20 09:59:08.350749 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:08.350703 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-spn8c" event={"ID":"1175aa8c-e324-496a-a96f-146cd4d65de4","Type":"ContainerStarted","Data":"d59ce8716da7d24bac66cef2286aac459c45abe7e2deea02e021d3437829f288"} Jul 20 09:59:12.365433 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:12.365396 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-spn8c" event={"ID":"1175aa8c-e324-496a-a96f-146cd4d65de4","Type":"ContainerStarted","Data":"3514d07ef46c0ccd8d87ec8bcfbff11372169949c704816b06febb186e774c34"} Jul 20 09:59:12.407396 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:12.407341 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-spn8c" podStartSLOduration=33.754227123 podStartE2EDuration="45.407324647s" totalImagesPullingTime="11.653097524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:58:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:12.406954613 +0000 UTC m=+118.164779505" watchObservedRunningTime="2026-07-20 09:59:12.407324647 +0000 UTC m=+118.165149538" Jul 20 09:59:21.309424 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.309367 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f4d647959-lfztk"] Jul 20 09:59:21.313660 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.313639 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.318287 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.318264 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 20 09:59:21.318287 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.318276 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 20 09:59:21.318456 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.318357 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 20 09:59:21.318649 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.318635 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 20 09:59:21.318718 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.318665 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 20 09:59:21.318913 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.318893 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pm75m\"" Jul 20 09:59:21.319002 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.318896 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 20 09:59:21.320261 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.320240 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 20 09:59:21.324789 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.324770 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 20 09:59:21.332306 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.332283 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f4d647959-lfztk"] Jul 20 09:59:21.430368 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.430332 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-oauth-serving-cert\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.430560 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.430378 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knj4r\" (UniqueName: \"kubernetes.io/projected/c7a4da23-38cf-4401-aacb-dc8537aaae5a-kube-api-access-knj4r\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.430560 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.430431 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-trusted-ca-bundle\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.430560 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.430452 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7a4da23-38cf-4401-aacb-dc8537aaae5a-console-oauth-config\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.430560 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.430469 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-console-config\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.430718 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.430575 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-service-ca\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.430718 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.430626 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7a4da23-38cf-4401-aacb-dc8537aaae5a-console-serving-cert\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.531483 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.531446 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-service-ca\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.531664 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.531510 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7a4da23-38cf-4401-aacb-dc8537aaae5a-console-serving-cert\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.531664 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.531554 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-oauth-serving-cert\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.531664 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.531581 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knj4r\" (UniqueName: \"kubernetes.io/projected/c7a4da23-38cf-4401-aacb-dc8537aaae5a-kube-api-access-knj4r\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.531664 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.531619 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-trusted-ca-bundle\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.531664 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.531637 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7a4da23-38cf-4401-aacb-dc8537aaae5a-console-oauth-config\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.531664 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.531655 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-console-config\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.532261 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.532233 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-oauth-serving-cert\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.532398 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.532239 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-service-ca\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.532463 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.532392 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-console-config\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.532525 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.532460 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-trusted-ca-bundle\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.534021 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.534000 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7a4da23-38cf-4401-aacb-dc8537aaae5a-console-serving-cert\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.534187 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.534169 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7a4da23-38cf-4401-aacb-dc8537aaae5a-console-oauth-config\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.545968 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.545943 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knj4r\" (UniqueName: \"kubernetes.io/projected/c7a4da23-38cf-4401-aacb-dc8537aaae5a-kube-api-access-knj4r\") pod \"console-f4d647959-lfztk\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.622618 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.622517 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:21.767236 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:21.767081 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f4d647959-lfztk"] Jul 20 09:59:21.769564 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:59:21.769522 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a4da23_38cf_4401_aacb_dc8537aaae5a.slice/crio-d7d147bd64509bfa1aa4c956a2ee18888229bc0cb0a1485ed5c4b0f06c647621 WatchSource:0}: Error finding container d7d147bd64509bfa1aa4c956a2ee18888229bc0cb0a1485ed5c4b0f06c647621: Status 404 returned error can't find the container with id d7d147bd64509bfa1aa4c956a2ee18888229bc0cb0a1485ed5c4b0f06c647621 Jul 20 09:59:22.397382 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:22.397341 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4d647959-lfztk" event={"ID":"c7a4da23-38cf-4401-aacb-dc8537aaae5a","Type":"ContainerStarted","Data":"d7d147bd64509bfa1aa4c956a2ee18888229bc0cb0a1485ed5c4b0f06c647621"} Jul 20 09:59:24.556589 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:24.556530 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs\") pod \"network-metrics-daemon-gx8gs\" (UID: \"cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f\") " pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:59:24.558782 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:24.558750 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f-metrics-certs\") pod \"network-metrics-daemon-gx8gs\" (UID: \"cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f\") " pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:59:24.828490 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:24.828454 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q8hvk\"" Jul 20 09:59:24.836146 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:24.836124 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gx8gs" Jul 20 09:59:24.959600 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:24.959569 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gx8gs"] Jul 20 09:59:24.961843 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:59:24.961812 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb02b524_e30b_4fbc_af9f_3b6b61c4cc5f.slice/crio-c21db0c9dbd837b19edee678583eabb4ab6e77360a8d8a2a7296ea8fee9cc838 WatchSource:0}: Error finding container c21db0c9dbd837b19edee678583eabb4ab6e77360a8d8a2a7296ea8fee9cc838: Status 404 returned error can't find the container with id c21db0c9dbd837b19edee678583eabb4ab6e77360a8d8a2a7296ea8fee9cc838 Jul 20 09:59:25.409719 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.409681 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4d647959-lfztk" event={"ID":"c7a4da23-38cf-4401-aacb-dc8537aaae5a","Type":"ContainerStarted","Data":"20958eb326a8c8fdf5c749076553aff6201e19f716ee124c16565363d51cd065"} Jul 20 09:59:25.411028 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.410996 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gx8gs" event={"ID":"cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f","Type":"ContainerStarted","Data":"c21db0c9dbd837b19edee678583eabb4ab6e77360a8d8a2a7296ea8fee9cc838"} Jul 20 09:59:25.443066 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.443009 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f4d647959-lfztk" podStartSLOduration=1.827444214 podStartE2EDuration="4.442993262s" totalImagesPullingTime="2.615549048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:25.442688304 +0000 UTC m=+131.200513198" watchObservedRunningTime="2026-07-20 09:59:25.442993262 +0000 UTC m=+131.200818155" Jul 20 09:59:25.677913 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.677828 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hprfm"] Jul 20 09:59:25.681474 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.681450 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.685009 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.684987 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 20 09:59:25.686067 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.686042 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 20 09:59:25.686237 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.686159 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 20 09:59:25.686710 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.686678 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 20 09:59:25.687252 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.687233 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g7gtr\"" Jul 20 09:59:25.763876 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.763844 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03c014fd-c304-4b95-b283-e147474e515b-metrics-client-ca\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.764053 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.763879 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03c014fd-c304-4b95-b283-e147474e515b-node-exporter-accelerators-collector-config\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.764053 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.763901 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03c014fd-c304-4b95-b283-e147474e515b-node-exporter-textfile\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.764053 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.763949 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03c014fd-c304-4b95-b283-e147474e515b-node-exporter-tls\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.764053 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.763982 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03c014fd-c304-4b95-b283-e147474e515b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.764053 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.764001 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqvq9\" (UniqueName: \"kubernetes.io/projected/03c014fd-c304-4b95-b283-e147474e515b-kube-api-access-lqvq9\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.764053 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.764036 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03c014fd-c304-4b95-b283-e147474e515b-node-exporter-wtmp\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.764292 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.764060 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03c014fd-c304-4b95-b283-e147474e515b-sys\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.764292 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.764085 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03c014fd-c304-4b95-b283-e147474e515b-root\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.864669 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.864637 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03c014fd-c304-4b95-b283-e147474e515b-metrics-client-ca\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.864791 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.864684 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03c014fd-c304-4b95-b283-e147474e515b-node-exporter-accelerators-collector-config\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.864791 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.864722 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03c014fd-c304-4b95-b283-e147474e515b-node-exporter-textfile\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.864791 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.864750 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03c014fd-c304-4b95-b283-e147474e515b-node-exporter-tls\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.864791 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.864774 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03c014fd-c304-4b95-b283-e147474e515b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.864956 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.864798 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqvq9\" (UniqueName: \"kubernetes.io/projected/03c014fd-c304-4b95-b283-e147474e515b-kube-api-access-lqvq9\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.864956 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:59:25.864889 2584 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 20 09:59:25.865042 ip-10-0-142-23 kubenswrapper[2584]: E0720 09:59:25.864963 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03c014fd-c304-4b95-b283-e147474e515b-node-exporter-tls podName:03c014fd-c304-4b95-b283-e147474e515b nodeName:}" failed. No retries permitted until 2026-07-20 09:59:26.364941699 +0000 UTC m=+132.122766587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/03c014fd-c304-4b95-b283-e147474e515b-node-exporter-tls") pod "node-exporter-hprfm" (UID: "03c014fd-c304-4b95-b283-e147474e515b") : secret "node-exporter-tls" not found Jul 20 09:59:25.865042 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.864985 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03c014fd-c304-4b95-b283-e147474e515b-node-exporter-wtmp\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.865042 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.865027 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03c014fd-c304-4b95-b283-e147474e515b-sys\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.865285 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.865075 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03c014fd-c304-4b95-b283-e147474e515b-root\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.865285 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.865188 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03c014fd-c304-4b95-b283-e147474e515b-root\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.865285 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.865215 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03c014fd-c304-4b95-b283-e147474e515b-node-exporter-wtmp\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.865285 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.865247 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03c014fd-c304-4b95-b283-e147474e515b-sys\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.865490 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.865309 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03c014fd-c304-4b95-b283-e147474e515b-node-exporter-accelerators-collector-config\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.865490 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.865338 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03c014fd-c304-4b95-b283-e147474e515b-metrics-client-ca\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.865619 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.865505 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03c014fd-c304-4b95-b283-e147474e515b-node-exporter-textfile\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.867043 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.867023 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03c014fd-c304-4b95-b283-e147474e515b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:25.878379 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:25.878354 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqvq9\" (UniqueName: \"kubernetes.io/projected/03c014fd-c304-4b95-b283-e147474e515b-kube-api-access-lqvq9\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:26.345908 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.345871 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7454d87f88-2jwtz" Jul 20 09:59:26.368257 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.368223 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03c014fd-c304-4b95-b283-e147474e515b-node-exporter-tls\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:26.370553 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.370513 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03c014fd-c304-4b95-b283-e147474e515b-node-exporter-tls\") pod \"node-exporter-hprfm\" (UID: \"03c014fd-c304-4b95-b283-e147474e515b\") " pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:26.416328 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.416288 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gx8gs" event={"ID":"cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f","Type":"ContainerStarted","Data":"dbc455ce43efaadf9a0490f414f1a4cd301b6ee5ca015500f1c4d6026817a8f3"} Jul 20 09:59:26.416593 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.416365 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gx8gs" event={"ID":"cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f","Type":"ContainerStarted","Data":"c1763ffc9da4601ea5fa9b9f0b08dc604ce715c785cbb170a139ce683a8c161f"} Jul 20 09:59:26.442307 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.442258 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gx8gs" podStartSLOduration=130.609680613 podStartE2EDuration="2m11.442241081s" totalImagesPullingTime="832.560468ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:26.441100636 +0000 UTC m=+132.198925530" watchObservedRunningTime="2026-07-20 09:59:26.442241081 +0000 UTC m=+132.200065971" Jul 20 09:59:26.592141 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.592107 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hprfm" Jul 20 09:59:26.603709 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:59:26.603676 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c014fd_c304_4b95_b283_e147474e515b.slice/crio-f13066376fce32874195259a2b56008bd00b076cf29e60878c553f0d5f39ae56 WatchSource:0}: Error finding container f13066376fce32874195259a2b56008bd00b076cf29e60878c553f0d5f39ae56: Status 404 returned error can't find the container with id f13066376fce32874195259a2b56008bd00b076cf29e60878c553f0d5f39ae56 Jul 20 09:59:26.801428 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.801388 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 09:59:26.806300 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.806276 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.811491 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.811353 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 20 09:59:26.811648 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.811566 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 20 09:59:26.812324 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.812297 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 20 09:59:26.812479 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.812462 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 20 09:59:26.813065 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.813046 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 20 09:59:26.813610 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.813593 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 20 09:59:26.814421 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.814396 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 20 09:59:26.821492 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.821471 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 20 09:59:26.821752 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.821731 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 20 09:59:26.821870 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.821772 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nch2d\"" Jul 20 09:59:26.832616 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.832592 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 09:59:26.872672 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.872578 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.872672 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.872614 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcvtb\" (UniqueName: \"kubernetes.io/projected/adc44dab-5edd-4449-808a-867c5c5943d0-kube-api-access-vcvtb\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.872672 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.872636 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-config-volume\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.872672 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.872659 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/adc44dab-5edd-4449-808a-867c5c5943d0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.872948 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.872688 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.872948 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.872723 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/adc44dab-5edd-4449-808a-867c5c5943d0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.872948 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.872747 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.872948 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.872842 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/adc44dab-5edd-4449-808a-867c5c5943d0-config-out\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.872948 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.872902 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-web-config\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.873174 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.872970 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adc44dab-5edd-4449-808a-867c5c5943d0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.873174 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.873041 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc44dab-5edd-4449-808a-867c5c5943d0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.873174 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.873069 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.873174 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.873117 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.973944 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.973903 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc44dab-5edd-4449-808a-867c5c5943d0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.973944 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.973944 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.974178 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.973968 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.974178 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.974014 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.974178 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.974040 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcvtb\" (UniqueName: \"kubernetes.io/projected/adc44dab-5edd-4449-808a-867c5c5943d0-kube-api-access-vcvtb\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.974178 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.974062 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-config-volume\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.974178 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.974090 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/adc44dab-5edd-4449-808a-867c5c5943d0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.974178 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.974129 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.974178 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.974155 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/adc44dab-5edd-4449-808a-867c5c5943d0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.974178 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.974178 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.974581 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.974223 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/adc44dab-5edd-4449-808a-867c5c5943d0-config-out\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.974581 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.974250 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-web-config\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.974581 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.974285 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adc44dab-5edd-4449-808a-867c5c5943d0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.974983 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.974955 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc44dab-5edd-4449-808a-867c5c5943d0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.975161 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.975025 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/adc44dab-5edd-4449-808a-867c5c5943d0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.975273 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.975081 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adc44dab-5edd-4449-808a-867c5c5943d0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.977280 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.977231 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.977385 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.977294 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.977833 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.977809 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/adc44dab-5edd-4449-808a-867c5c5943d0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.977950 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.977914 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.978491 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.978469 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.978491 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.978480 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-config-volume\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.978645 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.978578 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-web-config\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.978836 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.978817 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/adc44dab-5edd-4449-808a-867c5c5943d0-config-out\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.979766 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.979746 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:26.990066 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:26.990039 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcvtb\" (UniqueName: \"kubernetes.io/projected/adc44dab-5edd-4449-808a-867c5c5943d0-kube-api-access-vcvtb\") pod \"alertmanager-main-0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:27.127532 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.127457 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 09:59:27.289770 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.289743 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 09:59:27.291674 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:59:27.291641 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc44dab_5edd_4449_808a_867c5c5943d0.slice/crio-ce928b2f691e13f0989fd24e899e5165729dffcd13227cfa3cac436007405810 WatchSource:0}: Error finding container ce928b2f691e13f0989fd24e899e5165729dffcd13227cfa3cac436007405810: Status 404 returned error can't find the container with id ce928b2f691e13f0989fd24e899e5165729dffcd13227cfa3cac436007405810 Jul 20 09:59:27.423378 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.423252 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc44dab-5edd-4449-808a-867c5c5943d0","Type":"ContainerStarted","Data":"ce928b2f691e13f0989fd24e899e5165729dffcd13227cfa3cac436007405810"} Jul 20 09:59:27.424587 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.424553 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hprfm" event={"ID":"03c014fd-c304-4b95-b283-e147474e515b","Type":"ContainerStarted","Data":"f13066376fce32874195259a2b56008bd00b076cf29e60878c553f0d5f39ae56"} Jul 20 09:59:27.716136 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.716098 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7f4bcdd898-c9278"] Jul 20 09:59:27.720924 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.720898 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.723837 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.723813 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 20 09:59:27.724047 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.724031 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 20 09:59:27.724290 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.724256 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 20 09:59:27.724387 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.724368 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 20 09:59:27.724457 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.724262 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 20 09:59:27.725260 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.725239 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-49ce6gdou1rce\"" Jul 20 09:59:27.725368 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.725243 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7tpz4\"" Jul 20 09:59:27.732983 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.732958 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f4bcdd898-c9278"] Jul 20 09:59:27.780683 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.780643 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.780841 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.780693 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-metrics-client-ca\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.780841 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.780726 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.780841 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.780813 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm2wd\" (UniqueName: \"kubernetes.io/projected/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-kube-api-access-qm2wd\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.780970 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.780870 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.780970 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.780908 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.780970 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.780944 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-secret-thanos-querier-tls\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.781103 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.780991 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-secret-grpc-tls\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.881424 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.881380 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.881876 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.881440 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-metrics-client-ca\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.881876 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.881481 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.881876 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.881525 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm2wd\" (UniqueName: \"kubernetes.io/projected/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-kube-api-access-qm2wd\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.881876 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.881578 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.881876 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.881621 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.881876 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.881654 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-secret-thanos-querier-tls\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.881876 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.881697 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-secret-grpc-tls\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.882950 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.882301 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-metrics-client-ca\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.884447 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.884415 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.884578 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.884467 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.884661 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.884639 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-secret-grpc-tls\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.885326 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.885303 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.885697 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.885664 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.885925 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.885907 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-secret-thanos-querier-tls\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:27.892602 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:27.892580 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm2wd\" (UniqueName: \"kubernetes.io/projected/2b8035d1-32a8-4a34-b8e7-b8d8e0021016-kube-api-access-qm2wd\") pod \"thanos-querier-7f4bcdd898-c9278\" (UID: \"2b8035d1-32a8-4a34-b8e7-b8d8e0021016\") " pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:28.033825 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:28.033791 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:28.378100 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:28.377932 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f4bcdd898-c9278"] Jul 20 09:59:28.379942 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:59:28.379912 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b8035d1_32a8_4a34_b8e7_b8d8e0021016.slice/crio-ee6fe14f97f5e17e858682f3435a629c1213ec7c22eaf8ab9702201af059614f WatchSource:0}: Error finding container ee6fe14f97f5e17e858682f3435a629c1213ec7c22eaf8ab9702201af059614f: Status 404 returned error can't find the container with id ee6fe14f97f5e17e858682f3435a629c1213ec7c22eaf8ab9702201af059614f Jul 20 09:59:28.429098 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:28.429069 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" event={"ID":"2b8035d1-32a8-4a34-b8e7-b8d8e0021016","Type":"ContainerStarted","Data":"ee6fe14f97f5e17e858682f3435a629c1213ec7c22eaf8ab9702201af059614f"} Jul 20 09:59:28.430457 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:28.430431 2584 generic.go:356] "Generic (PLEG): container finished" podID="adc44dab-5edd-4449-808a-867c5c5943d0" containerID="43af05bb403ca35486b45fa71aa395a98ff657beca0c96525ab40b8c6370b163" exitCode=0 Jul 20 09:59:28.430582 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:28.430499 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc44dab-5edd-4449-808a-867c5c5943d0","Type":"ContainerDied","Data":"43af05bb403ca35486b45fa71aa395a98ff657beca0c96525ab40b8c6370b163"} Jul 20 09:59:28.432034 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:28.432005 2584 generic.go:356] "Generic (PLEG): container finished" podID="03c014fd-c304-4b95-b283-e147474e515b" containerID="93eae46a96436c8dc1bd0a9f4f0c0457592ef2691857c7e0bfccde6aa41ba5fe" exitCode=0 Jul 20 09:59:28.432117 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:28.432057 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hprfm" event={"ID":"03c014fd-c304-4b95-b283-e147474e515b","Type":"ContainerDied","Data":"93eae46a96436c8dc1bd0a9f4f0c0457592ef2691857c7e0bfccde6aa41ba5fe"} Jul 20 09:59:29.439099 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:29.439065 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hprfm" event={"ID":"03c014fd-c304-4b95-b283-e147474e515b","Type":"ContainerStarted","Data":"5f8421be5ecfa9be13666fddac5289ce5809e27f3fcf2818c81eb6fe8973f3b1"} Jul 20 09:59:29.439099 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:29.439132 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hprfm" event={"ID":"03c014fd-c304-4b95-b283-e147474e515b","Type":"ContainerStarted","Data":"dee3eba8646de8b0384c08604d1823a57e196d99c87e66e5e250f02d59d63580"} Jul 20 09:59:29.466962 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:29.466910 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hprfm" podStartSLOduration=3.329878029 podStartE2EDuration="4.466890308s" totalImagesPullingTime="1.052745208s" totalInitContainerRuntime="84.267071ms" isStatefulPod=true podCreationTimestamp="2026-07-20 09:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:29.464643399 +0000 UTC m=+135.222468291" watchObservedRunningTime="2026-07-20 09:59:29.466890308 +0000 UTC m=+135.224715199" Jul 20 09:59:30.240816 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.240287 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5db8456c6b-npwkv"] Jul 20 09:59:30.244008 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.243982 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.248561 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.248516 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 20 09:59:30.248561 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.248519 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 20 09:59:30.248779 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.248523 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5n4nv\"" Jul 20 09:59:30.248779 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.248590 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6b2eb6h086s49\"" Jul 20 09:59:30.248779 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.248523 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 20 09:59:30.248944 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.248926 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 20 09:59:30.258406 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.258378 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5db8456c6b-npwkv"] Jul 20 09:59:30.305878 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.305696 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/158aa05c-7e01-4812-a7ca-268d0863f0af-client-ca-bundle\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.305878 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.305727 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stwqw\" (UniqueName: \"kubernetes.io/projected/158aa05c-7e01-4812-a7ca-268d0863f0af-kube-api-access-stwqw\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.305878 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.305837 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/158aa05c-7e01-4812-a7ca-268d0863f0af-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.305878 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.305873 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/158aa05c-7e01-4812-a7ca-268d0863f0af-secret-metrics-server-tls\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.306101 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.305903 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/158aa05c-7e01-4812-a7ca-268d0863f0af-audit-log\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.306101 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.305924 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/158aa05c-7e01-4812-a7ca-268d0863f0af-secret-metrics-server-client-certs\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.306101 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.305944 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/158aa05c-7e01-4812-a7ca-268d0863f0af-metrics-server-audit-profiles\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.406992 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.406961 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stwqw\" (UniqueName: \"kubernetes.io/projected/158aa05c-7e01-4812-a7ca-268d0863f0af-kube-api-access-stwqw\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.407118 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.407076 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/158aa05c-7e01-4812-a7ca-268d0863f0af-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.407118 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.407110 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/158aa05c-7e01-4812-a7ca-268d0863f0af-secret-metrics-server-tls\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.407244 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.407136 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/158aa05c-7e01-4812-a7ca-268d0863f0af-audit-log\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.407244 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.407169 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/158aa05c-7e01-4812-a7ca-268d0863f0af-secret-metrics-server-client-certs\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.407244 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.407203 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/158aa05c-7e01-4812-a7ca-268d0863f0af-metrics-server-audit-profiles\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.407394 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.407252 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/158aa05c-7e01-4812-a7ca-268d0863f0af-client-ca-bundle\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.408773 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.407887 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/158aa05c-7e01-4812-a7ca-268d0863f0af-audit-log\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.408773 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.408302 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/158aa05c-7e01-4812-a7ca-268d0863f0af-metrics-server-audit-profiles\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.408773 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.408563 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/158aa05c-7e01-4812-a7ca-268d0863f0af-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.411914 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.411819 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/158aa05c-7e01-4812-a7ca-268d0863f0af-secret-metrics-server-tls\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.411914 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.411856 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/158aa05c-7e01-4812-a7ca-268d0863f0af-client-ca-bundle\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.412179 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.412159 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/158aa05c-7e01-4812-a7ca-268d0863f0af-secret-metrics-server-client-certs\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.417469 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.417427 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stwqw\" (UniqueName: \"kubernetes.io/projected/158aa05c-7e01-4812-a7ca-268d0863f0af-kube-api-access-stwqw\") pod \"metrics-server-5db8456c6b-npwkv\" (UID: \"158aa05c-7e01-4812-a7ca-268d0863f0af\") " pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.446147 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.446113 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc44dab-5edd-4449-808a-867c5c5943d0","Type":"ContainerStarted","Data":"556be789547e362cb6489c1ff2d917c271fc06150056d110881cb21c7d1b8588"} Jul 20 09:59:30.448162 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.448139 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" event={"ID":"2b8035d1-32a8-4a34-b8e7-b8d8e0021016","Type":"ContainerStarted","Data":"100eecd220c811e8a3519a63c635e7b774f0b50248da282ccf428baf13342134"} Jul 20 09:59:30.448252 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.448194 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" event={"ID":"2b8035d1-32a8-4a34-b8e7-b8d8e0021016","Type":"ContainerStarted","Data":"e3daad3243efa7d77920d0a99bdf0b61b7e8443a364a798c6256f0132d450aee"} Jul 20 09:59:30.554463 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.554412 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:30.697795 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:30.697771 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5db8456c6b-npwkv"] Jul 20 09:59:30.699381 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:59:30.699353 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod158aa05c_7e01_4812_a7ca_268d0863f0af.slice/crio-eab29916b3840a0b836ded9b4faf3607022e2104f33d3270dfdd618fe19b17de WatchSource:0}: Error finding container eab29916b3840a0b836ded9b4faf3607022e2104f33d3270dfdd618fe19b17de: Status 404 returned error can't find the container with id eab29916b3840a0b836ded9b4faf3607022e2104f33d3270dfdd618fe19b17de Jul 20 09:59:31.458601 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.458501 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc44dab-5edd-4449-808a-867c5c5943d0","Type":"ContainerStarted","Data":"65a333a2757423d3bfc5cef852aa4ae27d6f14be8b06931c07808a067ab727be"} Jul 20 09:59:31.459025 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.458613 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc44dab-5edd-4449-808a-867c5c5943d0","Type":"ContainerStarted","Data":"d2b7fcb8b0c7df36f3411babc759d5fa6353ef45f00b11ff2d8fcd72d3425583"} Jul 20 09:59:31.459025 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.458664 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc44dab-5edd-4449-808a-867c5c5943d0","Type":"ContainerStarted","Data":"095d017c474ac597844067414e36c683187a4a3125e2b62a7be5a6f58d29828b"} Jul 20 09:59:31.459025 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.458705 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc44dab-5edd-4449-808a-867c5c5943d0","Type":"ContainerStarted","Data":"519cce9d423be062c64bc62c1aa217dc474bab0a3a5f10d35ccbf5fc7c465ad2"} Jul 20 09:59:31.459025 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.458750 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc44dab-5edd-4449-808a-867c5c5943d0","Type":"ContainerStarted","Data":"407bb6bf89df55cff73ecf26715a588bf76c7305c356834d115a332050c67a3a"} Jul 20 09:59:31.462004 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.461976 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" event={"ID":"2b8035d1-32a8-4a34-b8e7-b8d8e0021016","Type":"ContainerStarted","Data":"39c0ab9759466431f1d4142d435a7288a81c6f7a7371363a82b3c087d04a72f0"} Jul 20 09:59:31.462130 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.462044 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" event={"ID":"2b8035d1-32a8-4a34-b8e7-b8d8e0021016","Type":"ContainerStarted","Data":"12a19f5a7b6366285f17b9f56d775de01e40f484439303407bc2e6329284878c"} Jul 20 09:59:31.462130 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.462085 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" event={"ID":"2b8035d1-32a8-4a34-b8e7-b8d8e0021016","Type":"ContainerStarted","Data":"05899ea679035d459bb115592f73326f7854c15008125e9955e0b68719c7d4bb"} Jul 20 09:59:31.462130 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.462118 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" event={"ID":"2b8035d1-32a8-4a34-b8e7-b8d8e0021016","Type":"ContainerStarted","Data":"8a1f839805e20a6e2afa932a3a8e6f2b61e5d008cd0e7339dd06258c2c35df2d"} Jul 20 09:59:31.462258 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.462151 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:31.463272 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.463249 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" event={"ID":"158aa05c-7e01-4812-a7ca-268d0863f0af","Type":"ContainerStarted","Data":"eab29916b3840a0b836ded9b4faf3607022e2104f33d3270dfdd618fe19b17de"} Jul 20 09:59:31.492790 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.492732 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.05664823 podStartE2EDuration="5.492712072s" totalImagesPullingTime="3.418583703s" totalInitContainerRuntime="17.480139ms" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:31.490516523 +0000 UTC m=+137.248341413" watchObservedRunningTime="2026-07-20 09:59:31.492712072 +0000 UTC m=+137.250536967" Jul 20 09:59:31.518192 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.518135 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" podStartSLOduration=1.942850231 podStartE2EDuration="4.518118049s" totalImagesPullingTime="2.575267818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:31.515741335 +0000 UTC m=+137.273566239" watchObservedRunningTime="2026-07-20 09:59:31.518118049 +0000 UTC m=+137.275942965" Jul 20 09:59:31.623398 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.623366 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:31.623573 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.623437 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:31.629180 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.629155 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:31.910749 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.910714 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 09:59:31.915897 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.915870 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:31.919038 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.918990 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 20 09:59:31.919177 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.919090 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 20 09:59:31.919298 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.919215 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 20 09:59:31.919298 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.919254 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-p52jm\"" Jul 20 09:59:31.919437 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.919326 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 20 09:59:31.919496 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.919422 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 20 09:59:31.919496 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.919445 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 20 09:59:31.919614 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.919553 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 20 09:59:31.919806 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.919785 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6g693sb9rica9\"" Jul 20 09:59:31.920627 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.920443 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 20 09:59:31.920627 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.920466 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 20 09:59:31.920627 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.920574 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 20 09:59:31.920839 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.920770 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 20 09:59:31.920839 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.920811 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 20 09:59:31.920936 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.920858 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 20 09:59:31.922652 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.922633 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 20 09:59:31.930413 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:31.930392 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 09:59:32.024235 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.024200 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ff27802-e9f8-4748-8d65-f6c3e4448069-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.024405 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.024246 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.024405 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.024274 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.024405 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.024314 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.024554 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.024438 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.024616 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.024566 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.024672 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.024645 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.024714 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.024694 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.024756 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.024721 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-config\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.024756 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.024738 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.024827 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.024758 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.024827 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.024796 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.024900 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.024836 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.024900 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.024855 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.024900 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.024878 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ff27802-e9f8-4748-8d65-f6c3e4448069-config-out\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.025017 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.024912 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.025017 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.024926 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.025017 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.024958 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.025017 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.024999 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-web-config\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.025185 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.025019 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfstn\" (UniqueName: \"kubernetes.io/projected/6ff27802-e9f8-4748-8d65-f6c3e4448069-kube-api-access-rfstn\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.125765 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.125743 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.125865 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.125772 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.125865 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.125796 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ff27802-e9f8-4748-8d65-f6c3e4448069-config-out\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.125865 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.125837 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.125865 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.125852 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.126049 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.125869 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.126049 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.125896 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-web-config\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.126049 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.125919 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfstn\" (UniqueName: \"kubernetes.io/projected/6ff27802-e9f8-4748-8d65-f6c3e4448069-kube-api-access-rfstn\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.126049 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.125944 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ff27802-e9f8-4748-8d65-f6c3e4448069-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.126049 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.125972 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.126049 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.126008 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.126049 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.126030 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.126360 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.126061 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.126360 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.126094 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.126360 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.126116 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.126360 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.126160 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.126360 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.126190 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-config\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.126360 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.126213 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.126360 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.126276 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.126360 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.126323 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.126767 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.126498 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.126767 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.126635 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.126868 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.126789 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.128348 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.127244 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.128348 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.126187 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.131969 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.131324 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.131969 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.131363 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.131969 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.131570 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ff27802-e9f8-4748-8d65-f6c3e4448069-config-out\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.131969 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.131789 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.131969 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.131801 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-config\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.134091 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.132403 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.134091 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.132466 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.134091 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.132639 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.134091 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.132821 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.134091 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.132839 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.134091 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.132904 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.139068 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.139043 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-web-config\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.139141 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.139100 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.139141 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.139105 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ff27802-e9f8-4748-8d65-f6c3e4448069-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.140971 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.140953 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfstn\" (UniqueName: \"kubernetes.io/projected/6ff27802-e9f8-4748-8d65-f6c3e4448069-kube-api-access-rfstn\") pod \"prometheus-k8s-0\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.227397 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.227303 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:32.371635 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.371596 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 09:59:32.374075 ip-10-0-142-23 kubenswrapper[2584]: W0720 09:59:32.374045 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff27802_e9f8_4748_8d65_f6c3e4448069.slice/crio-adcda97a5cf80c36bff2e13efe1cd73281b34419720591c0c4756c06ac6c1074 WatchSource:0}: Error finding container adcda97a5cf80c36bff2e13efe1cd73281b34419720591c0c4756c06ac6c1074: Status 404 returned error can't find the container with id adcda97a5cf80c36bff2e13efe1cd73281b34419720591c0c4756c06ac6c1074 Jul 20 09:59:32.469403 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.469370 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" event={"ID":"158aa05c-7e01-4812-a7ca-268d0863f0af","Type":"ContainerStarted","Data":"34284ea5ca5c2c5e15fef67f8e9df5bd4126c0f57fd697ec6fd01b487948e44f"} Jul 20 09:59:32.471143 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.471112 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff27802-e9f8-4748-8d65-f6c3e4448069","Type":"ContainerStarted","Data":"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2"} Jul 20 09:59:32.471262 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.471192 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff27802-e9f8-4748-8d65-f6c3e4448069","Type":"ContainerStarted","Data":"adcda97a5cf80c36bff2e13efe1cd73281b34419720591c0c4756c06ac6c1074"} Jul 20 09:59:32.476444 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.476417 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f4d647959-lfztk" Jul 20 09:59:32.490153 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:32.490064 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" podStartSLOduration=1.126829362 podStartE2EDuration="2.490048941s" totalImagesPullingTime="1.363219579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:32.488426247 +0000 UTC m=+138.246251137" watchObservedRunningTime="2026-07-20 09:59:32.490048941 +0000 UTC m=+138.247873831" Jul 20 09:59:33.476812 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:33.476773 2584 generic.go:356] "Generic (PLEG): container finished" podID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerID="786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2" exitCode=0 Jul 20 09:59:33.477245 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:33.476855 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff27802-e9f8-4748-8d65-f6c3e4448069","Type":"ContainerDied","Data":"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2"} Jul 20 09:59:37.477965 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:37.477924 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7f4bcdd898-c9278" Jul 20 09:59:37.497922 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:37.497887 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff27802-e9f8-4748-8d65-f6c3e4448069","Type":"ContainerStarted","Data":"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7"} Jul 20 09:59:37.498088 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:37.497964 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff27802-e9f8-4748-8d65-f6c3e4448069","Type":"ContainerStarted","Data":"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf"} Jul 20 09:59:37.498088 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:37.498003 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff27802-e9f8-4748-8d65-f6c3e4448069","Type":"ContainerStarted","Data":"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f"} Jul 20 09:59:37.498088 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:37.498042 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff27802-e9f8-4748-8d65-f6c3e4448069","Type":"ContainerStarted","Data":"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207"} Jul 20 09:59:37.498088 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:37.498077 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff27802-e9f8-4748-8d65-f6c3e4448069","Type":"ContainerStarted","Data":"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641"} Jul 20 09:59:37.498236 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:37.498111 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff27802-e9f8-4748-8d65-f6c3e4448069","Type":"ContainerStarted","Data":"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e"} Jul 20 09:59:37.538489 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:37.538417 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.201468954 podStartE2EDuration="6.538393788s" totalImagesPullingTime="3.318977401s" totalInitContainerRuntime="17.947433ms" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:37.537851273 +0000 UTC m=+143.295676204" watchObservedRunningTime="2026-07-20 09:59:37.538393788 +0000 UTC m=+143.296218682" Jul 20 09:59:41.611276 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:41.611237 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f4d647959-lfztk"] Jul 20 09:59:42.227653 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:42.227612 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:50.554831 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:50.554797 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 09:59:50.555215 ip-10-0-142-23 kubenswrapper[2584]: I0720 09:59:50.554873 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 10:00:06.632997 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:06.632929 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f4d647959-lfztk" podUID="c7a4da23-38cf-4401-aacb-dc8537aaae5a" containerName="console" containerID="cri-o://20958eb326a8c8fdf5c749076553aff6201e19f716ee124c16565363d51cd065" gracePeriod=15 Jul 20 10:00:06.878490 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:06.878465 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4d647959-lfztk" Jul 20 10:00:06.931670 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:06.931581 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7a4da23-38cf-4401-aacb-dc8537aaae5a-console-oauth-config\") pod \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " Jul 20 10:00:06.931670 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:06.931637 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-service-ca\") pod \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " Jul 20 10:00:06.931670 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:06.931672 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-console-config\") pod \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " Jul 20 10:00:06.931931 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:06.931705 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7a4da23-38cf-4401-aacb-dc8537aaae5a-console-serving-cert\") pod \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " Jul 20 10:00:06.931931 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:06.931742 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knj4r\" (UniqueName: \"kubernetes.io/projected/c7a4da23-38cf-4401-aacb-dc8537aaae5a-kube-api-access-knj4r\") pod \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " Jul 20 10:00:06.931931 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:06.931814 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-trusted-ca-bundle\") pod \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " Jul 20 10:00:06.931931 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:06.931852 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-oauth-serving-cert\") pod \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\" (UID: \"c7a4da23-38cf-4401-aacb-dc8537aaae5a\") " Jul 20 10:00:06.932209 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:06.932179 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-service-ca" (OuterVolumeSpecName: "service-ca") pod "c7a4da23-38cf-4401-aacb-dc8537aaae5a" (UID: "c7a4da23-38cf-4401-aacb-dc8537aaae5a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:06.932271 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:06.932200 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-console-config" (OuterVolumeSpecName: "console-config") pod "c7a4da23-38cf-4401-aacb-dc8537aaae5a" (UID: "c7a4da23-38cf-4401-aacb-dc8537aaae5a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:06.932323 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:06.932265 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c7a4da23-38cf-4401-aacb-dc8537aaae5a" (UID: "c7a4da23-38cf-4401-aacb-dc8537aaae5a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:06.932323 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:06.932303 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c7a4da23-38cf-4401-aacb-dc8537aaae5a" (UID: "c7a4da23-38cf-4401-aacb-dc8537aaae5a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:06.933978 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:06.933948 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7a4da23-38cf-4401-aacb-dc8537aaae5a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c7a4da23-38cf-4401-aacb-dc8537aaae5a" (UID: "c7a4da23-38cf-4401-aacb-dc8537aaae5a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:06.934086 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:06.934007 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7a4da23-38cf-4401-aacb-dc8537aaae5a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c7a4da23-38cf-4401-aacb-dc8537aaae5a" (UID: "c7a4da23-38cf-4401-aacb-dc8537aaae5a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:06.934086 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:06.934019 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7a4da23-38cf-4401-aacb-dc8537aaae5a-kube-api-access-knj4r" (OuterVolumeSpecName: "kube-api-access-knj4r") pod "c7a4da23-38cf-4401-aacb-dc8537aaae5a" (UID: "c7a4da23-38cf-4401-aacb-dc8537aaae5a"). InnerVolumeSpecName "kube-api-access-knj4r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:00:07.032734 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:07.032689 2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-service-ca\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:07.032734 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:07.032726 2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-console-config\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:07.032734 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:07.032739 2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7a4da23-38cf-4401-aacb-dc8537aaae5a-console-serving-cert\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:07.032985 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:07.032752 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knj4r\" (UniqueName: \"kubernetes.io/projected/c7a4da23-38cf-4401-aacb-dc8537aaae5a-kube-api-access-knj4r\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:07.032985 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:07.032764 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-trusted-ca-bundle\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:07.032985 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:07.032807 2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7a4da23-38cf-4401-aacb-dc8537aaae5a-oauth-serving-cert\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:07.032985 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:07.032821 2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7a4da23-38cf-4401-aacb-dc8537aaae5a-console-oauth-config\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:07.619761 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:07.619724 2584 generic.go:356] "Generic (PLEG): container finished" podID="c7a4da23-38cf-4401-aacb-dc8537aaae5a" containerID="20958eb326a8c8fdf5c749076553aff6201e19f716ee124c16565363d51cd065" exitCode=0 Jul 20 10:00:07.619960 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:07.619776 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4d647959-lfztk" Jul 20 10:00:07.619960 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:07.619790 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4d647959-lfztk" event={"ID":"c7a4da23-38cf-4401-aacb-dc8537aaae5a","Type":"ContainerDied","Data":"20958eb326a8c8fdf5c749076553aff6201e19f716ee124c16565363d51cd065"} Jul 20 10:00:07.619960 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:07.619843 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4d647959-lfztk" event={"ID":"c7a4da23-38cf-4401-aacb-dc8537aaae5a","Type":"ContainerDied","Data":"d7d147bd64509bfa1aa4c956a2ee18888229bc0cb0a1485ed5c4b0f06c647621"} Jul 20 10:00:07.619960 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:07.619867 2584 scope.go:117] "RemoveContainer" containerID="20958eb326a8c8fdf5c749076553aff6201e19f716ee124c16565363d51cd065" Jul 20 10:00:07.632083 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:07.632059 2584 scope.go:117] "RemoveContainer" containerID="20958eb326a8c8fdf5c749076553aff6201e19f716ee124c16565363d51cd065" Jul 20 10:00:07.632381 ip-10-0-142-23 kubenswrapper[2584]: E0720 10:00:07.632357 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20958eb326a8c8fdf5c749076553aff6201e19f716ee124c16565363d51cd065\": container with ID starting with 20958eb326a8c8fdf5c749076553aff6201e19f716ee124c16565363d51cd065 not found: ID does not exist" containerID="20958eb326a8c8fdf5c749076553aff6201e19f716ee124c16565363d51cd065" Jul 20 10:00:07.632441 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:07.632396 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20958eb326a8c8fdf5c749076553aff6201e19f716ee124c16565363d51cd065"} err="failed to get container status \"20958eb326a8c8fdf5c749076553aff6201e19f716ee124c16565363d51cd065\": rpc error: code = NotFound desc = could not find container \"20958eb326a8c8fdf5c749076553aff6201e19f716ee124c16565363d51cd065\": container with ID starting with 20958eb326a8c8fdf5c749076553aff6201e19f716ee124c16565363d51cd065 not found: ID does not exist" Jul 20 10:00:07.645605 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:07.645576 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f4d647959-lfztk"] Jul 20 10:00:07.648962 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:07.648937 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f4d647959-lfztk"] Jul 20 10:00:08.810358 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:08.810326 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7a4da23-38cf-4401-aacb-dc8537aaae5a" path="/var/lib/kubelet/pods/c7a4da23-38cf-4401-aacb-dc8537aaae5a/volumes" Jul 20 10:00:10.559718 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:10.559687 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 10:00:10.563958 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:10.563937 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5db8456c6b-npwkv" Jul 20 10:00:32.228099 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:32.228042 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:32.243946 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:32.243920 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:32.731528 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:32.731500 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:45.973502 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:45.973457 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 10:00:45.974118 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:45.973858 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="alertmanager" containerID="cri-o://556be789547e362cb6489c1ff2d917c271fc06150056d110881cb21c7d1b8588" gracePeriod=120 Jul 20 10:00:45.974118 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:45.973920 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="kube-rbac-proxy-metric" containerID="cri-o://095d017c474ac597844067414e36c683187a4a3125e2b62a7be5a6f58d29828b" gracePeriod=120 Jul 20 10:00:45.974118 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:45.973919 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="kube-rbac-proxy-web" containerID="cri-o://407bb6bf89df55cff73ecf26715a588bf76c7305c356834d115a332050c67a3a" gracePeriod=120 Jul 20 10:00:45.974118 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:45.973989 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="prom-label-proxy" containerID="cri-o://d2b7fcb8b0c7df36f3411babc759d5fa6353ef45f00b11ff2d8fcd72d3425583" gracePeriod=120 Jul 20 10:00:45.974118 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:45.974003 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="kube-rbac-proxy" containerID="cri-o://519cce9d423be062c64bc62c1aa217dc474bab0a3a5f10d35ccbf5fc7c465ad2" gracePeriod=120 Jul 20 10:00:45.974118 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:45.973929 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="config-reloader" containerID="cri-o://65a333a2757423d3bfc5cef852aa4ae27d6f14be8b06931c07808a067ab727be" gracePeriod=120 Jul 20 10:00:46.774739 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:46.774706 2584 generic.go:356] "Generic (PLEG): container finished" podID="adc44dab-5edd-4449-808a-867c5c5943d0" containerID="d2b7fcb8b0c7df36f3411babc759d5fa6353ef45f00b11ff2d8fcd72d3425583" exitCode=0 Jul 20 10:00:46.774739 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:46.774735 2584 generic.go:356] "Generic (PLEG): container finished" podID="adc44dab-5edd-4449-808a-867c5c5943d0" containerID="519cce9d423be062c64bc62c1aa217dc474bab0a3a5f10d35ccbf5fc7c465ad2" exitCode=0 Jul 20 10:00:46.774739 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:46.774741 2584 generic.go:356] "Generic (PLEG): container finished" podID="adc44dab-5edd-4449-808a-867c5c5943d0" containerID="65a333a2757423d3bfc5cef852aa4ae27d6f14be8b06931c07808a067ab727be" exitCode=0 Jul 20 10:00:46.774739 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:46.774747 2584 generic.go:356] "Generic (PLEG): container finished" podID="adc44dab-5edd-4449-808a-867c5c5943d0" containerID="556be789547e362cb6489c1ff2d917c271fc06150056d110881cb21c7d1b8588" exitCode=0 Jul 20 10:00:46.774999 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:46.774784 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc44dab-5edd-4449-808a-867c5c5943d0","Type":"ContainerDied","Data":"d2b7fcb8b0c7df36f3411babc759d5fa6353ef45f00b11ff2d8fcd72d3425583"} Jul 20 10:00:46.774999 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:46.774844 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc44dab-5edd-4449-808a-867c5c5943d0","Type":"ContainerDied","Data":"519cce9d423be062c64bc62c1aa217dc474bab0a3a5f10d35ccbf5fc7c465ad2"} Jul 20 10:00:46.774999 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:46.774869 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc44dab-5edd-4449-808a-867c5c5943d0","Type":"ContainerDied","Data":"65a333a2757423d3bfc5cef852aa4ae27d6f14be8b06931c07808a067ab727be"} Jul 20 10:00:46.774999 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:46.774892 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc44dab-5edd-4449-808a-867c5c5943d0","Type":"ContainerDied","Data":"556be789547e362cb6489c1ff2d917c271fc06150056d110881cb21c7d1b8588"} Jul 20 10:00:47.220349 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.220324 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:47.386790 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.386697 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/adc44dab-5edd-4449-808a-867c5c5943d0-alertmanager-main-db\") pod \"adc44dab-5edd-4449-808a-867c5c5943d0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " Jul 20 10:00:47.386790 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.386747 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcvtb\" (UniqueName: \"kubernetes.io/projected/adc44dab-5edd-4449-808a-867c5c5943d0-kube-api-access-vcvtb\") pod \"adc44dab-5edd-4449-808a-867c5c5943d0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " Jul 20 10:00:47.386790 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.386779 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-kube-rbac-proxy-web\") pod \"adc44dab-5edd-4449-808a-867c5c5943d0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " Jul 20 10:00:47.387066 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.386806 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-config-volume\") pod \"adc44dab-5edd-4449-808a-867c5c5943d0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " Jul 20 10:00:47.387066 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.386823 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/adc44dab-5edd-4449-808a-867c5c5943d0-tls-assets\") pod \"adc44dab-5edd-4449-808a-867c5c5943d0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " Jul 20 10:00:47.387066 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.386845 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-main-tls\") pod \"adc44dab-5edd-4449-808a-867c5c5943d0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " Jul 20 10:00:47.387066 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.386991 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc44dab-5edd-4449-808a-867c5c5943d0-alertmanager-trusted-ca-bundle\") pod \"adc44dab-5edd-4449-808a-867c5c5943d0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " Jul 20 10:00:47.387066 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.387047 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adc44dab-5edd-4449-808a-867c5c5943d0-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "adc44dab-5edd-4449-808a-867c5c5943d0" (UID: "adc44dab-5edd-4449-808a-867c5c5943d0"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:00:47.387066 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.387063 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-cluster-tls-config\") pod \"adc44dab-5edd-4449-808a-867c5c5943d0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " Jul 20 10:00:47.387370 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.387094 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"adc44dab-5edd-4449-808a-867c5c5943d0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " Jul 20 10:00:47.387370 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.387127 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adc44dab-5edd-4449-808a-867c5c5943d0-metrics-client-ca\") pod \"adc44dab-5edd-4449-808a-867c5c5943d0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " Jul 20 10:00:47.387370 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.387156 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/adc44dab-5edd-4449-808a-867c5c5943d0-config-out\") pod \"adc44dab-5edd-4449-808a-867c5c5943d0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " Jul 20 10:00:47.387370 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.387183 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-kube-rbac-proxy\") pod \"adc44dab-5edd-4449-808a-867c5c5943d0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " Jul 20 10:00:47.387370 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.387245 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-web-config\") pod \"adc44dab-5edd-4449-808a-867c5c5943d0\" (UID: \"adc44dab-5edd-4449-808a-867c5c5943d0\") " Jul 20 10:00:47.387634 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.387436 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adc44dab-5edd-4449-808a-867c5c5943d0-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "adc44dab-5edd-4449-808a-867c5c5943d0" (UID: "adc44dab-5edd-4449-808a-867c5c5943d0"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:47.387634 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.387557 2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adc44dab-5edd-4449-808a-867c5c5943d0-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:47.387634 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.387576 2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/adc44dab-5edd-4449-808a-867c5c5943d0-alertmanager-main-db\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:47.388094 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.388054 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adc44dab-5edd-4449-808a-867c5c5943d0-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "adc44dab-5edd-4449-808a-867c5c5943d0" (UID: "adc44dab-5edd-4449-808a-867c5c5943d0"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:47.389817 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.389757 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-config-volume" (OuterVolumeSpecName: "config-volume") pod "adc44dab-5edd-4449-808a-867c5c5943d0" (UID: "adc44dab-5edd-4449-808a-867c5c5943d0"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:47.389817 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.389799 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "adc44dab-5edd-4449-808a-867c5c5943d0" (UID: "adc44dab-5edd-4449-808a-867c5c5943d0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:47.390022 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.389974 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adc44dab-5edd-4449-808a-867c5c5943d0-kube-api-access-vcvtb" (OuterVolumeSpecName: "kube-api-access-vcvtb") pod "adc44dab-5edd-4449-808a-867c5c5943d0" (UID: "adc44dab-5edd-4449-808a-867c5c5943d0"). InnerVolumeSpecName "kube-api-access-vcvtb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:00:47.390502 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.390468 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adc44dab-5edd-4449-808a-867c5c5943d0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "adc44dab-5edd-4449-808a-867c5c5943d0" (UID: "adc44dab-5edd-4449-808a-867c5c5943d0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:00:47.390726 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.390703 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adc44dab-5edd-4449-808a-867c5c5943d0-config-out" (OuterVolumeSpecName: "config-out") pod "adc44dab-5edd-4449-808a-867c5c5943d0" (UID: "adc44dab-5edd-4449-808a-867c5c5943d0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:00:47.390726 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.390716 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "adc44dab-5edd-4449-808a-867c5c5943d0" (UID: "adc44dab-5edd-4449-808a-867c5c5943d0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:47.390857 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.390736 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "adc44dab-5edd-4449-808a-867c5c5943d0" (UID: "adc44dab-5edd-4449-808a-867c5c5943d0"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:47.391256 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.391233 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "adc44dab-5edd-4449-808a-867c5c5943d0" (UID: "adc44dab-5edd-4449-808a-867c5c5943d0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:47.396155 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.396126 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "adc44dab-5edd-4449-808a-867c5c5943d0" (UID: "adc44dab-5edd-4449-808a-867c5c5943d0"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:47.402273 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.402252 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-web-config" (OuterVolumeSpecName: "web-config") pod "adc44dab-5edd-4449-808a-867c5c5943d0" (UID: "adc44dab-5edd-4449-808a-867c5c5943d0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:47.488512 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.488482 2584 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adc44dab-5edd-4449-808a-867c5c5943d0-metrics-client-ca\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:47.488512 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.488508 2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/adc44dab-5edd-4449-808a-867c5c5943d0-config-out\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:47.488700 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.488520 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:47.488700 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.488530 2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-web-config\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:47.488700 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.488557 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcvtb\" (UniqueName: \"kubernetes.io/projected/adc44dab-5edd-4449-808a-867c5c5943d0-kube-api-access-vcvtb\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:47.488700 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.488566 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:47.488700 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.488575 2584 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-config-volume\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:47.488700 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.488583 2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/adc44dab-5edd-4449-808a-867c5c5943d0-tls-assets\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:47.488700 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.488590 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-main-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:47.488700 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.488598 2584 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-cluster-tls-config\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:47.488700 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.488606 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/adc44dab-5edd-4449-808a-867c5c5943d0-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:47.781325 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.781294 2584 generic.go:356] "Generic (PLEG): container finished" podID="adc44dab-5edd-4449-808a-867c5c5943d0" containerID="095d017c474ac597844067414e36c683187a4a3125e2b62a7be5a6f58d29828b" exitCode=0 Jul 20 10:00:47.781325 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.781319 2584 generic.go:356] "Generic (PLEG): container finished" podID="adc44dab-5edd-4449-808a-867c5c5943d0" containerID="407bb6bf89df55cff73ecf26715a588bf76c7305c356834d115a332050c67a3a" exitCode=0 Jul 20 10:00:47.781498 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.781345 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc44dab-5edd-4449-808a-867c5c5943d0","Type":"ContainerDied","Data":"095d017c474ac597844067414e36c683187a4a3125e2b62a7be5a6f58d29828b"} Jul 20 10:00:47.781498 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.781380 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:47.781498 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.781428 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc44dab-5edd-4449-808a-867c5c5943d0","Type":"ContainerDied","Data":"407bb6bf89df55cff73ecf26715a588bf76c7305c356834d115a332050c67a3a"} Jul 20 10:00:47.781498 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.781455 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"adc44dab-5edd-4449-808a-867c5c5943d0","Type":"ContainerDied","Data":"ce928b2f691e13f0989fd24e899e5165729dffcd13227cfa3cac436007405810"} Jul 20 10:00:47.781498 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.781486 2584 scope.go:117] "RemoveContainer" containerID="d2b7fcb8b0c7df36f3411babc759d5fa6353ef45f00b11ff2d8fcd72d3425583" Jul 20 10:00:47.788851 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.788829 2584 scope.go:117] "RemoveContainer" containerID="095d017c474ac597844067414e36c683187a4a3125e2b62a7be5a6f58d29828b" Jul 20 10:00:47.796362 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.796345 2584 scope.go:117] "RemoveContainer" containerID="519cce9d423be062c64bc62c1aa217dc474bab0a3a5f10d35ccbf5fc7c465ad2" Jul 20 10:00:47.802810 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.802794 2584 scope.go:117] "RemoveContainer" containerID="407bb6bf89df55cff73ecf26715a588bf76c7305c356834d115a332050c67a3a" Jul 20 10:00:47.806616 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.806592 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 10:00:47.810071 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.810051 2584 scope.go:117] "RemoveContainer" containerID="65a333a2757423d3bfc5cef852aa4ae27d6f14be8b06931c07808a067ab727be" Jul 20 10:00:47.813198 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.813180 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 10:00:47.817222 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.817201 2584 scope.go:117] "RemoveContainer" containerID="556be789547e362cb6489c1ff2d917c271fc06150056d110881cb21c7d1b8588" Jul 20 10:00:47.823988 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.823966 2584 scope.go:117] "RemoveContainer" containerID="43af05bb403ca35486b45fa71aa395a98ff657beca0c96525ab40b8c6370b163" Jul 20 10:00:47.830332 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.830316 2584 scope.go:117] "RemoveContainer" containerID="d2b7fcb8b0c7df36f3411babc759d5fa6353ef45f00b11ff2d8fcd72d3425583" Jul 20 10:00:47.830583 ip-10-0-142-23 kubenswrapper[2584]: E0720 10:00:47.830555 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2b7fcb8b0c7df36f3411babc759d5fa6353ef45f00b11ff2d8fcd72d3425583\": container with ID starting with d2b7fcb8b0c7df36f3411babc759d5fa6353ef45f00b11ff2d8fcd72d3425583 not found: ID does not exist" containerID="d2b7fcb8b0c7df36f3411babc759d5fa6353ef45f00b11ff2d8fcd72d3425583" Jul 20 10:00:47.830676 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.830594 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b7fcb8b0c7df36f3411babc759d5fa6353ef45f00b11ff2d8fcd72d3425583"} err="failed to get container status \"d2b7fcb8b0c7df36f3411babc759d5fa6353ef45f00b11ff2d8fcd72d3425583\": rpc error: code = NotFound desc = could not find container \"d2b7fcb8b0c7df36f3411babc759d5fa6353ef45f00b11ff2d8fcd72d3425583\": container with ID starting with d2b7fcb8b0c7df36f3411babc759d5fa6353ef45f00b11ff2d8fcd72d3425583 not found: ID does not exist" Jul 20 10:00:47.830676 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.830619 2584 scope.go:117] "RemoveContainer" containerID="095d017c474ac597844067414e36c683187a4a3125e2b62a7be5a6f58d29828b" Jul 20 10:00:47.830979 ip-10-0-142-23 kubenswrapper[2584]: E0720 10:00:47.830959 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"095d017c474ac597844067414e36c683187a4a3125e2b62a7be5a6f58d29828b\": container with ID starting with 095d017c474ac597844067414e36c683187a4a3125e2b62a7be5a6f58d29828b not found: ID does not exist" containerID="095d017c474ac597844067414e36c683187a4a3125e2b62a7be5a6f58d29828b" Jul 20 10:00:47.831058 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.830985 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"095d017c474ac597844067414e36c683187a4a3125e2b62a7be5a6f58d29828b"} err="failed to get container status \"095d017c474ac597844067414e36c683187a4a3125e2b62a7be5a6f58d29828b\": rpc error: code = NotFound desc = could not find container \"095d017c474ac597844067414e36c683187a4a3125e2b62a7be5a6f58d29828b\": container with ID starting with 095d017c474ac597844067414e36c683187a4a3125e2b62a7be5a6f58d29828b not found: ID does not exist" Jul 20 10:00:47.831058 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.831009 2584 scope.go:117] "RemoveContainer" containerID="519cce9d423be062c64bc62c1aa217dc474bab0a3a5f10d35ccbf5fc7c465ad2" Jul 20 10:00:47.831372 ip-10-0-142-23 kubenswrapper[2584]: E0720 10:00:47.831340 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"519cce9d423be062c64bc62c1aa217dc474bab0a3a5f10d35ccbf5fc7c465ad2\": container with ID starting with 519cce9d423be062c64bc62c1aa217dc474bab0a3a5f10d35ccbf5fc7c465ad2 not found: ID does not exist" containerID="519cce9d423be062c64bc62c1aa217dc474bab0a3a5f10d35ccbf5fc7c465ad2" Jul 20 10:00:47.831441 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.831371 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"519cce9d423be062c64bc62c1aa217dc474bab0a3a5f10d35ccbf5fc7c465ad2"} err="failed to get container status \"519cce9d423be062c64bc62c1aa217dc474bab0a3a5f10d35ccbf5fc7c465ad2\": rpc error: code = NotFound desc = could not find container \"519cce9d423be062c64bc62c1aa217dc474bab0a3a5f10d35ccbf5fc7c465ad2\": container with ID starting with 519cce9d423be062c64bc62c1aa217dc474bab0a3a5f10d35ccbf5fc7c465ad2 not found: ID does not exist" Jul 20 10:00:47.831441 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.831392 2584 scope.go:117] "RemoveContainer" containerID="407bb6bf89df55cff73ecf26715a588bf76c7305c356834d115a332050c67a3a" Jul 20 10:00:47.831710 ip-10-0-142-23 kubenswrapper[2584]: E0720 10:00:47.831687 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"407bb6bf89df55cff73ecf26715a588bf76c7305c356834d115a332050c67a3a\": container with ID starting with 407bb6bf89df55cff73ecf26715a588bf76c7305c356834d115a332050c67a3a not found: ID does not exist" containerID="407bb6bf89df55cff73ecf26715a588bf76c7305c356834d115a332050c67a3a" Jul 20 10:00:47.831790 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.831714 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"407bb6bf89df55cff73ecf26715a588bf76c7305c356834d115a332050c67a3a"} err="failed to get container status \"407bb6bf89df55cff73ecf26715a588bf76c7305c356834d115a332050c67a3a\": rpc error: code = NotFound desc = could not find container \"407bb6bf89df55cff73ecf26715a588bf76c7305c356834d115a332050c67a3a\": container with ID starting with 407bb6bf89df55cff73ecf26715a588bf76c7305c356834d115a332050c67a3a not found: ID does not exist" Jul 20 10:00:47.831790 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.831728 2584 scope.go:117] "RemoveContainer" containerID="65a333a2757423d3bfc5cef852aa4ae27d6f14be8b06931c07808a067ab727be" Jul 20 10:00:47.831995 ip-10-0-142-23 kubenswrapper[2584]: E0720 10:00:47.831978 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65a333a2757423d3bfc5cef852aa4ae27d6f14be8b06931c07808a067ab727be\": container with ID starting with 65a333a2757423d3bfc5cef852aa4ae27d6f14be8b06931c07808a067ab727be not found: ID does not exist" containerID="65a333a2757423d3bfc5cef852aa4ae27d6f14be8b06931c07808a067ab727be" Jul 20 10:00:47.832035 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.832001 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a333a2757423d3bfc5cef852aa4ae27d6f14be8b06931c07808a067ab727be"} err="failed to get container status \"65a333a2757423d3bfc5cef852aa4ae27d6f14be8b06931c07808a067ab727be\": rpc error: code = NotFound desc = could not find container \"65a333a2757423d3bfc5cef852aa4ae27d6f14be8b06931c07808a067ab727be\": container with ID starting with 65a333a2757423d3bfc5cef852aa4ae27d6f14be8b06931c07808a067ab727be not found: ID does not exist" Jul 20 10:00:47.832035 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.832016 2584 scope.go:117] "RemoveContainer" containerID="556be789547e362cb6489c1ff2d917c271fc06150056d110881cb21c7d1b8588" Jul 20 10:00:47.832275 ip-10-0-142-23 kubenswrapper[2584]: E0720 10:00:47.832258 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"556be789547e362cb6489c1ff2d917c271fc06150056d110881cb21c7d1b8588\": container with ID starting with 556be789547e362cb6489c1ff2d917c271fc06150056d110881cb21c7d1b8588 not found: ID does not exist" containerID="556be789547e362cb6489c1ff2d917c271fc06150056d110881cb21c7d1b8588" Jul 20 10:00:47.832354 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.832281 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"556be789547e362cb6489c1ff2d917c271fc06150056d110881cb21c7d1b8588"} err="failed to get container status \"556be789547e362cb6489c1ff2d917c271fc06150056d110881cb21c7d1b8588\": rpc error: code = NotFound desc = could not find container \"556be789547e362cb6489c1ff2d917c271fc06150056d110881cb21c7d1b8588\": container with ID starting with 556be789547e362cb6489c1ff2d917c271fc06150056d110881cb21c7d1b8588 not found: ID does not exist" Jul 20 10:00:47.832354 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.832295 2584 scope.go:117] "RemoveContainer" containerID="43af05bb403ca35486b45fa71aa395a98ff657beca0c96525ab40b8c6370b163" Jul 20 10:00:47.832521 ip-10-0-142-23 kubenswrapper[2584]: E0720 10:00:47.832502 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43af05bb403ca35486b45fa71aa395a98ff657beca0c96525ab40b8c6370b163\": container with ID starting with 43af05bb403ca35486b45fa71aa395a98ff657beca0c96525ab40b8c6370b163 not found: ID does not exist" containerID="43af05bb403ca35486b45fa71aa395a98ff657beca0c96525ab40b8c6370b163" Jul 20 10:00:47.832587 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.832524 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43af05bb403ca35486b45fa71aa395a98ff657beca0c96525ab40b8c6370b163"} err="failed to get container status \"43af05bb403ca35486b45fa71aa395a98ff657beca0c96525ab40b8c6370b163\": rpc error: code = NotFound desc = could not find container \"43af05bb403ca35486b45fa71aa395a98ff657beca0c96525ab40b8c6370b163\": container with ID starting with 43af05bb403ca35486b45fa71aa395a98ff657beca0c96525ab40b8c6370b163 not found: ID does not exist" Jul 20 10:00:47.832587 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.832561 2584 scope.go:117] "RemoveContainer" containerID="d2b7fcb8b0c7df36f3411babc759d5fa6353ef45f00b11ff2d8fcd72d3425583" Jul 20 10:00:47.832832 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.832813 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b7fcb8b0c7df36f3411babc759d5fa6353ef45f00b11ff2d8fcd72d3425583"} err="failed to get container status \"d2b7fcb8b0c7df36f3411babc759d5fa6353ef45f00b11ff2d8fcd72d3425583\": rpc error: code = NotFound desc = could not find container \"d2b7fcb8b0c7df36f3411babc759d5fa6353ef45f00b11ff2d8fcd72d3425583\": container with ID starting with d2b7fcb8b0c7df36f3411babc759d5fa6353ef45f00b11ff2d8fcd72d3425583 not found: ID does not exist" Jul 20 10:00:47.832882 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.832840 2584 scope.go:117] "RemoveContainer" containerID="095d017c474ac597844067414e36c683187a4a3125e2b62a7be5a6f58d29828b" Jul 20 10:00:47.833085 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.833057 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"095d017c474ac597844067414e36c683187a4a3125e2b62a7be5a6f58d29828b"} err="failed to get container status \"095d017c474ac597844067414e36c683187a4a3125e2b62a7be5a6f58d29828b\": rpc error: code = NotFound desc = could not find container \"095d017c474ac597844067414e36c683187a4a3125e2b62a7be5a6f58d29828b\": container with ID starting with 095d017c474ac597844067414e36c683187a4a3125e2b62a7be5a6f58d29828b not found: ID does not exist" Jul 20 10:00:47.833085 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.833075 2584 scope.go:117] "RemoveContainer" containerID="519cce9d423be062c64bc62c1aa217dc474bab0a3a5f10d35ccbf5fc7c465ad2" Jul 20 10:00:47.833292 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.833272 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"519cce9d423be062c64bc62c1aa217dc474bab0a3a5f10d35ccbf5fc7c465ad2"} err="failed to get container status \"519cce9d423be062c64bc62c1aa217dc474bab0a3a5f10d35ccbf5fc7c465ad2\": rpc error: code = NotFound desc = could not find container \"519cce9d423be062c64bc62c1aa217dc474bab0a3a5f10d35ccbf5fc7c465ad2\": container with ID starting with 519cce9d423be062c64bc62c1aa217dc474bab0a3a5f10d35ccbf5fc7c465ad2 not found: ID does not exist" Jul 20 10:00:47.833342 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.833293 2584 scope.go:117] "RemoveContainer" containerID="407bb6bf89df55cff73ecf26715a588bf76c7305c356834d115a332050c67a3a" Jul 20 10:00:47.833488 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.833469 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"407bb6bf89df55cff73ecf26715a588bf76c7305c356834d115a332050c67a3a"} err="failed to get container status \"407bb6bf89df55cff73ecf26715a588bf76c7305c356834d115a332050c67a3a\": rpc error: code = NotFound desc = could not find container \"407bb6bf89df55cff73ecf26715a588bf76c7305c356834d115a332050c67a3a\": container with ID starting with 407bb6bf89df55cff73ecf26715a588bf76c7305c356834d115a332050c67a3a not found: ID does not exist" Jul 20 10:00:47.833488 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.833486 2584 scope.go:117] "RemoveContainer" containerID="65a333a2757423d3bfc5cef852aa4ae27d6f14be8b06931c07808a067ab727be" Jul 20 10:00:47.833693 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.833676 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a333a2757423d3bfc5cef852aa4ae27d6f14be8b06931c07808a067ab727be"} err="failed to get container status \"65a333a2757423d3bfc5cef852aa4ae27d6f14be8b06931c07808a067ab727be\": rpc error: code = NotFound desc = could not find container \"65a333a2757423d3bfc5cef852aa4ae27d6f14be8b06931c07808a067ab727be\": container with ID starting with 65a333a2757423d3bfc5cef852aa4ae27d6f14be8b06931c07808a067ab727be not found: ID does not exist" Jul 20 10:00:47.833741 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.833693 2584 scope.go:117] "RemoveContainer" containerID="556be789547e362cb6489c1ff2d917c271fc06150056d110881cb21c7d1b8588" Jul 20 10:00:47.833950 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.833928 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"556be789547e362cb6489c1ff2d917c271fc06150056d110881cb21c7d1b8588"} err="failed to get container status \"556be789547e362cb6489c1ff2d917c271fc06150056d110881cb21c7d1b8588\": rpc error: code = NotFound desc = could not find container \"556be789547e362cb6489c1ff2d917c271fc06150056d110881cb21c7d1b8588\": container with ID starting with 556be789547e362cb6489c1ff2d917c271fc06150056d110881cb21c7d1b8588 not found: ID does not exist" Jul 20 10:00:47.834010 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.833950 2584 scope.go:117] "RemoveContainer" containerID="43af05bb403ca35486b45fa71aa395a98ff657beca0c96525ab40b8c6370b163" Jul 20 10:00:47.834184 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.834165 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43af05bb403ca35486b45fa71aa395a98ff657beca0c96525ab40b8c6370b163"} err="failed to get container status \"43af05bb403ca35486b45fa71aa395a98ff657beca0c96525ab40b8c6370b163\": rpc error: code = NotFound desc = could not find container \"43af05bb403ca35486b45fa71aa395a98ff657beca0c96525ab40b8c6370b163\": container with ID starting with 43af05bb403ca35486b45fa71aa395a98ff657beca0c96525ab40b8c6370b163 not found: ID does not exist" Jul 20 10:00:47.841264 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841243 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 10:00:47.841592 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841577 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7a4da23-38cf-4401-aacb-dc8537aaae5a" containerName="console" Jul 20 10:00:47.841674 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841595 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7a4da23-38cf-4401-aacb-dc8537aaae5a" containerName="console" Jul 20 10:00:47.841674 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841609 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="alertmanager" Jul 20 10:00:47.841674 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841618 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="alertmanager" Jul 20 10:00:47.841674 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841630 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="prom-label-proxy" Jul 20 10:00:47.841674 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841639 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="prom-label-proxy" Jul 20 10:00:47.841674 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841650 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="kube-rbac-proxy-metric" Jul 20 10:00:47.841674 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841659 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="kube-rbac-proxy-metric" Jul 20 10:00:47.842001 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841676 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="kube-rbac-proxy" Jul 20 10:00:47.842001 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841685 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="kube-rbac-proxy" Jul 20 10:00:47.842001 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841697 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="kube-rbac-proxy-web" Jul 20 10:00:47.842001 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841705 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="kube-rbac-proxy-web" Jul 20 10:00:47.842001 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841718 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="init-config-reloader" Jul 20 10:00:47.842001 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841726 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="init-config-reloader" Jul 20 10:00:47.842001 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841737 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="config-reloader" Jul 20 10:00:47.842001 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841745 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="config-reloader" Jul 20 10:00:47.842001 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841830 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7a4da23-38cf-4401-aacb-dc8537aaae5a" containerName="console" Jul 20 10:00:47.842001 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841843 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="kube-rbac-proxy-web" Jul 20 10:00:47.842001 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841853 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="prom-label-proxy" Jul 20 10:00:47.842001 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841860 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="kube-rbac-proxy-metric" Jul 20 10:00:47.842001 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841871 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="alertmanager" Jul 20 10:00:47.842001 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841882 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="config-reloader" Jul 20 10:00:47.842001 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.841890 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" containerName="kube-rbac-proxy" Jul 20 10:00:47.844983 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.844966 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:47.848216 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.848199 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 20 10:00:47.848763 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.848747 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 20 10:00:47.848861 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.848763 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 20 10:00:47.848861 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.848748 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 20 10:00:47.848861 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.848747 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 20 10:00:47.848861 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.848835 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 20 10:00:47.849163 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.849135 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 20 10:00:47.849315 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.849297 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 20 10:00:47.849389 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.849319 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nch2d\"" Jul 20 10:00:47.856264 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.856245 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 20 10:00:47.865217 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.865193 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 10:00:47.993155 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.993117 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:47.993310 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.993159 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdbt7\" (UniqueName: \"kubernetes.io/projected/8da78283-fca0-4357-8133-82d34813d5fb-kube-api-access-xdbt7\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:47.993310 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.993183 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-config-volume\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:47.993310 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.993266 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:47.993310 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.993300 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da78283-fca0-4357-8133-82d34813d5fb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:47.993468 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.993329 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8da78283-fca0-4357-8133-82d34813d5fb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:47.993468 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.993358 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8da78283-fca0-4357-8133-82d34813d5fb-config-out\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:47.993468 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.993386 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8da78283-fca0-4357-8133-82d34813d5fb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:47.993468 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.993416 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:47.993468 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.993441 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:47.993468 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.993459 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8da78283-fca0-4357-8133-82d34813d5fb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:47.993685 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.993523 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:47.993685 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:47.993591 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-web-config\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.094968 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.094923 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.094968 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.094971 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da78283-fca0-4357-8133-82d34813d5fb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.095131 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.094998 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8da78283-fca0-4357-8133-82d34813d5fb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.095131 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.095019 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8da78283-fca0-4357-8133-82d34813d5fb-config-out\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.095131 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.095046 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8da78283-fca0-4357-8133-82d34813d5fb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.095131 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.095073 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.095131 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.095100 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.095131 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.095124 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8da78283-fca0-4357-8133-82d34813d5fb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.095399 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.095186 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.095399 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.095216 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-web-config\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.095399 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.095258 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.095399 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.095297 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdbt7\" (UniqueName: \"kubernetes.io/projected/8da78283-fca0-4357-8133-82d34813d5fb-kube-api-access-xdbt7\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.095399 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.095323 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-config-volume\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.095676 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.095606 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8da78283-fca0-4357-8133-82d34813d5fb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.096070 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.095955 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da78283-fca0-4357-8133-82d34813d5fb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.096929 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.096583 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8da78283-fca0-4357-8133-82d34813d5fb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.098203 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.098175 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-config-volume\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.098343 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.098265 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-web-config\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.098343 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.098275 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.098343 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.098309 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8da78283-fca0-4357-8133-82d34813d5fb-config-out\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.098528 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.098342 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.098528 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.098342 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.098794 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.098773 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8da78283-fca0-4357-8133-82d34813d5fb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.099284 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.099263 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.100106 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.100088 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8da78283-fca0-4357-8133-82d34813d5fb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.107953 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.107936 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdbt7\" (UniqueName: \"kubernetes.io/projected/8da78283-fca0-4357-8133-82d34813d5fb-kube-api-access-xdbt7\") pod \"alertmanager-main-0\" (UID: \"8da78283-fca0-4357-8133-82d34813d5fb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.155138 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.155109 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 10:00:48.295647 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.295618 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 10:00:48.297576 ip-10-0-142-23 kubenswrapper[2584]: W0720 10:00:48.297549 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da78283_fca0_4357_8133_82d34813d5fb.slice/crio-94953fd399210475e6617e107d6471a0ae9ea654daddc9770b5a36ddf7475df6 WatchSource:0}: Error finding container 94953fd399210475e6617e107d6471a0ae9ea654daddc9770b5a36ddf7475df6: Status 404 returned error can't find the container with id 94953fd399210475e6617e107d6471a0ae9ea654daddc9770b5a36ddf7475df6 Jul 20 10:00:48.787558 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.787502 2584 generic.go:356] "Generic (PLEG): container finished" podID="8da78283-fca0-4357-8133-82d34813d5fb" containerID="0d8150a88cce570085e9df0c8270bf4fd8dea7d73e3e367c80db2740c9d12f07" exitCode=0 Jul 20 10:00:48.787558 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.787561 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8da78283-fca0-4357-8133-82d34813d5fb","Type":"ContainerDied","Data":"0d8150a88cce570085e9df0c8270bf4fd8dea7d73e3e367c80db2740c9d12f07"} Jul 20 10:00:48.787754 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.787610 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8da78283-fca0-4357-8133-82d34813d5fb","Type":"ContainerStarted","Data":"94953fd399210475e6617e107d6471a0ae9ea654daddc9770b5a36ddf7475df6"} Jul 20 10:00:48.810231 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:48.810200 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adc44dab-5edd-4449-808a-867c5c5943d0" path="/var/lib/kubelet/pods/adc44dab-5edd-4449-808a-867c5c5943d0/volumes" Jul 20 10:00:49.794447 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:49.794404 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8da78283-fca0-4357-8133-82d34813d5fb","Type":"ContainerStarted","Data":"f8f2c78e33a96591301397e97577d673ede9555c4730164db6b861efb7a5804f"} Jul 20 10:00:49.794853 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:49.794554 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8da78283-fca0-4357-8133-82d34813d5fb","Type":"ContainerStarted","Data":"b2215a67fde592962ca21c81cdd32012ed2956dd83d42a8798bbb7f2897b7f15"} Jul 20 10:00:49.794853 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:49.794588 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8da78283-fca0-4357-8133-82d34813d5fb","Type":"ContainerStarted","Data":"7bf5d6ea825a775452df54179355af6004f7bbc0c959ce324e138f800e3301cf"} Jul 20 10:00:49.794853 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:49.794612 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8da78283-fca0-4357-8133-82d34813d5fb","Type":"ContainerStarted","Data":"f74252955e0650ef7fc1771dc7ef827a8c4f63db52990bbd087959328a28c93e"} Jul 20 10:00:49.794853 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:49.794637 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8da78283-fca0-4357-8133-82d34813d5fb","Type":"ContainerStarted","Data":"52bf2b508cb3665fcfd055bff3fbe6d575d1eb96520314b09e1a1857042853c3"} Jul 20 10:00:49.794853 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:49.794661 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8da78283-fca0-4357-8133-82d34813d5fb","Type":"ContainerStarted","Data":"77898b5bcf9c42aaf6b6224f791ec5809503401fa52944e4a6b97dea8c445b8f"} Jul 20 10:00:50.306925 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.306871 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.289325443 podStartE2EDuration="3.306811785s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.486342ms" isStatefulPod=false podCreationTimestamp="2026-07-20 10:00:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:00:49.834270533 +0000 UTC m=+215.592095425" watchObservedRunningTime="2026-07-20 10:00:50.306811785 +0000 UTC m=+216.064636676" Jul 20 10:00:50.308240 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.308216 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 10:00:50.308565 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.308520 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="prometheus" containerID="cri-o://da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e" gracePeriod=600 Jul 20 10:00:50.308711 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.308556 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="thanos-sidecar" containerID="cri-o://ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207" gracePeriod=600 Jul 20 10:00:50.308711 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.308529 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="kube-rbac-proxy" containerID="cri-o://20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf" gracePeriod=600 Jul 20 10:00:50.308711 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.308580 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="config-reloader" containerID="cri-o://9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641" gracePeriod=600 Jul 20 10:00:50.308711 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.308623 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7" gracePeriod=600 Jul 20 10:00:50.308711 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.308597 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="kube-rbac-proxy-web" containerID="cri-o://fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f" gracePeriod=600 Jul 20 10:00:50.566575 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.566549 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:50.721697 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.721647 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-rulefiles-1\") pod \"6ff27802-e9f8-4748-8d65-f6c3e4448069\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " Jul 20 10:00:50.721890 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.721708 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-kube-rbac-proxy\") pod \"6ff27802-e9f8-4748-8d65-f6c3e4448069\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " Jul 20 10:00:50.721890 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.721729 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6ff27802-e9f8-4748-8d65-f6c3e4448069\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " Jul 20 10:00:50.722007 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.721900 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-config\") pod \"6ff27802-e9f8-4748-8d65-f6c3e4448069\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " Jul 20 10:00:50.722007 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.721942 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-metrics-client-certs\") pod \"6ff27802-e9f8-4748-8d65-f6c3e4448069\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " Jul 20 10:00:50.722007 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.721970 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-rulefiles-0\") pod \"6ff27802-e9f8-4748-8d65-f6c3e4448069\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " Jul 20 10:00:50.722175 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.722004 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6ff27802-e9f8-4748-8d65-f6c3e4448069\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " Jul 20 10:00:50.722175 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.722019 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "6ff27802-e9f8-4748-8d65-f6c3e4448069" (UID: "6ff27802-e9f8-4748-8d65-f6c3e4448069"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:50.722175 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.722045 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfstn\" (UniqueName: \"kubernetes.io/projected/6ff27802-e9f8-4748-8d65-f6c3e4448069-kube-api-access-rfstn\") pod \"6ff27802-e9f8-4748-8d65-f6c3e4448069\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " Jul 20 10:00:50.722175 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.722078 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-trusted-ca-bundle\") pod \"6ff27802-e9f8-4748-8d65-f6c3e4448069\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " Jul 20 10:00:50.722175 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.722131 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-web-config\") pod \"6ff27802-e9f8-4748-8d65-f6c3e4448069\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " Jul 20 10:00:50.722175 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.722161 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-db\") pod \"6ff27802-e9f8-4748-8d65-f6c3e4448069\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " Jul 20 10:00:50.722450 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.722186 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-rulefiles-2\") pod \"6ff27802-e9f8-4748-8d65-f6c3e4448069\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " Jul 20 10:00:50.722450 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.722215 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ff27802-e9f8-4748-8d65-f6c3e4448069-tls-assets\") pod \"6ff27802-e9f8-4748-8d65-f6c3e4448069\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " Jul 20 10:00:50.722450 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.722256 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-configmap-kubelet-serving-ca-bundle\") pod \"6ff27802-e9f8-4748-8d65-f6c3e4448069\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " Jul 20 10:00:50.722450 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.722287 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ff27802-e9f8-4748-8d65-f6c3e4448069-config-out\") pod \"6ff27802-e9f8-4748-8d65-f6c3e4448069\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " Jul 20 10:00:50.722450 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.722314 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-grpc-tls\") pod \"6ff27802-e9f8-4748-8d65-f6c3e4448069\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " Jul 20 10:00:50.722450 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.722340 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-thanos-prometheus-http-client-file\") pod \"6ff27802-e9f8-4748-8d65-f6c3e4448069\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " Jul 20 10:00:50.722450 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.722379 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-configmap-serving-certs-ca-bundle\") pod \"6ff27802-e9f8-4748-8d65-f6c3e4448069\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " Jul 20 10:00:50.722450 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.722406 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-configmap-metrics-client-ca\") pod \"6ff27802-e9f8-4748-8d65-f6c3e4448069\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " Jul 20 10:00:50.722450 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.722444 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-prometheus-k8s-tls\") pod \"6ff27802-e9f8-4748-8d65-f6c3e4448069\" (UID: \"6ff27802-e9f8-4748-8d65-f6c3e4448069\") " Jul 20 10:00:50.722915 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.722790 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:50.723664 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.723368 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "6ff27802-e9f8-4748-8d65-f6c3e4448069" (UID: "6ff27802-e9f8-4748-8d65-f6c3e4448069"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:50.724675 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.724623 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "6ff27802-e9f8-4748-8d65-f6c3e4448069" (UID: "6ff27802-e9f8-4748-8d65-f6c3e4448069"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:50.724792 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.724770 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "6ff27802-e9f8-4748-8d65-f6c3e4448069" (UID: "6ff27802-e9f8-4748-8d65-f6c3e4448069"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:50.726192 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.725644 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "6ff27802-e9f8-4748-8d65-f6c3e4448069" (UID: "6ff27802-e9f8-4748-8d65-f6c3e4448069"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:50.726192 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.725699 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "6ff27802-e9f8-4748-8d65-f6c3e4448069" (UID: "6ff27802-e9f8-4748-8d65-f6c3e4448069"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:50.726192 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.725724 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-config" (OuterVolumeSpecName: "config") pod "6ff27802-e9f8-4748-8d65-f6c3e4448069" (UID: "6ff27802-e9f8-4748-8d65-f6c3e4448069"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:50.726192 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.726038 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "6ff27802-e9f8-4748-8d65-f6c3e4448069" (UID: "6ff27802-e9f8-4748-8d65-f6c3e4448069"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:50.726192 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.726121 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ff27802-e9f8-4748-8d65-f6c3e4448069-kube-api-access-rfstn" (OuterVolumeSpecName: "kube-api-access-rfstn") pod "6ff27802-e9f8-4748-8d65-f6c3e4448069" (UID: "6ff27802-e9f8-4748-8d65-f6c3e4448069"). InnerVolumeSpecName "kube-api-access-rfstn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:00:50.726506 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.726260 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "6ff27802-e9f8-4748-8d65-f6c3e4448069" (UID: "6ff27802-e9f8-4748-8d65-f6c3e4448069"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:50.726665 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.726640 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ff27802-e9f8-4748-8d65-f6c3e4448069-config-out" (OuterVolumeSpecName: "config-out") pod "6ff27802-e9f8-4748-8d65-f6c3e4448069" (UID: "6ff27802-e9f8-4748-8d65-f6c3e4448069"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:00:50.726665 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.726648 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ff27802-e9f8-4748-8d65-f6c3e4448069-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6ff27802-e9f8-4748-8d65-f6c3e4448069" (UID: "6ff27802-e9f8-4748-8d65-f6c3e4448069"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:00:50.726864 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.726839 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "6ff27802-e9f8-4748-8d65-f6c3e4448069" (UID: "6ff27802-e9f8-4748-8d65-f6c3e4448069"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:00:50.726966 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.726947 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "6ff27802-e9f8-4748-8d65-f6c3e4448069" (UID: "6ff27802-e9f8-4748-8d65-f6c3e4448069"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:50.727609 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.727583 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "6ff27802-e9f8-4748-8d65-f6c3e4448069" (UID: "6ff27802-e9f8-4748-8d65-f6c3e4448069"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:50.727701 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.727592 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "6ff27802-e9f8-4748-8d65-f6c3e4448069" (UID: "6ff27802-e9f8-4748-8d65-f6c3e4448069"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:50.727701 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.727619 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "6ff27802-e9f8-4748-8d65-f6c3e4448069" (UID: "6ff27802-e9f8-4748-8d65-f6c3e4448069"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:50.727778 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.727702 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "6ff27802-e9f8-4748-8d65-f6c3e4448069" (UID: "6ff27802-e9f8-4748-8d65-f6c3e4448069"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:50.727778 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.727751 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "6ff27802-e9f8-4748-8d65-f6c3e4448069" (UID: "6ff27802-e9f8-4748-8d65-f6c3e4448069"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:50.735721 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.735700 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-web-config" (OuterVolumeSpecName: "web-config") pod "6ff27802-e9f8-4748-8d65-f6c3e4448069" (UID: "6ff27802-e9f8-4748-8d65-f6c3e4448069"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:50.801453 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.801418 2584 generic.go:356] "Generic (PLEG): container finished" podID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerID="4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7" exitCode=0 Jul 20 10:00:50.801453 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.801442 2584 generic.go:356] "Generic (PLEG): container finished" podID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerID="20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf" exitCode=0 Jul 20 10:00:50.801453 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.801449 2584 generic.go:356] "Generic (PLEG): container finished" podID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerID="fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f" exitCode=0 Jul 20 10:00:50.801453 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.801455 2584 generic.go:356] "Generic (PLEG): container finished" podID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerID="ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207" exitCode=0 Jul 20 10:00:50.801453 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.801461 2584 generic.go:356] "Generic (PLEG): container finished" podID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerID="9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641" exitCode=0 Jul 20 10:00:50.802082 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.801467 2584 generic.go:356] "Generic (PLEG): container finished" podID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerID="da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e" exitCode=0 Jul 20 10:00:50.802082 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.801495 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:50.802082 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.801494 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff27802-e9f8-4748-8d65-f6c3e4448069","Type":"ContainerDied","Data":"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7"} Jul 20 10:00:50.802082 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.801586 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff27802-e9f8-4748-8d65-f6c3e4448069","Type":"ContainerDied","Data":"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf"} Jul 20 10:00:50.802082 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.801616 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff27802-e9f8-4748-8d65-f6c3e4448069","Type":"ContainerDied","Data":"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f"} Jul 20 10:00:50.802082 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.801641 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff27802-e9f8-4748-8d65-f6c3e4448069","Type":"ContainerDied","Data":"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207"} Jul 20 10:00:50.802082 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.801651 2584 scope.go:117] "RemoveContainer" containerID="4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7" Jul 20 10:00:50.802082 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.801667 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff27802-e9f8-4748-8d65-f6c3e4448069","Type":"ContainerDied","Data":"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641"} Jul 20 10:00:50.802082 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.801691 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff27802-e9f8-4748-8d65-f6c3e4448069","Type":"ContainerDied","Data":"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e"} Jul 20 10:00:50.802082 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.801715 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff27802-e9f8-4748-8d65-f6c3e4448069","Type":"ContainerDied","Data":"adcda97a5cf80c36bff2e13efe1cd73281b34419720591c0c4756c06ac6c1074"} Jul 20 10:00:50.809404 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.809377 2584 scope.go:117] "RemoveContainer" containerID="20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf" Jul 20 10:00:50.820693 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.820671 2584 scope.go:117] "RemoveContainer" containerID="fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f" Jul 20 10:00:50.823872 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.823849 2584 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-metrics-client-certs\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:50.823939 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.823878 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:50.823939 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.823898 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:50.823939 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.823915 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfstn\" (UniqueName: \"kubernetes.io/projected/6ff27802-e9f8-4748-8d65-f6c3e4448069-kube-api-access-rfstn\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:50.823939 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.823930 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:50.824059 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.823970 2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-web-config\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:50.824059 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.823985 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-db\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:50.824059 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.823999 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:50.824059 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.824014 2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ff27802-e9f8-4748-8d65-f6c3e4448069-tls-assets\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:50.824059 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.824029 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:50.824059 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.824042 2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ff27802-e9f8-4748-8d65-f6c3e4448069-config-out\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:50.824059 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.824054 2584 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-grpc-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:50.824243 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.824067 2584 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:50.824243 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.824080 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:50.824243 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.824094 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ff27802-e9f8-4748-8d65-f6c3e4448069-configmap-metrics-client-ca\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:50.824243 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.824107 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:50.824243 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.824116 2584 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-kube-rbac-proxy\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:50.824243 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.824130 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:50.824243 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.824145 2584 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ff27802-e9f8-4748-8d65-f6c3e4448069-config\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 10:00:50.827399 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.827359 2584 scope.go:117] "RemoveContainer" containerID="ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207" Jul 20 10:00:50.833058 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.833034 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 10:00:50.835968 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.835944 2584 scope.go:117] "RemoveContainer" containerID="9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641" Jul 20 10:00:50.836914 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.836833 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 10:00:50.842632 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.842613 2584 scope.go:117] "RemoveContainer" containerID="da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e" Jul 20 10:00:50.849660 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.849641 2584 scope.go:117] "RemoveContainer" containerID="786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2" Jul 20 10:00:50.856260 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.856241 2584 scope.go:117] "RemoveContainer" containerID="4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7" Jul 20 10:00:50.856496 ip-10-0-142-23 kubenswrapper[2584]: E0720 10:00:50.856479 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7\": container with ID starting with 4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7 not found: ID does not exist" containerID="4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7" Jul 20 10:00:50.856557 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.856504 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7"} err="failed to get container status \"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7\": rpc error: code = NotFound desc = could not find container \"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7\": container with ID starting with 4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7 not found: ID does not exist" Jul 20 10:00:50.856557 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.856521 2584 scope.go:117] "RemoveContainer" containerID="20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf" Jul 20 10:00:50.856761 ip-10-0-142-23 kubenswrapper[2584]: E0720 10:00:50.856744 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf\": container with ID starting with 20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf not found: ID does not exist" containerID="20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf" Jul 20 10:00:50.856799 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.856767 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf"} err="failed to get container status \"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf\": rpc error: code = NotFound desc = could not find container \"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf\": container with ID starting with 20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf not found: ID does not exist" Jul 20 10:00:50.856799 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.856781 2584 scope.go:117] "RemoveContainer" containerID="fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f" Jul 20 10:00:50.856976 ip-10-0-142-23 kubenswrapper[2584]: E0720 10:00:50.856960 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f\": container with ID starting with fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f not found: ID does not exist" containerID="fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f" Jul 20 10:00:50.857013 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.856980 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f"} err="failed to get container status \"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f\": rpc error: code = NotFound desc = could not find container \"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f\": container with ID starting with fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f not found: ID does not exist" Jul 20 10:00:50.857013 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.856994 2584 scope.go:117] "RemoveContainer" containerID="ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207" Jul 20 10:00:50.857183 ip-10-0-142-23 kubenswrapper[2584]: E0720 10:00:50.857168 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207\": container with ID starting with ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207 not found: ID does not exist" containerID="ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207" Jul 20 10:00:50.857223 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.857186 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207"} err="failed to get container status \"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207\": rpc error: code = NotFound desc = could not find container \"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207\": container with ID starting with ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207 not found: ID does not exist" Jul 20 10:00:50.857223 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.857198 2584 scope.go:117] "RemoveContainer" containerID="9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641" Jul 20 10:00:50.857379 ip-10-0-142-23 kubenswrapper[2584]: E0720 10:00:50.857364 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641\": container with ID starting with 9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641 not found: ID does not exist" containerID="9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641" Jul 20 10:00:50.857415 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.857383 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641"} err="failed to get container status \"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641\": rpc error: code = NotFound desc = could not find container \"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641\": container with ID starting with 9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641 not found: ID does not exist" Jul 20 10:00:50.857415 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.857394 2584 scope.go:117] "RemoveContainer" containerID="da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e" Jul 20 10:00:50.857589 ip-10-0-142-23 kubenswrapper[2584]: E0720 10:00:50.857573 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e\": container with ID starting with da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e not found: ID does not exist" containerID="da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e" Jul 20 10:00:50.857633 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.857592 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e"} err="failed to get container status \"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e\": rpc error: code = NotFound desc = could not find container \"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e\": container with ID starting with da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e not found: ID does not exist" Jul 20 10:00:50.857633 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.857604 2584 scope.go:117] "RemoveContainer" containerID="786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2" Jul 20 10:00:50.857803 ip-10-0-142-23 kubenswrapper[2584]: E0720 10:00:50.857790 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2\": container with ID starting with 786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2 not found: ID does not exist" containerID="786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2" Jul 20 10:00:50.857847 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.857806 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2"} err="failed to get container status \"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2\": rpc error: code = NotFound desc = could not find container \"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2\": container with ID starting with 786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2 not found: ID does not exist" Jul 20 10:00:50.857847 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.857816 2584 scope.go:117] "RemoveContainer" containerID="4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7" Jul 20 10:00:50.857996 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.857980 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7"} err="failed to get container status \"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7\": rpc error: code = NotFound desc = could not find container \"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7\": container with ID starting with 4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7 not found: ID does not exist" Jul 20 10:00:50.858036 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.857996 2584 scope.go:117] "RemoveContainer" containerID="20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf" Jul 20 10:00:50.858170 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.858155 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf"} err="failed to get container status \"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf\": rpc error: code = NotFound desc = could not find container \"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf\": container with ID starting with 20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf not found: ID does not exist" Jul 20 10:00:50.858204 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.858170 2584 scope.go:117] "RemoveContainer" containerID="fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f" Jul 20 10:00:50.858360 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.858344 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f"} err="failed to get container status \"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f\": rpc error: code = NotFound desc = could not find container \"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f\": container with ID starting with fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f not found: ID does not exist" Jul 20 10:00:50.858401 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.858360 2584 scope.go:117] "RemoveContainer" containerID="ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207" Jul 20 10:00:50.858558 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.858531 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207"} err="failed to get container status \"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207\": rpc error: code = NotFound desc = could not find container \"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207\": container with ID starting with ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207 not found: ID does not exist" Jul 20 10:00:50.858607 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.858558 2584 scope.go:117] "RemoveContainer" containerID="9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641" Jul 20 10:00:50.858752 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.858737 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641"} err="failed to get container status \"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641\": rpc error: code = NotFound desc = could not find container \"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641\": container with ID starting with 9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641 not found: ID does not exist" Jul 20 10:00:50.858798 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.858752 2584 scope.go:117] "RemoveContainer" containerID="da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e" Jul 20 10:00:50.858963 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.858940 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e"} err="failed to get container status \"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e\": rpc error: code = NotFound desc = could not find container \"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e\": container with ID starting with da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e not found: ID does not exist" Jul 20 10:00:50.859038 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.858967 2584 scope.go:117] "RemoveContainer" containerID="786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2" Jul 20 10:00:50.859198 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.859184 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2"} err="failed to get container status \"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2\": rpc error: code = NotFound desc = could not find container \"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2\": container with ID starting with 786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2 not found: ID does not exist" Jul 20 10:00:50.859243 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.859198 2584 scope.go:117] "RemoveContainer" containerID="4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7" Jul 20 10:00:50.859346 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.859330 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7"} err="failed to get container status \"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7\": rpc error: code = NotFound desc = could not find container \"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7\": container with ID starting with 4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7 not found: ID does not exist" Jul 20 10:00:50.859387 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.859346 2584 scope.go:117] "RemoveContainer" containerID="20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf" Jul 20 10:00:50.859510 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.859490 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf"} err="failed to get container status \"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf\": rpc error: code = NotFound desc = could not find container \"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf\": container with ID starting with 20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf not found: ID does not exist" Jul 20 10:00:50.859593 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.859510 2584 scope.go:117] "RemoveContainer" containerID="fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f" Jul 20 10:00:50.859799 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.859781 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f"} err="failed to get container status \"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f\": rpc error: code = NotFound desc = could not find container \"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f\": container with ID starting with fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f not found: ID does not exist" Jul 20 10:00:50.859843 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.859800 2584 scope.go:117] "RemoveContainer" containerID="ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207" Jul 20 10:00:50.859977 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.859957 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207"} err="failed to get container status \"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207\": rpc error: code = NotFound desc = could not find container \"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207\": container with ID starting with ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207 not found: ID does not exist" Jul 20 10:00:50.860014 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.859979 2584 scope.go:117] "RemoveContainer" containerID="9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641" Jul 20 10:00:50.860190 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.860169 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641"} err="failed to get container status \"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641\": rpc error: code = NotFound desc = could not find container \"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641\": container with ID starting with 9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641 not found: ID does not exist" Jul 20 10:00:50.860190 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.860188 2584 scope.go:117] "RemoveContainer" containerID="da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e" Jul 20 10:00:50.860386 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.860371 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e"} err="failed to get container status \"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e\": rpc error: code = NotFound desc = could not find container \"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e\": container with ID starting with da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e not found: ID does not exist" Jul 20 10:00:50.860386 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.860385 2584 scope.go:117] "RemoveContainer" containerID="786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2" Jul 20 10:00:50.860602 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.860586 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2"} err="failed to get container status \"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2\": rpc error: code = NotFound desc = could not find container \"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2\": container with ID starting with 786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2 not found: ID does not exist" Jul 20 10:00:50.860602 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.860602 2584 scope.go:117] "RemoveContainer" containerID="4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7" Jul 20 10:00:50.860820 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.860804 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7"} err="failed to get container status \"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7\": rpc error: code = NotFound desc = could not find container \"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7\": container with ID starting with 4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7 not found: ID does not exist" Jul 20 10:00:50.860872 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.860821 2584 scope.go:117] "RemoveContainer" containerID="20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf" Jul 20 10:00:50.861041 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.861021 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf"} err="failed to get container status \"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf\": rpc error: code = NotFound desc = could not find container \"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf\": container with ID starting with 20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf not found: ID does not exist" Jul 20 10:00:50.861078 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.861042 2584 scope.go:117] "RemoveContainer" containerID="fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f" Jul 20 10:00:50.861240 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.861223 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f"} err="failed to get container status \"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f\": rpc error: code = NotFound desc = could not find container \"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f\": container with ID starting with fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f not found: ID does not exist" Jul 20 10:00:50.861280 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.861240 2584 scope.go:117] "RemoveContainer" containerID="ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207" Jul 20 10:00:50.861448 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.861430 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207"} err="failed to get container status \"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207\": rpc error: code = NotFound desc = could not find container \"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207\": container with ID starting with ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207 not found: ID does not exist" Jul 20 10:00:50.861499 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.861448 2584 scope.go:117] "RemoveContainer" containerID="9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641" Jul 20 10:00:50.861649 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.861633 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641"} err="failed to get container status \"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641\": rpc error: code = NotFound desc = could not find container \"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641\": container with ID starting with 9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641 not found: ID does not exist" Jul 20 10:00:50.861690 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.861649 2584 scope.go:117] "RemoveContainer" containerID="da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e" Jul 20 10:00:50.861850 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.861835 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e"} err="failed to get container status \"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e\": rpc error: code = NotFound desc = could not find container \"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e\": container with ID starting with da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e not found: ID does not exist" Jul 20 10:00:50.861890 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.861851 2584 scope.go:117] "RemoveContainer" containerID="786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2" Jul 20 10:00:50.862044 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.862029 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2"} err="failed to get container status \"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2\": rpc error: code = NotFound desc = could not find container \"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2\": container with ID starting with 786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2 not found: ID does not exist" Jul 20 10:00:50.862135 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.862045 2584 scope.go:117] "RemoveContainer" containerID="4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7" Jul 20 10:00:50.862262 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.862243 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7"} err="failed to get container status \"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7\": rpc error: code = NotFound desc = could not find container \"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7\": container with ID starting with 4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7 not found: ID does not exist" Jul 20 10:00:50.862301 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.862263 2584 scope.go:117] "RemoveContainer" containerID="20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf" Jul 20 10:00:50.862509 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.862478 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf"} err="failed to get container status \"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf\": rpc error: code = NotFound desc = could not find container \"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf\": container with ID starting with 20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf not found: ID does not exist" Jul 20 10:00:50.862509 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.862502 2584 scope.go:117] "RemoveContainer" containerID="fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f" Jul 20 10:00:50.862824 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.862801 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f"} err="failed to get container status \"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f\": rpc error: code = NotFound desc = could not find container \"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f\": container with ID starting with fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f not found: ID does not exist" Jul 20 10:00:50.862950 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.862930 2584 scope.go:117] "RemoveContainer" containerID="ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207" Jul 20 10:00:50.863413 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.863210 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207"} err="failed to get container status \"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207\": rpc error: code = NotFound desc = could not find container \"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207\": container with ID starting with ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207 not found: ID does not exist" Jul 20 10:00:50.863413 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.863255 2584 scope.go:117] "RemoveContainer" containerID="9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641" Jul 20 10:00:50.863744 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.863717 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641"} err="failed to get container status \"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641\": rpc error: code = NotFound desc = could not find container \"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641\": container with ID starting with 9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641 not found: ID does not exist" Jul 20 10:00:50.863744 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.863744 2584 scope.go:117] "RemoveContainer" containerID="da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e" Jul 20 10:00:50.863997 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.863976 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e"} err="failed to get container status \"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e\": rpc error: code = NotFound desc = could not find container \"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e\": container with ID starting with da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e not found: ID does not exist" Jul 20 10:00:50.864046 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.863998 2584 scope.go:117] "RemoveContainer" containerID="786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2" Jul 20 10:00:50.864232 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.864211 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2"} err="failed to get container status \"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2\": rpc error: code = NotFound desc = could not find container \"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2\": container with ID starting with 786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2 not found: ID does not exist" Jul 20 10:00:50.864232 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.864231 2584 scope.go:117] "RemoveContainer" containerID="4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7" Jul 20 10:00:50.864468 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.864451 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7"} err="failed to get container status \"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7\": rpc error: code = NotFound desc = could not find container \"4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7\": container with ID starting with 4e4c5699cea29e41e6478a0face37b44f7d229f0804eed42587f26f5aa7c08e7 not found: ID does not exist" Jul 20 10:00:50.864468 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.864467 2584 scope.go:117] "RemoveContainer" containerID="20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf" Jul 20 10:00:50.864716 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.864696 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf"} err="failed to get container status \"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf\": rpc error: code = NotFound desc = could not find container \"20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf\": container with ID starting with 20b5230ad4754163e1f2e232a74b5e1ee38e74071cc7cd8500d8ac168e104bcf not found: ID does not exist" Jul 20 10:00:50.864766 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.864716 2584 scope.go:117] "RemoveContainer" containerID="fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f" Jul 20 10:00:50.864955 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.864938 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 10:00:50.864955 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.864947 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f"} err="failed to get container status \"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f\": rpc error: code = NotFound desc = could not find container \"fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f\": container with ID starting with fd4bab5913da5340ff0cc918138f52671a4408f5ba1d8d19c766b321e553c34f not found: ID does not exist" Jul 20 10:00:50.865027 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.864961 2584 scope.go:117] "RemoveContainer" containerID="ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207" Jul 20 10:00:50.865183 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865167 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207"} err="failed to get container status \"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207\": rpc error: code = NotFound desc = could not find container \"ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207\": container with ID starting with ea348a443b24d22992b7ae0f6373bdac7bb19e6a9d75320c92046e3c67bac207 not found: ID does not exist" Jul 20 10:00:50.865227 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865184 2584 scope.go:117] "RemoveContainer" containerID="9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641" Jul 20 10:00:50.865269 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865255 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="config-reloader" Jul 20 10:00:50.865306 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865274 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="config-reloader" Jul 20 10:00:50.865306 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865285 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="kube-rbac-proxy-web" Jul 20 10:00:50.865306 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865295 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="kube-rbac-proxy-web" Jul 20 10:00:50.865407 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865305 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="kube-rbac-proxy" Jul 20 10:00:50.865407 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865315 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="kube-rbac-proxy" Jul 20 10:00:50.865407 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865329 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="init-config-reloader" Jul 20 10:00:50.865407 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865334 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="init-config-reloader" Jul 20 10:00:50.865407 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865354 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="kube-rbac-proxy-thanos" Jul 20 10:00:50.865407 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865360 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="kube-rbac-proxy-thanos" Jul 20 10:00:50.865407 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865366 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="prometheus" Jul 20 10:00:50.865407 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865375 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="prometheus" Jul 20 10:00:50.865407 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865388 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="thanos-sidecar" Jul 20 10:00:50.865407 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865394 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="thanos-sidecar" Jul 20 10:00:50.865752 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865438 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="kube-rbac-proxy-thanos" Jul 20 10:00:50.865752 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865445 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="kube-rbac-proxy" Jul 20 10:00:50.865752 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865370 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641"} err="failed to get container status \"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641\": rpc error: code = NotFound desc = could not find container \"9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641\": container with ID starting with 9f6a8008fa8706a70453c955625ff1817a4ace8d1f875ff2720677644769c641 not found: ID does not exist" Jul 20 10:00:50.865752 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865459 2584 scope.go:117] "RemoveContainer" containerID="da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e" Jul 20 10:00:50.865752 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865453 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="kube-rbac-proxy-web" Jul 20 10:00:50.865752 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865505 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="prometheus" Jul 20 10:00:50.865752 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865514 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="config-reloader" Jul 20 10:00:50.865752 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865522 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" containerName="thanos-sidecar" Jul 20 10:00:50.865752 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865704 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e"} err="failed to get container status \"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e\": rpc error: code = NotFound desc = could not find container \"da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e\": container with ID starting with da1e59c3e23ab05884734e418e67c60eebedce533baa3c920d8a0b1992bfb33e not found: ID does not exist" Jul 20 10:00:50.865752 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865728 2584 scope.go:117] "RemoveContainer" containerID="786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2" Jul 20 10:00:50.866123 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.865940 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2"} err="failed to get container status \"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2\": rpc error: code = NotFound desc = could not find container \"786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2\": container with ID starting with 786e23e01c4607d58fbc9a89d8a1c8cf2a9c6ddcd81c6984ce9798c70bb6cff2 not found: ID does not exist" Jul 20 10:00:50.869151 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.869136 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:50.872121 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.872096 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 20 10:00:50.872228 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.872151 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6g693sb9rica9\"" Jul 20 10:00:50.872228 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.872192 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 20 10:00:50.872428 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.872404 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 20 10:00:50.872575 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.872435 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-p52jm\"" Jul 20 10:00:50.872575 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.872507 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 20 10:00:50.872575 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.872512 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 20 10:00:50.872725 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.872706 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 20 10:00:50.872797 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.872771 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 20 10:00:50.872921 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.872900 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 20 10:00:50.873004 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.872973 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 20 10:00:50.873471 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.873431 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 20 10:00:50.873597 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.873581 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 20 10:00:50.873597 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.873617 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 20 10:00:50.876224 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.876204 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 20 10:00:50.877927 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.877903 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 20 10:00:50.891998 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:50.891971 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 10:00:51.025784 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.025750 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a1f7a837-68eb-4e8d-a799-611a9cc19c36-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.025784 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.025788 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1f7a837-68eb-4e8d-a799-611a9cc19c36-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.026023 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.025809 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.026023 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.025832 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.026023 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.025850 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.026023 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.025915 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.026023 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.025945 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-config\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.026023 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.025965 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-web-config\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.026293 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.026042 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.026293 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.026097 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1f7a837-68eb-4e8d-a799-611a9cc19c36-config-out\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.026293 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.026127 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.026293 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.026159 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.026293 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.026209 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmnk2\" (UniqueName: \"kubernetes.io/projected/a1f7a837-68eb-4e8d-a799-611a9cc19c36-kube-api-access-wmnk2\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.026293 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.026248 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.026293 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.026278 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.026522 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.026320 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.026522 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.026336 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.026522 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.026356 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.026522 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.026371 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.026522 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.026396 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.127426 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.127343 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1f7a837-68eb-4e8d-a799-611a9cc19c36-config-out\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.127426 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.127379 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.127426 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.127400 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.127426 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.127425 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmnk2\" (UniqueName: \"kubernetes.io/projected/a1f7a837-68eb-4e8d-a799-611a9cc19c36-kube-api-access-wmnk2\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.127720 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.127443 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.127720 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.127463 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.127720 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.127486 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.127720 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.127503 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.127720 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.127520 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.127720 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.127559 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.127720 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.127594 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.127720 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.127631 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a1f7a837-68eb-4e8d-a799-611a9cc19c36-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.127720 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.127658 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1f7a837-68eb-4e8d-a799-611a9cc19c36-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.127720 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.127682 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.127720 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.127708 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.128248 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.127735 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.128248 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.127766 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.128248 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.127793 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-config\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.128248 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.127821 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-web-config\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.128248 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.127857 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.128504 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.128360 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.128504 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.128416 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.130388 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.130293 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1f7a837-68eb-4e8d-a799-611a9cc19c36-config-out\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.131846 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.130692 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.131846 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.130702 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.131846 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.130932 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.131846 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.131117 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.131846 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.131237 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.131846 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.131274 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.131846 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.131490 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.131846 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.131702 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.131846 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.131790 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a1f7a837-68eb-4e8d-a799-611a9cc19c36-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.132357 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.131868 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.132357 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.132182 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.132357 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.132289 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1f7a837-68eb-4e8d-a799-611a9cc19c36-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.132741 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.132718 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.133033 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.133017 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-config\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.133276 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.133262 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1f7a837-68eb-4e8d-a799-611a9cc19c36-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.133563 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.133524 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1f7a837-68eb-4e8d-a799-611a9cc19c36-web-config\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.136726 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.136709 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmnk2\" (UniqueName: \"kubernetes.io/projected/a1f7a837-68eb-4e8d-a799-611a9cc19c36-kube-api-access-wmnk2\") pod \"prometheus-k8s-0\" (UID: \"a1f7a837-68eb-4e8d-a799-611a9cc19c36\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.179587 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.179519 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:51.314678 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.314650 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 10:00:51.316110 ip-10-0-142-23 kubenswrapper[2584]: W0720 10:00:51.316082 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f7a837_68eb_4e8d_a799_611a9cc19c36.slice/crio-74adad700277c51a9620b39adf19861b7c4bdd8aec2b3caf0c003660a11927a8 WatchSource:0}: Error finding container 74adad700277c51a9620b39adf19861b7c4bdd8aec2b3caf0c003660a11927a8: Status 404 returned error can't find the container with id 74adad700277c51a9620b39adf19861b7c4bdd8aec2b3caf0c003660a11927a8 Jul 20 10:00:51.807208 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.807175 2584 generic.go:356] "Generic (PLEG): container finished" podID="a1f7a837-68eb-4e8d-a799-611a9cc19c36" containerID="493a340e2f9e955b1a6cfeed7976ffffb54b23415c3baa307af9e740997e6584" exitCode=0 Jul 20 10:00:51.807743 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.807266 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1f7a837-68eb-4e8d-a799-611a9cc19c36","Type":"ContainerDied","Data":"493a340e2f9e955b1a6cfeed7976ffffb54b23415c3baa307af9e740997e6584"} Jul 20 10:00:51.807743 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:51.807357 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1f7a837-68eb-4e8d-a799-611a9cc19c36","Type":"ContainerStarted","Data":"74adad700277c51a9620b39adf19861b7c4bdd8aec2b3caf0c003660a11927a8"} Jul 20 10:00:52.810252 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:52.810214 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ff27802-e9f8-4748-8d65-f6c3e4448069" path="/var/lib/kubelet/pods/6ff27802-e9f8-4748-8d65-f6c3e4448069/volumes" Jul 20 10:00:52.815724 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:52.815692 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1f7a837-68eb-4e8d-a799-611a9cc19c36","Type":"ContainerStarted","Data":"56b046092f62ccbfd129a69753eba2440c386a1274834ee6e4ce697358a2acff"} Jul 20 10:00:52.815867 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:52.815761 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1f7a837-68eb-4e8d-a799-611a9cc19c36","Type":"ContainerStarted","Data":"caf61f52a65237ecffc6136980c3e31cc3a913d4ab54b84431095ef3a837a51a"} Jul 20 10:00:52.815867 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:52.815787 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1f7a837-68eb-4e8d-a799-611a9cc19c36","Type":"ContainerStarted","Data":"81ace90b94f00e51d2d7660e926a7115e51e5c71fec4c05271ec7ce4632ab670"} Jul 20 10:00:52.815867 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:52.815811 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1f7a837-68eb-4e8d-a799-611a9cc19c36","Type":"ContainerStarted","Data":"9487258b91c817bf7b7d0c75dbe90a6f212f3b8e06a9545ed1e408096dfb55ba"} Jul 20 10:00:52.815867 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:52.815836 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1f7a837-68eb-4e8d-a799-611a9cc19c36","Type":"ContainerStarted","Data":"7fa793e198eace5d9303a460d41cf91fffb6343a0ae9b37bc4ae58be7db5907b"} Jul 20 10:00:52.815867 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:52.815858 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1f7a837-68eb-4e8d-a799-611a9cc19c36","Type":"ContainerStarted","Data":"77c37abb67ce5f76892e614c5bbdcfddadf84a14cf910602879764626f25d5dd"} Jul 20 10:00:52.854070 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:52.854014 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.8301020120000002 podStartE2EDuration="2.853998671s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.896659ms" isStatefulPod=false podCreationTimestamp="2026-07-20 10:00:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:00:52.851460695 +0000 UTC m=+218.609285599" watchObservedRunningTime="2026-07-20 10:00:52.853998671 +0000 UTC m=+218.611823562" Jul 20 10:00:56.180321 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:00:56.180280 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:01:51.180276 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:01:51.180189 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:01:51.195286 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:01:51.195258 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:01:52.054615 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:01:52.054589 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:02:14.670075 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:02:14.670047 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:02:14.676026 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:02:14.676004 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:02:14.680403 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:02:14.680382 2584 kubelet.go:1648] "Image garbage collection succeeded" Jul 20 10:07:14.700106 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:07:14.700072 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:07:14.701063 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:07:14.701036 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:12:14.727567 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:12:14.727474 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:12:14.728867 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:12:14.728836 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:17:14.752097 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:17:14.752067 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:17:14.754220 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:17:14.754193 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:22:14.778469 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:22:14.778439 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:22:14.782551 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:22:14.782516 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:27:14.801938 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:27:14.801907 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:27:14.806934 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:27:14.806906 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:32:14.825999 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:32:14.825971 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:32:14.831984 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:32:14.831962 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:37:14.849776 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:37:14.849655 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:37:14.856620 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:37:14.856594 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:42:14.874073 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:42:14.873952 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:42:14.881309 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:42:14.881285 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:47:14.898278 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:47:14.898158 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:47:14.906317 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:47:14.906295 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:52:14.925163 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:52:14.925054 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:52:14.932434 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:52:14.932414 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:57:14.949452 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:57:14.949327 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 10:57:14.957128 ip-10-0-142-23 kubenswrapper[2584]: I0720 10:57:14.957104 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 11:02:14.974358 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:02:14.974229 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 11:02:14.981892 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:02:14.981870 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 11:07:14.998240 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:07:14.998214 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 11:07:15.005759 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:07:15.005735 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 11:12:15.022868 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:12:15.022750 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 11:12:15.030418 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:12:15.030399 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 11:17:15.046960 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:17:15.046854 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 11:17:15.054387 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:17:15.054361 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 11:19:10.626842 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:10.626810 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-49v49/must-gather-p92tx"] Jul 20 11:19:10.630053 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:10.630034 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-49v49/must-gather-p92tx" Jul 20 11:19:10.632666 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:10.632635 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-49v49\"/\"kube-root-ca.crt\"" Jul 20 11:19:10.632666 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:10.632651 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-49v49\"/\"openshift-service-ca.crt\"" Jul 20 11:19:10.637495 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:10.637473 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-49v49/must-gather-p92tx"] Jul 20 11:19:10.728634 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:10.728593 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zk75\" (UniqueName: \"kubernetes.io/projected/d4508612-d4e2-4ed4-af39-c714aa1455d9-kube-api-access-5zk75\") pod \"must-gather-p92tx\" (UID: \"d4508612-d4e2-4ed4-af39-c714aa1455d9\") " pod="openshift-must-gather-49v49/must-gather-p92tx" Jul 20 11:19:10.728813 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:10.728651 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4508612-d4e2-4ed4-af39-c714aa1455d9-must-gather-output\") pod \"must-gather-p92tx\" (UID: \"d4508612-d4e2-4ed4-af39-c714aa1455d9\") " pod="openshift-must-gather-49v49/must-gather-p92tx" Jul 20 11:19:10.830075 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:10.830037 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zk75\" (UniqueName: \"kubernetes.io/projected/d4508612-d4e2-4ed4-af39-c714aa1455d9-kube-api-access-5zk75\") pod \"must-gather-p92tx\" (UID: \"d4508612-d4e2-4ed4-af39-c714aa1455d9\") " pod="openshift-must-gather-49v49/must-gather-p92tx" Jul 20 11:19:10.830260 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:10.830108 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4508612-d4e2-4ed4-af39-c714aa1455d9-must-gather-output\") pod \"must-gather-p92tx\" (UID: \"d4508612-d4e2-4ed4-af39-c714aa1455d9\") " pod="openshift-must-gather-49v49/must-gather-p92tx" Jul 20 11:19:10.830475 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:10.830454 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4508612-d4e2-4ed4-af39-c714aa1455d9-must-gather-output\") pod \"must-gather-p92tx\" (UID: \"d4508612-d4e2-4ed4-af39-c714aa1455d9\") " pod="openshift-must-gather-49v49/must-gather-p92tx" Jul 20 11:19:10.838279 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:10.838246 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zk75\" (UniqueName: \"kubernetes.io/projected/d4508612-d4e2-4ed4-af39-c714aa1455d9-kube-api-access-5zk75\") pod \"must-gather-p92tx\" (UID: \"d4508612-d4e2-4ed4-af39-c714aa1455d9\") " pod="openshift-must-gather-49v49/must-gather-p92tx" Jul 20 11:19:10.951925 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:10.951842 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-49v49/must-gather-p92tx" Jul 20 11:19:11.082879 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:11.082816 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-49v49/must-gather-p92tx"] Jul 20 11:19:11.085073 ip-10-0-142-23 kubenswrapper[2584]: W0720 11:19:11.085048 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4508612_d4e2_4ed4_af39_c714aa1455d9.slice/crio-f7e403e11fb152a0417aa8fad5178358f851c86818bf387ab0f3665c967d2ec2 WatchSource:0}: Error finding container f7e403e11fb152a0417aa8fad5178358f851c86818bf387ab0f3665c967d2ec2: Status 404 returned error can't find the container with id f7e403e11fb152a0417aa8fad5178358f851c86818bf387ab0f3665c967d2ec2 Jul 20 11:19:11.086891 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:11.086876 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 11:19:11.673305 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:11.673260 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-49v49/must-gather-p92tx" event={"ID":"d4508612-d4e2-4ed4-af39-c714aa1455d9","Type":"ContainerStarted","Data":"f7e403e11fb152a0417aa8fad5178358f851c86818bf387ab0f3665c967d2ec2"} Jul 20 11:19:17.704634 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:17.704592 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-49v49/must-gather-p92tx" event={"ID":"d4508612-d4e2-4ed4-af39-c714aa1455d9","Type":"ContainerStarted","Data":"9a574441b79c34e4246c750976ec11efc5f09616158716e9fadeb56b2ae5e53c"} Jul 20 11:19:17.704634 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:17.704635 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-49v49/must-gather-p92tx" event={"ID":"d4508612-d4e2-4ed4-af39-c714aa1455d9","Type":"ContainerStarted","Data":"bfef35d3636761c19e9e0c3394a736f29bfd4253b09b2392ad247890db554259"} Jul 20 11:19:17.721422 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:17.721372 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-49v49/must-gather-p92tx" podStartSLOduration=1.559221286 podStartE2EDuration="7.72135642s" totalImagesPullingTime="6.162135134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 11:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 11:19:17.719673049 +0000 UTC m=+4923.477497934" watchObservedRunningTime="2026-07-20 11:19:17.72135642 +0000 UTC m=+4923.479181310" Jul 20 11:19:41.812063 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:41.812027 2584 generic.go:356] "Generic (PLEG): container finished" podID="d4508612-d4e2-4ed4-af39-c714aa1455d9" containerID="bfef35d3636761c19e9e0c3394a736f29bfd4253b09b2392ad247890db554259" exitCode=0 Jul 20 11:19:41.812602 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:41.812106 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-49v49/must-gather-p92tx" event={"ID":"d4508612-d4e2-4ed4-af39-c714aa1455d9","Type":"ContainerDied","Data":"bfef35d3636761c19e9e0c3394a736f29bfd4253b09b2392ad247890db554259"} Jul 20 11:19:41.812602 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:41.812484 2584 scope.go:117] "RemoveContainer" containerID="bfef35d3636761c19e9e0c3394a736f29bfd4253b09b2392ad247890db554259" Jul 20 11:19:42.651138 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:42.651106 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-49v49_must-gather-p92tx_d4508612-d4e2-4ed4-af39-c714aa1455d9/gather/0.log" Jul 20 11:19:46.125125 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:46.125093 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jb6t4_ed82fcf6-9e23-4480-ab33-68ca1d46dfaf/global-pull-secret-syncer/0.log" Jul 20 11:19:46.311157 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:46.311123 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rlg4l_fafee4ad-5222-403d-980f-5f9f21422ced/konnectivity-agent/0.log" Jul 20 11:19:46.374132 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:46.374104 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-23.ec2.internal_d159dfd7e8915df45f4573e327fe646c/haproxy/0.log" Jul 20 11:19:48.189044 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.189011 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-49v49/must-gather-p92tx"] Jul 20 11:19:48.189596 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.189203 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-49v49/must-gather-p92tx" podUID="d4508612-d4e2-4ed4-af39-c714aa1455d9" containerName="copy" containerID="cri-o://9a574441b79c34e4246c750976ec11efc5f09616158716e9fadeb56b2ae5e53c" gracePeriod=2 Jul 20 11:19:48.191837 ip-10-0-142-23 kubenswrapper[2584]: E0720 11:19:48.191795 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-p92tx\" is forbidden: User \"system:node:ip-10-0-142-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-49v49\": no relationship found between node 'ip-10-0-142-23.ec2.internal' and this object" podUID="d4508612-d4e2-4ed4-af39-c714aa1455d9" pod="openshift-must-gather-49v49/must-gather-p92tx" Jul 20 11:19:48.192065 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.192036 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-49v49/must-gather-p92tx"] Jul 20 11:19:48.419385 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.419364 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-49v49_must-gather-p92tx_d4508612-d4e2-4ed4-af39-c714aa1455d9/copy/0.log" Jul 20 11:19:48.420871 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.420853 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-49v49/must-gather-p92tx" Jul 20 11:19:48.423216 ip-10-0-142-23 kubenswrapper[2584]: E0720 11:19:48.423191 2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-p92tx\" is forbidden: User \"system:node:ip-10-0-142-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-49v49\": no relationship found between node 'ip-10-0-142-23.ec2.internal' and this object" podUID="d4508612-d4e2-4ed4-af39-c714aa1455d9" pod="openshift-must-gather-49v49/must-gather-p92tx" Jul 20 11:19:48.468822 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.468750 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4508612-d4e2-4ed4-af39-c714aa1455d9-must-gather-output\") pod \"d4508612-d4e2-4ed4-af39-c714aa1455d9\" (UID: \"d4508612-d4e2-4ed4-af39-c714aa1455d9\") " Jul 20 11:19:48.468822 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.468822 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zk75\" (UniqueName: \"kubernetes.io/projected/d4508612-d4e2-4ed4-af39-c714aa1455d9-kube-api-access-5zk75\") pod \"d4508612-d4e2-4ed4-af39-c714aa1455d9\" (UID: \"d4508612-d4e2-4ed4-af39-c714aa1455d9\") " Jul 20 11:19:48.470326 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.470302 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4508612-d4e2-4ed4-af39-c714aa1455d9-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "d4508612-d4e2-4ed4-af39-c714aa1455d9" (UID: "d4508612-d4e2-4ed4-af39-c714aa1455d9"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 11:19:48.471063 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.471040 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4508612-d4e2-4ed4-af39-c714aa1455d9-kube-api-access-5zk75" (OuterVolumeSpecName: "kube-api-access-5zk75") pod "d4508612-d4e2-4ed4-af39-c714aa1455d9" (UID: "d4508612-d4e2-4ed4-af39-c714aa1455d9"). InnerVolumeSpecName "kube-api-access-5zk75". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 11:19:48.569664 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.569624 2584 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4508612-d4e2-4ed4-af39-c714aa1455d9-must-gather-output\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 11:19:48.569664 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.569657 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zk75\" (UniqueName: \"kubernetes.io/projected/d4508612-d4e2-4ed4-af39-c714aa1455d9-kube-api-access-5zk75\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\"" Jul 20 11:19:48.809971 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.809937 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4508612-d4e2-4ed4-af39-c714aa1455d9" path="/var/lib/kubelet/pods/d4508612-d4e2-4ed4-af39-c714aa1455d9/volumes" Jul 20 11:19:48.840416 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.840391 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-49v49_must-gather-p92tx_d4508612-d4e2-4ed4-af39-c714aa1455d9/copy/0.log" Jul 20 11:19:48.840784 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.840752 2584 generic.go:356] "Generic (PLEG): container finished" podID="d4508612-d4e2-4ed4-af39-c714aa1455d9" containerID="9a574441b79c34e4246c750976ec11efc5f09616158716e9fadeb56b2ae5e53c" exitCode=143 Jul 20 11:19:48.840922 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.840792 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-49v49/must-gather-p92tx" Jul 20 11:19:48.840922 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.840851 2584 scope.go:117] "RemoveContainer" containerID="9a574441b79c34e4246c750976ec11efc5f09616158716e9fadeb56b2ae5e53c" Jul 20 11:19:48.848744 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.848721 2584 scope.go:117] "RemoveContainer" containerID="bfef35d3636761c19e9e0c3394a736f29bfd4253b09b2392ad247890db554259" Jul 20 11:19:48.860853 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.860835 2584 scope.go:117] "RemoveContainer" containerID="9a574441b79c34e4246c750976ec11efc5f09616158716e9fadeb56b2ae5e53c" Jul 20 11:19:48.861155 ip-10-0-142-23 kubenswrapper[2584]: E0720 11:19:48.861137 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a574441b79c34e4246c750976ec11efc5f09616158716e9fadeb56b2ae5e53c\": container with ID starting with 9a574441b79c34e4246c750976ec11efc5f09616158716e9fadeb56b2ae5e53c not found: ID does not exist" containerID="9a574441b79c34e4246c750976ec11efc5f09616158716e9fadeb56b2ae5e53c" Jul 20 11:19:48.861202 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.861165 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a574441b79c34e4246c750976ec11efc5f09616158716e9fadeb56b2ae5e53c"} err="failed to get container status \"9a574441b79c34e4246c750976ec11efc5f09616158716e9fadeb56b2ae5e53c\": rpc error: code = NotFound desc = could not find container \"9a574441b79c34e4246c750976ec11efc5f09616158716e9fadeb56b2ae5e53c\": container with ID starting with 9a574441b79c34e4246c750976ec11efc5f09616158716e9fadeb56b2ae5e53c not found: ID does not exist" Jul 20 11:19:48.861202 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.861185 2584 scope.go:117] "RemoveContainer" containerID="bfef35d3636761c19e9e0c3394a736f29bfd4253b09b2392ad247890db554259" Jul 20 11:19:48.861411 ip-10-0-142-23 kubenswrapper[2584]: E0720 11:19:48.861393 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfef35d3636761c19e9e0c3394a736f29bfd4253b09b2392ad247890db554259\": container with ID starting with bfef35d3636761c19e9e0c3394a736f29bfd4253b09b2392ad247890db554259 not found: ID does not exist" containerID="bfef35d3636761c19e9e0c3394a736f29bfd4253b09b2392ad247890db554259" Jul 20 11:19:48.861455 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:48.861421 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfef35d3636761c19e9e0c3394a736f29bfd4253b09b2392ad247890db554259"} err="failed to get container status \"bfef35d3636761c19e9e0c3394a736f29bfd4253b09b2392ad247890db554259\": rpc error: code = NotFound desc = could not find container \"bfef35d3636761c19e9e0c3394a736f29bfd4253b09b2392ad247890db554259\": container with ID starting with bfef35d3636761c19e9e0c3394a736f29bfd4253b09b2392ad247890db554259 not found: ID does not exist" Jul 20 11:19:50.028531 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:50.028502 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8da78283-fca0-4357-8133-82d34813d5fb/alertmanager/0.log" Jul 20 11:19:50.057200 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:50.057173 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8da78283-fca0-4357-8133-82d34813d5fb/config-reloader/0.log" Jul 20 11:19:50.089305 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:50.089281 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8da78283-fca0-4357-8133-82d34813d5fb/kube-rbac-proxy-web/0.log" Jul 20 11:19:50.129592 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:50.129564 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8da78283-fca0-4357-8133-82d34813d5fb/kube-rbac-proxy/0.log" Jul 20 11:19:50.166332 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:50.166313 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8da78283-fca0-4357-8133-82d34813d5fb/kube-rbac-proxy-metric/0.log" Jul 20 11:19:50.198636 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:50.198612 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8da78283-fca0-4357-8133-82d34813d5fb/prom-label-proxy/0.log" Jul 20 11:19:50.241492 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:50.241465 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8da78283-fca0-4357-8133-82d34813d5fb/init-config-reloader/0.log" Jul 20 11:19:50.297652 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:50.297581 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-gnhqb_842b54d2-d9e9-40fc-b879-9f0a9eb80998/cluster-monitoring-operator/0.log" Jul 20 11:19:50.417492 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:50.417462 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5db8456c6b-npwkv_158aa05c-7e01-4812-a7ca-268d0863f0af/metrics-server/0.log" Jul 20 11:19:50.497919 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:50.497891 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hprfm_03c014fd-c304-4b95-b283-e147474e515b/node-exporter/0.log" Jul 20 11:19:50.526970 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:50.526941 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hprfm_03c014fd-c304-4b95-b283-e147474e515b/kube-rbac-proxy/0.log" Jul 20 11:19:50.550979 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:50.550920 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hprfm_03c014fd-c304-4b95-b283-e147474e515b/init-textfile/0.log" Jul 20 11:19:50.834101 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:50.834000 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a1f7a837-68eb-4e8d-a799-611a9cc19c36/prometheus/0.log" Jul 20 11:19:50.858529 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:50.858502 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a1f7a837-68eb-4e8d-a799-611a9cc19c36/config-reloader/0.log" Jul 20 11:19:50.883718 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:50.883694 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a1f7a837-68eb-4e8d-a799-611a9cc19c36/thanos-sidecar/0.log" Jul 20 11:19:50.906780 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:50.906757 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a1f7a837-68eb-4e8d-a799-611a9cc19c36/kube-rbac-proxy-web/0.log" Jul 20 11:19:50.929107 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:50.929080 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a1f7a837-68eb-4e8d-a799-611a9cc19c36/kube-rbac-proxy/0.log" Jul 20 11:19:50.960946 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:50.960917 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a1f7a837-68eb-4e8d-a799-611a9cc19c36/kube-rbac-proxy-thanos/0.log" Jul 20 11:19:50.996830 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:50.996807 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a1f7a837-68eb-4e8d-a799-611a9cc19c36/init-config-reloader/0.log" Jul 20 11:19:51.193616 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:51.193525 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4bcdd898-c9278_2b8035d1-32a8-4a34-b8e7-b8d8e0021016/thanos-query/0.log" Jul 20 11:19:51.213353 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:51.213330 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4bcdd898-c9278_2b8035d1-32a8-4a34-b8e7-b8d8e0021016/kube-rbac-proxy-web/0.log" Jul 20 11:19:51.232499 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:51.232478 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4bcdd898-c9278_2b8035d1-32a8-4a34-b8e7-b8d8e0021016/kube-rbac-proxy/0.log" Jul 20 11:19:51.259864 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:51.254985 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4bcdd898-c9278_2b8035d1-32a8-4a34-b8e7-b8d8e0021016/prom-label-proxy/0.log" Jul 20 11:19:51.275159 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:51.275128 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4bcdd898-c9278_2b8035d1-32a8-4a34-b8e7-b8d8e0021016/kube-rbac-proxy-rules/0.log" Jul 20 11:19:51.302218 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:51.302194 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4bcdd898-c9278_2b8035d1-32a8-4a34-b8e7-b8d8e0021016/kube-rbac-proxy-metrics/0.log" Jul 20 11:19:53.143402 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:53.143367 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/1.log" Jul 20 11:19:53.148985 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:53.148963 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-pqsvb_1a0f88a7-90c0-44ad-9922-4cfd2b371e0d/console-operator/2.log" Jul 20 11:19:54.725270 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.725235 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v"] Jul 20 11:19:54.725738 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.725550 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4508612-d4e2-4ed4-af39-c714aa1455d9" containerName="copy" Jul 20 11:19:54.725738 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.725562 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4508612-d4e2-4ed4-af39-c714aa1455d9" containerName="copy" Jul 20 11:19:54.725738 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.725578 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4508612-d4e2-4ed4-af39-c714aa1455d9" containerName="gather" Jul 20 11:19:54.725738 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.725584 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4508612-d4e2-4ed4-af39-c714aa1455d9" containerName="gather" Jul 20 11:19:54.725738 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.725649 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4508612-d4e2-4ed4-af39-c714aa1455d9" containerName="gather" Jul 20 11:19:54.725738 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.725659 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4508612-d4e2-4ed4-af39-c714aa1455d9" containerName="copy" Jul 20 11:19:54.730906 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.730885 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" Jul 20 11:19:54.733725 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.733707 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p54z8\"/\"openshift-service-ca.crt\"" Jul 20 11:19:54.733932 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.733919 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p54z8\"/\"kube-root-ca.crt\"" Jul 20 11:19:54.735119 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.735103 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p54z8\"/\"default-dockercfg-5bcv8\"" Jul 20 11:19:54.738013 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.737996 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v"] Jul 20 11:19:54.820124 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.820091 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c17fc203-4889-42f1-8a86-5f8e883617e3-lib-modules\") pod \"perf-node-gather-daemonset-dsh9v\" (UID: \"c17fc203-4889-42f1-8a86-5f8e883617e3\") " pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" Jul 20 11:19:54.820124 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.820123 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c17fc203-4889-42f1-8a86-5f8e883617e3-sys\") pod \"perf-node-gather-daemonset-dsh9v\" (UID: \"c17fc203-4889-42f1-8a86-5f8e883617e3\") " pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" Jul 20 11:19:54.820335 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.820159 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c17fc203-4889-42f1-8a86-5f8e883617e3-proc\") pod \"perf-node-gather-daemonset-dsh9v\" (UID: \"c17fc203-4889-42f1-8a86-5f8e883617e3\") " pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" Jul 20 11:19:54.820335 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.820249 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c17fc203-4889-42f1-8a86-5f8e883617e3-podres\") pod \"perf-node-gather-daemonset-dsh9v\" (UID: \"c17fc203-4889-42f1-8a86-5f8e883617e3\") " pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" Jul 20 11:19:54.820335 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.820277 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqndb\" (UniqueName: \"kubernetes.io/projected/c17fc203-4889-42f1-8a86-5f8e883617e3-kube-api-access-hqndb\") pod \"perf-node-gather-daemonset-dsh9v\" (UID: \"c17fc203-4889-42f1-8a86-5f8e883617e3\") " pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" Jul 20 11:19:54.921094 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.921061 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c17fc203-4889-42f1-8a86-5f8e883617e3-proc\") pod \"perf-node-gather-daemonset-dsh9v\" (UID: \"c17fc203-4889-42f1-8a86-5f8e883617e3\") " pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" Jul 20 11:19:54.921271 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.921116 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c17fc203-4889-42f1-8a86-5f8e883617e3-podres\") pod \"perf-node-gather-daemonset-dsh9v\" (UID: \"c17fc203-4889-42f1-8a86-5f8e883617e3\") " pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" Jul 20 11:19:54.921271 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.921140 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqndb\" (UniqueName: \"kubernetes.io/projected/c17fc203-4889-42f1-8a86-5f8e883617e3-kube-api-access-hqndb\") pod \"perf-node-gather-daemonset-dsh9v\" (UID: \"c17fc203-4889-42f1-8a86-5f8e883617e3\") " pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" Jul 20 11:19:54.921271 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.921195 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c17fc203-4889-42f1-8a86-5f8e883617e3-lib-modules\") pod \"perf-node-gather-daemonset-dsh9v\" (UID: \"c17fc203-4889-42f1-8a86-5f8e883617e3\") " pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" Jul 20 11:19:54.921271 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.921197 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c17fc203-4889-42f1-8a86-5f8e883617e3-proc\") pod \"perf-node-gather-daemonset-dsh9v\" (UID: \"c17fc203-4889-42f1-8a86-5f8e883617e3\") " pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" Jul 20 11:19:54.921271 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.921218 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c17fc203-4889-42f1-8a86-5f8e883617e3-sys\") pod \"perf-node-gather-daemonset-dsh9v\" (UID: \"c17fc203-4889-42f1-8a86-5f8e883617e3\") " pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" Jul 20 11:19:54.921271 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.921255 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c17fc203-4889-42f1-8a86-5f8e883617e3-podres\") pod \"perf-node-gather-daemonset-dsh9v\" (UID: \"c17fc203-4889-42f1-8a86-5f8e883617e3\") " pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" Jul 20 11:19:54.921590 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.921297 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c17fc203-4889-42f1-8a86-5f8e883617e3-sys\") pod \"perf-node-gather-daemonset-dsh9v\" (UID: \"c17fc203-4889-42f1-8a86-5f8e883617e3\") " pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" Jul 20 11:19:54.921590 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.921382 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c17fc203-4889-42f1-8a86-5f8e883617e3-lib-modules\") pod \"perf-node-gather-daemonset-dsh9v\" (UID: \"c17fc203-4889-42f1-8a86-5f8e883617e3\") " pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" Jul 20 11:19:54.935923 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:54.935892 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqndb\" (UniqueName: \"kubernetes.io/projected/c17fc203-4889-42f1-8a86-5f8e883617e3-kube-api-access-hqndb\") pod \"perf-node-gather-daemonset-dsh9v\" (UID: \"c17fc203-4889-42f1-8a86-5f8e883617e3\") " pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" Jul 20 11:19:55.041033 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:55.040994 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" Jul 20 11:19:55.089552 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:55.089202 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vw52w_ff533437-340c-4587-98de-04091941072f/dns/0.log" Jul 20 11:19:55.125873 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:55.125805 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vw52w_ff533437-340c-4587-98de-04091941072f/kube-rbac-proxy/0.log" Jul 20 11:19:55.166676 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:55.166653 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v"] Jul 20 11:19:55.168915 ip-10-0-142-23 kubenswrapper[2584]: W0720 11:19:55.168890 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc17fc203_4889_42f1_8a86_5f8e883617e3.slice/crio-4e3b026fadf54cc3b3408f54cafa53fbcfdeddc568d9614bfdaf38f31edaf3be WatchSource:0}: Error finding container 4e3b026fadf54cc3b3408f54cafa53fbcfdeddc568d9614bfdaf38f31edaf3be: Status 404 returned error can't find the container with id 4e3b026fadf54cc3b3408f54cafa53fbcfdeddc568d9614bfdaf38f31edaf3be Jul 20 11:19:55.187661 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:55.187636 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s6shl_dcff7929-ba73-40b0-96ab-f83447015d94/dns-node-resolver/0.log" Jul 20 11:19:55.677975 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:55.677947 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7454d87f88-2jwtz_bfa25a95-6dfd-43a6-83e4-02984ae58a0c/registry/0.log" Jul 20 11:19:55.733716 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:55.733688 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2mf8j_45c3ada5-0fc6-47ad-b198-45040191642e/node-ca/0.log" Jul 20 11:19:55.869524 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:55.869486 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" event={"ID":"c17fc203-4889-42f1-8a86-5f8e883617e3","Type":"ContainerStarted","Data":"e99576ed84354d0649728e4ac1101c44892a51f30f40f2c6e340f36b2812099a"} Jul 20 11:19:55.869719 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:55.869602 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" Jul 20 11:19:55.869719 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:55.869626 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" event={"ID":"c17fc203-4889-42f1-8a86-5f8e883617e3","Type":"ContainerStarted","Data":"4e3b026fadf54cc3b3408f54cafa53fbcfdeddc568d9614bfdaf38f31edaf3be"} Jul 20 11:19:55.888015 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:55.887950 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" podStartSLOduration=1.887933205 podStartE2EDuration="1.887933205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 11:19:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 11:19:55.886394268 +0000 UTC m=+4961.644219153" watchObservedRunningTime="2026-07-20 11:19:55.887933205 +0000 UTC m=+4961.645758097" Jul 20 11:19:56.511271 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:56.511244 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-999d75578-sn452_0804cfeb-f931-49da-ad64-d62bcd2f8503/router/0.log" Jul 20 11:19:56.841955 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:56.841875 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ckr5n_67690331-05ca-4498-bc34-96466d9078ee/serve-healthcheck-canary/0.log" Jul 20 11:19:57.287314 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:57.287279 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-spn8c_1175aa8c-e324-496a-a96f-146cd4d65de4/kube-rbac-proxy/0.log" Jul 20 11:19:57.308082 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:57.308060 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-spn8c_1175aa8c-e324-496a-a96f-146cd4d65de4/exporter/0.log" Jul 20 11:19:57.325983 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:19:57.325955 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-spn8c_1175aa8c-e324-496a-a96f-146cd4d65de4/extractor/0.log" Jul 20 11:20:01.883286 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:01.883259 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p54z8/perf-node-gather-daemonset-dsh9v" Jul 20 11:20:03.776590 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:03.776556 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-lmzv4_90ab6ed5-a750-4bbf-b007-80991b42a435/migrator/0.log" Jul 20 11:20:03.794639 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:03.794558 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-lmzv4_90ab6ed5-a750-4bbf-b007-80991b42a435/graceful-termination/0.log" Jul 20 11:20:05.032331 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:05.032304 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h2xdk_d6a09d1a-3a7b-43c6-9dbf-382dc473bc64/kube-multus-additional-cni-plugins/0.log" Jul 20 11:20:05.061697 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:05.061672 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h2xdk_d6a09d1a-3a7b-43c6-9dbf-382dc473bc64/egress-router-binary-copy/0.log" Jul 20 11:20:05.080719 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:05.080693 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h2xdk_d6a09d1a-3a7b-43c6-9dbf-382dc473bc64/cni-plugins/0.log" Jul 20 11:20:05.099364 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:05.099331 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h2xdk_d6a09d1a-3a7b-43c6-9dbf-382dc473bc64/bond-cni-plugin/0.log" Jul 20 11:20:05.117248 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:05.117224 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h2xdk_d6a09d1a-3a7b-43c6-9dbf-382dc473bc64/routeoverride-cni/0.log" Jul 20 11:20:05.136011 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:05.135991 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h2xdk_d6a09d1a-3a7b-43c6-9dbf-382dc473bc64/whereabouts-cni-bincopy/0.log" Jul 20 11:20:05.155014 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:05.154992 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h2xdk_d6a09d1a-3a7b-43c6-9dbf-382dc473bc64/whereabouts-cni/0.log" Jul 20 11:20:05.560345 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:05.560315 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-phtmd_d3731182-2536-4d68-bbba-b082e162e6b9/kube-multus/0.log" Jul 20 11:20:05.580584 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:05.580557 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gx8gs_cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f/network-metrics-daemon/0.log" Jul 20 11:20:05.601361 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:05.601333 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gx8gs_cb02b524-e30b-4fbc-af9f-3b6b61c4cc5f/kube-rbac-proxy/0.log" Jul 20 11:20:06.637638 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:06.637608 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmnb2_b77339f6-cf2e-4381-991d-af590d424ed0/ovn-controller/0.log" Jul 20 11:20:06.653606 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:06.653511 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmnb2_b77339f6-cf2e-4381-991d-af590d424ed0/ovn-acl-logging/0.log" Jul 20 11:20:06.675983 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:06.675957 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmnb2_b77339f6-cf2e-4381-991d-af590d424ed0/kube-rbac-proxy-node/0.log" Jul 20 11:20:06.695030 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:06.695009 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmnb2_b77339f6-cf2e-4381-991d-af590d424ed0/kube-rbac-proxy-ovn-metrics/0.log" Jul 20 11:20:06.712343 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:06.712320 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmnb2_b77339f6-cf2e-4381-991d-af590d424ed0/northd/0.log" Jul 20 11:20:06.731293 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:06.731273 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmnb2_b77339f6-cf2e-4381-991d-af590d424ed0/nbdb/0.log" Jul 20 11:20:06.750719 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:06.750697 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmnb2_b77339f6-cf2e-4381-991d-af590d424ed0/sbdb/0.log" Jul 20 11:20:06.790566 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:06.790523 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmnb2_b77339f6-cf2e-4381-991d-af590d424ed0/ovnkube-controller/0.log" Jul 20 11:20:07.903791 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:07.903766 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7bc5b6bf85-7dgrt_b51212bd-b9d6-498a-abf2-90e242002526/check-endpoints/0.log" Jul 20 11:20:07.924327 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:07.924305 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-dvtzz_7d66f714-a387-4064-a9b6-95fb006c732a/network-check-target-container/0.log" Jul 20 11:20:08.871234 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:08.871209 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-ndwhk_4c045356-44fb-4116-97c9-1a9897f93447/iptables-alerter/0.log" Jul 20 11:20:09.426330 ip-10-0-142-23 kubenswrapper[2584]: I0720 11:20:09.426298 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-c7jvr_1855f72b-9815-46c5-9598-8527e45d7ed7/tuned/0.log"