Jul 21 18:20:22.656588 ip-10-0-140-156 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 21 18:20:22.656600 ip-10-0-140-156 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 21 18:20:22.656610 ip-10-0-140-156 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 21 18:20:22.656884 ip-10-0-140-156 systemd[1]: Failed to start Kubernetes Kubelet. Jul 21 18:20:32.828538 ip-10-0-140-156 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 21 18:20:32.828557 ip-10-0-140-156 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 716631aecc18460d9e237bbc41610a07 -- Jul 21 18:22:32.106075 ip-10-0-140-156 systemd[1]: Starting Kubernetes Kubelet... Jul 21 18:22:33.686624 ip-10-0-140-156 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 18:22:33.686624 ip-10-0-140-156 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 21 18:22:33.686624 ip-10-0-140-156 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 18:22:33.686624 ip-10-0-140-156 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 21 18:22:33.686624 ip-10-0-140-156 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 18:22:33.686624 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.685962 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 21 18:22:33.792157 ip-10-0-140-156 systemd[1]: Started Kubernetes Kubelet. Jul 21 18:22:33.802985 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702052 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 18:22:33.802985 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702071 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 18:22:33.802985 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702075 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 18:22:33.802985 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702078 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 18:22:33.802985 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702082 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 18:22:33.802985 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702084 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 18:22:33.802985 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702088 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 18:22:33.802985 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702090 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 18:22:33.802985 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702095 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 18:22:33.802985 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702099 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 18:22:33.802985 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702101 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 18:22:33.802985 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702104 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 18:22:33.802985 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702107 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 18:22:33.802985 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702111 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 18:22:33.802985 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702113 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 18:22:33.802985 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702116 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 18:22:33.802985 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702119 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 18:22:33.802985 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702122 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 18:22:33.802985 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702125 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 18:22:33.802985 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702128 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 18:22:33.804040 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702130 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 18:22:33.804040 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702133 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 18:22:33.804040 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702136 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 18:22:33.804040 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702139 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 18:22:33.804040 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702142 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 18:22:33.804040 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702144 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 18:22:33.804040 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702147 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 18:22:33.804040 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702149 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 18:22:33.804040 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702152 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 18:22:33.804040 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702154 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 18:22:33.804040 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702156 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 18:22:33.804040 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702159 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 18:22:33.804040 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702167 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 18:22:33.804040 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702170 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 18:22:33.804040 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702172 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 18:22:33.804040 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702175 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 18:22:33.804040 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702177 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 18:22:33.804040 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702180 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 18:22:33.804040 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702183 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 18:22:33.804040 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702185 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 18:22:33.805313 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702188 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 18:22:33.805313 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702191 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 18:22:33.805313 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702193 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 18:22:33.805313 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702198 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 18:22:33.805313 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702202 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 18:22:33.805313 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702207 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 18:22:33.805313 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702210 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 18:22:33.805313 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702213 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 18:22:33.805313 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702216 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 18:22:33.805313 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702218 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 18:22:33.805313 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702221 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 18:22:33.805313 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702224 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 18:22:33.805313 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702227 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 18:22:33.805313 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702230 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 18:22:33.805313 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702232 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 18:22:33.805313 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702235 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 18:22:33.805313 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702249 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 18:22:33.805313 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702252 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 18:22:33.805313 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702255 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 18:22:33.805313 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702258 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 18:22:33.806179 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702261 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 18:22:33.806179 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702263 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 18:22:33.806179 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702266 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 18:22:33.806179 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702269 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 18:22:33.806179 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702272 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 18:22:33.806179 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702274 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 18:22:33.806179 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702276 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 18:22:33.806179 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702279 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 18:22:33.806179 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702282 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 18:22:33.806179 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702284 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 21 18:22:33.806179 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702287 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 18:22:33.806179 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702292 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 18:22:33.806179 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702295 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 18:22:33.806179 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702298 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 18:22:33.806179 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702300 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 18:22:33.806179 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702303 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 18:22:33.806179 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702306 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 18:22:33.806179 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702309 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 18:22:33.806179 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702312 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 18:22:33.807367 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702314 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 18:22:33.807367 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702318 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 18:22:33.807367 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702322 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 18:22:33.807367 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702325 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 18:22:33.807367 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702330 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 18:22:33.807367 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702333 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 18:22:33.807367 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702336 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 18:22:33.807367 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702338 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 18:22:33.807367 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702341 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 18:22:33.807367 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702343 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 18:22:33.807367 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702346 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 18:22:33.807367 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702349 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 18:22:33.807367 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702352 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 18:22:33.807367 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702355 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 18:22:33.807367 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702357 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 18:22:33.807367 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702360 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 18:22:33.807367 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702362 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 18:22:33.807367 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702365 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 18:22:33.807367 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702367 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 18:22:33.809550 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.702370 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 18:22:33.809550 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703119 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 18:22:33.809550 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703127 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 18:22:33.809550 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703131 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 18:22:33.809550 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703134 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 18:22:33.809550 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703137 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 18:22:33.809550 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703140 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 18:22:33.809550 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703142 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 18:22:33.809550 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703145 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 18:22:33.809550 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703148 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 18:22:33.809550 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703152 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 18:22:33.809550 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703156 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 18:22:33.809550 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703160 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 18:22:33.809550 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703163 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 18:22:33.809550 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703167 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 18:22:33.809550 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703170 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 18:22:33.809550 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703174 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 18:22:33.809550 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703176 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 18:22:33.809550 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703183 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 18:22:33.810636 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703186 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 18:22:33.810636 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703189 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 18:22:33.810636 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703192 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 18:22:33.810636 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703195 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 18:22:33.810636 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703198 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 18:22:33.810636 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703200 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 18:22:33.810636 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703203 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 18:22:33.810636 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703206 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 18:22:33.810636 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703208 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 18:22:33.810636 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703211 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 18:22:33.810636 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703213 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 18:22:33.810636 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703216 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 18:22:33.810636 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703219 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 18:22:33.810636 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703221 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 18:22:33.810636 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703224 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 18:22:33.810636 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703227 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 18:22:33.810636 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703229 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 18:22:33.810636 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703232 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 18:22:33.810636 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703234 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 18:22:33.812582 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703237 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 18:22:33.812582 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703240 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 18:22:33.812582 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703242 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 18:22:33.812582 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703245 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 18:22:33.812582 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703247 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 18:22:33.812582 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703250 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 18:22:33.812582 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703253 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 18:22:33.812582 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703256 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 18:22:33.812582 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703259 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 18:22:33.812582 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703262 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 18:22:33.812582 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703265 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 18:22:33.812582 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703268 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 18:22:33.812582 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703272 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 18:22:33.812582 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703275 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 18:22:33.812582 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703277 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 18:22:33.812582 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703280 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 21 18:22:33.812582 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703283 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 18:22:33.812582 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703285 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 18:22:33.812582 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703288 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 18:22:33.812582 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703291 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 18:22:33.813184 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703293 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 18:22:33.813184 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703296 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 18:22:33.813184 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703299 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 18:22:33.813184 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703301 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 18:22:33.813184 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703303 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 18:22:33.813184 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703306 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 18:22:33.813184 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703309 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 18:22:33.813184 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703311 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 18:22:33.813184 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703314 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 18:22:33.813184 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703316 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 18:22:33.813184 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703319 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 18:22:33.813184 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703321 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 18:22:33.813184 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703324 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 18:22:33.813184 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703326 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 18:22:33.813184 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703329 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 18:22:33.813184 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703332 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 18:22:33.813184 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703335 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 18:22:33.813184 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703337 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 18:22:33.813184 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703340 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 18:22:33.813184 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703342 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 18:22:33.814446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703345 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 18:22:33.814446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703348 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 18:22:33.814446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703350 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 18:22:33.814446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703353 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 18:22:33.814446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703355 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 18:22:33.814446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703358 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 18:22:33.814446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703361 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 18:22:33.814446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703364 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 18:22:33.814446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703366 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 18:22:33.814446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703369 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 18:22:33.814446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703371 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 18:22:33.814446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703374 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 18:22:33.814446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703376 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 18:22:33.814446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703378 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 18:22:33.814446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703381 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 18:22:33.814446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703383 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 18:22:33.814446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703386 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 18:22:33.814446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703389 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 18:22:33.814446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703391 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 18:22:33.814446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703393 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 18:22:33.815082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703397 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 18:22:33.815082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703399 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 18:22:33.815082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703831 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 18:22:33.815082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703837 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 18:22:33.815082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703840 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 18:22:33.815082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703843 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 18:22:33.815082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703846 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 18:22:33.815082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703849 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 18:22:33.815082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703851 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 18:22:33.815082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703854 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 18:22:33.815082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703856 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 18:22:33.815082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703859 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 18:22:33.815082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703862 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 18:22:33.815082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703865 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 18:22:33.815082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703868 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 18:22:33.815082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703870 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 18:22:33.815082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703873 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 18:22:33.815082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703876 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 18:22:33.815082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703886 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 18:22:33.815082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703889 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 18:22:33.815942 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703891 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 18:22:33.815942 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703894 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 18:22:33.815942 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703896 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 18:22:33.815942 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703899 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 18:22:33.815942 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703904 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 18:22:33.815942 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703907 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 18:22:33.815942 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703910 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 18:22:33.815942 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703914 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 18:22:33.815942 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703916 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 18:22:33.815942 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703919 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 18:22:33.815942 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703921 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 18:22:33.815942 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703924 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 18:22:33.815942 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703928 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 18:22:33.815942 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703932 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 18:22:33.815942 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703935 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 18:22:33.815942 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703938 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 18:22:33.815942 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703941 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 18:22:33.815942 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703943 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 18:22:33.815942 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703946 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 18:22:33.816583 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703949 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 18:22:33.816583 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703951 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 18:22:33.816583 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703954 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 18:22:33.816583 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703956 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 18:22:33.816583 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703959 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 18:22:33.816583 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703962 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 18:22:33.816583 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703965 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 18:22:33.816583 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703968 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 18:22:33.816583 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703970 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 18:22:33.816583 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703973 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 18:22:33.816583 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703975 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 18:22:33.816583 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703978 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 18:22:33.816583 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703981 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 18:22:33.816583 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703983 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 18:22:33.816583 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703986 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 18:22:33.816583 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703988 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 18:22:33.816583 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703991 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 18:22:33.816583 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703993 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 18:22:33.816583 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.703996 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 18:22:33.817206 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704000 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 18:22:33.817206 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704005 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 18:22:33.817206 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704008 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 18:22:33.817206 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704011 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 18:22:33.817206 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704014 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 18:22:33.817206 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704017 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 18:22:33.817206 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704020 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 18:22:33.817206 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704023 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 18:22:33.817206 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704026 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 18:22:33.817206 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704028 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 18:22:33.817206 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704031 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 18:22:33.817206 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704052 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 18:22:33.817206 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704056 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 18:22:33.817206 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704060 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 18:22:33.817206 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704063 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 18:22:33.817206 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704066 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 18:22:33.817206 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704069 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 18:22:33.817206 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704072 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 18:22:33.817206 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704075 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 18:22:33.817824 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704077 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 18:22:33.817824 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704080 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 18:22:33.817824 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704083 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 18:22:33.817824 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704085 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 18:22:33.817824 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704090 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 18:22:33.817824 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704092 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 18:22:33.817824 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704095 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 18:22:33.817824 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704098 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 18:22:33.817824 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704100 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 18:22:33.817824 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704103 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 18:22:33.817824 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704110 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 18:22:33.817824 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704115 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 18:22:33.817824 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704117 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 18:22:33.817824 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704120 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 18:22:33.817824 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704123 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 18:22:33.817824 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704125 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 18:22:33.817824 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704128 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 18:22:33.817824 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704130 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 18:22:33.817824 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704133 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 18:22:33.817824 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704135 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704138 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704140 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704143 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704145 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704216 2567 flags.go:64] FLAG: --address="0.0.0.0" Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704224 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704248 2567 flags.go:64] FLAG: --anonymous-auth="true" Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704253 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704258 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704261 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704266 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704270 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704273 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704277 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704281 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704284 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704287 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704290 2567 flags.go:64] FLAG: --cgroup-root="" Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704293 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704296 2567 flags.go:64] FLAG: --client-ca-file="" Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704300 2567 flags.go:64] FLAG: --cloud-provider="external" Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704303 2567 flags.go:64] FLAG: --cluster-dns="[]" Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704309 2567 flags.go:64] FLAG: --cluster-domain="" Jul 21 18:22:33.818446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704313 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704316 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704319 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704323 2567 flags.go:64] FLAG: --container-log-max-files="5" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704328 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704330 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704334 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704337 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704340 2567 flags.go:64] FLAG: --contention-profiling="false" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704343 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704346 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704349 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704352 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704357 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704360 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704362 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704365 2567 flags.go:64] FLAG: --enable-load-reader="false" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704368 2567 flags.go:64] FLAG: --enable-server="true" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704371 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704377 2567 flags.go:64] FLAG: --event-burst="100" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704380 2567 flags.go:64] FLAG: --event-qps="50" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704382 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704385 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704388 2567 flags.go:64] FLAG: --eviction-hard="" Jul 21 18:22:33.819272 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704392 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704395 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704398 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704401 2567 flags.go:64] FLAG: --eviction-soft="" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704404 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704407 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704410 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704415 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704419 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704422 2567 flags.go:64] FLAG: --fail-swap-on="true" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704425 2567 flags.go:64] FLAG: --feature-gates="" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704429 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704432 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704435 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704438 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704441 2567 flags.go:64] FLAG: --healthz-port="10248" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704444 2567 flags.go:64] FLAG: --help="false" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704447 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-140-156.ec2.internal" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704450 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704453 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704456 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704459 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704463 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704466 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 21 18:22:33.819999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704469 2567 flags.go:64] FLAG: --image-service-endpoint="" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704472 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704474 2567 flags.go:64] FLAG: --kube-api-burst="100" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704477 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704481 2567 flags.go:64] FLAG: --kube-api-qps="50" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704484 2567 flags.go:64] FLAG: --kube-reserved="" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704487 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704490 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704493 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704496 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704499 2567 flags.go:64] FLAG: --lock-file="" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704501 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704504 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704507 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704512 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704520 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704524 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704527 2567 flags.go:64] FLAG: --logging-format="text" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704530 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704533 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704536 2567 flags.go:64] FLAG: --manifest-url="" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704539 2567 flags.go:64] FLAG: --manifest-url-header="" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704543 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704546 2567 flags.go:64] FLAG: --max-open-files="1000000" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704550 2567 flags.go:64] FLAG: --max-pods="110" Jul 21 18:22:33.821194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704553 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704556 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704559 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704562 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704565 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704568 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704570 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704578 2567 flags.go:64] FLAG: --node-status-max-images="50" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704581 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704584 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704587 2567 flags.go:64] FLAG: --pod-cidr="" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704590 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704596 2567 flags.go:64] FLAG: --pod-manifest-path="" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704599 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704602 2567 flags.go:64] FLAG: --pods-per-core="0" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704620 2567 flags.go:64] FLAG: --port="10250" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704626 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704630 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0afb01d62f3c0932b" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704635 2567 flags.go:64] FLAG: --qos-reserved="" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704639 2567 flags.go:64] FLAG: --read-only-port="10255" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704643 2567 flags.go:64] FLAG: --register-node="true" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704646 2567 flags.go:64] FLAG: --register-with-taints="" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704650 2567 flags.go:64] FLAG: --registry-burst="10" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704659 2567 flags.go:64] FLAG: --registry-qps="5" Jul 21 18:22:33.822274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704662 2567 flags.go:64] FLAG: --reserved-cpus="" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704665 2567 flags.go:64] FLAG: --reserved-memory="" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704669 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704672 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704675 2567 flags.go:64] FLAG: --rotate-certificates="false" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704678 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704681 2567 flags.go:64] FLAG: --runonce="false" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704684 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704687 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704690 2567 flags.go:64] FLAG: --seccomp-default="false" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704693 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704696 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704699 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704702 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704704 2567 flags.go:64] FLAG: --storage-driver-password="root" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704708 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704710 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704713 2567 flags.go:64] FLAG: --storage-driver-user="root" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704716 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704719 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704723 2567 flags.go:64] FLAG: --system-cgroups="" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704725 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704731 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704734 2567 flags.go:64] FLAG: --tls-cert-file="" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704737 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 21 18:22:33.823384 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704741 2567 flags.go:64] FLAG: --tls-min-version="" Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704744 2567 flags.go:64] FLAG: --tls-private-key-file="" Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704746 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704749 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704752 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704755 2567 flags.go:64] FLAG: --v="2" Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704761 2567 flags.go:64] FLAG: --version="false" Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704766 2567 flags.go:64] FLAG: --vmodule="" Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704770 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.704773 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704894 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704899 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704902 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704905 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704909 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704912 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704915 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704917 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704920 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704924 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704928 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704932 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 18:22:33.824659 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704935 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 18:22:33.825815 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704939 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 18:22:33.825815 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704942 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 18:22:33.825815 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704946 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 18:22:33.825815 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704949 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 18:22:33.825815 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704952 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 18:22:33.825815 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704956 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 18:22:33.825815 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704959 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 18:22:33.825815 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704961 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 18:22:33.825815 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704964 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 18:22:33.825815 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704967 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 18:22:33.825815 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704969 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 18:22:33.825815 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704972 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 18:22:33.825815 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704974 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 18:22:33.825815 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704977 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 18:22:33.825815 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704979 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 18:22:33.825815 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704984 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 18:22:33.825815 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704987 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 18:22:33.825815 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704991 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 18:22:33.825815 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704993 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 18:22:33.826975 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704996 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 18:22:33.826975 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.704998 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 18:22:33.826975 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705001 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 18:22:33.826975 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705004 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 18:22:33.826975 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705006 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 18:22:33.826975 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705009 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 18:22:33.826975 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705012 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 18:22:33.826975 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705014 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 18:22:33.826975 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705017 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 18:22:33.826975 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705019 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 18:22:33.826975 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705022 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 18:22:33.826975 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705024 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 18:22:33.826975 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705027 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 18:22:33.826975 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705030 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 18:22:33.826975 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705033 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 18:22:33.826975 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705035 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 18:22:33.826975 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705038 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 18:22:33.826975 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705041 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 18:22:33.826975 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705043 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 18:22:33.826975 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705046 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 18:22:33.828043 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705048 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 18:22:33.828043 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705051 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 18:22:33.828043 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705054 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 18:22:33.828043 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705056 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 18:22:33.828043 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705059 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 18:22:33.828043 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705061 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 18:22:33.828043 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705063 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 18:22:33.828043 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705066 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 18:22:33.828043 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705070 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 18:22:33.828043 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705073 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 18:22:33.828043 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705076 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 18:22:33.828043 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705079 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 18:22:33.828043 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705082 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 18:22:33.828043 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705084 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 18:22:33.828043 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705087 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 18:22:33.828043 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705090 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 18:22:33.828043 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705092 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 18:22:33.828043 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705095 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 18:22:33.828043 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705097 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 18:22:33.828043 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705100 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 18:22:33.977459 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705102 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 18:22:33.977459 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705105 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 18:22:33.977459 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705108 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 18:22:33.977459 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705110 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 18:22:33.977459 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705113 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 18:22:33.977459 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705116 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 18:22:33.977459 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705118 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 18:22:33.977459 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705121 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 18:22:33.977459 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705123 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 18:22:33.977459 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705126 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 18:22:33.977459 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705128 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 21 18:22:33.977459 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705131 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 18:22:33.977459 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705133 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 18:22:33.977459 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705136 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 18:22:33.977459 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705138 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 18:22:33.977459 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705141 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 18:22:33.977459 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705144 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 18:22:33.977459 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705147 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 18:22:33.977459 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705149 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 18:22:33.977459 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705152 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 18:22:33.978713 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705157 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 18:22:33.978713 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705160 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 18:22:33.978713 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705162 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 18:22:33.978713 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705165 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 18:22:33.978713 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705168 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 18:22:33.978713 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705170 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 18:22:33.978713 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.705173 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 18:22:33.978713 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.706066 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 18:22:33.978713 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.726562 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 21 18:22:33.978713 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.726585 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 21 18:22:33.978713 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.726630 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 21 18:22:33.978713 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.726648 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 21 18:22:33.978713 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726712 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 18:22:33.978713 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726718 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 18:22:33.978713 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726721 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 18:22:33.979725 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726725 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 18:22:33.979725 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726728 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 18:22:33.979725 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726731 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 18:22:33.979725 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726734 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 18:22:33.979725 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726738 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 18:22:33.979725 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726741 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 18:22:33.979725 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726744 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 18:22:33.979725 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726746 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 18:22:33.979725 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726750 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 18:22:33.979725 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726753 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 18:22:33.979725 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726755 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 18:22:33.979725 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726758 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 18:22:33.979725 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726761 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 18:22:33.979725 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726763 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 18:22:33.979725 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726766 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 18:22:33.979725 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726769 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 18:22:33.979725 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726772 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 18:22:33.979725 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726775 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 18:22:33.979725 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726777 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 18:22:33.979725 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726780 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 18:22:33.981091 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726782 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 18:22:33.981091 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726786 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 18:22:33.981091 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726789 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 18:22:33.981091 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726791 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 18:22:33.981091 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726796 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 18:22:33.981091 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726800 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 18:22:33.981091 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726803 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 18:22:33.981091 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726807 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 18:22:33.981091 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726810 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 18:22:33.981091 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726813 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 18:22:33.981091 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726816 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 18:22:33.981091 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726819 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 18:22:33.981091 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726822 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 18:22:33.981091 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726825 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 18:22:33.981091 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726830 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 18:22:33.981091 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726832 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 18:22:33.981091 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726835 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 18:22:33.981091 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726838 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 18:22:33.981091 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726840 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 18:22:33.982115 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726847 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 18:22:33.982115 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726849 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 18:22:33.982115 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726852 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 18:22:33.982115 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726855 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 18:22:33.982115 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726857 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 18:22:33.982115 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726860 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 18:22:33.982115 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726863 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 18:22:33.982115 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726865 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 18:22:33.982115 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726868 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 18:22:33.982115 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726871 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 18:22:33.982115 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726873 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 18:22:33.982115 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726876 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 18:22:33.982115 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726878 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 18:22:33.982115 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726881 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 18:22:33.982115 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726884 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 18:22:33.982115 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726897 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 18:22:33.982115 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726900 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 18:22:33.982115 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726903 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 18:22:33.982115 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726905 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 18:22:33.982115 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726908 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 18:22:33.984060 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726911 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 18:22:33.984060 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726913 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 18:22:33.984060 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726916 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 18:22:33.984060 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726918 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 18:22:33.984060 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726921 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 18:22:33.984060 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726923 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 18:22:33.984060 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726926 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 18:22:33.984060 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726928 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 18:22:33.984060 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726931 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 18:22:33.984060 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726933 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 18:22:33.984060 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726936 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 18:22:33.984060 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726938 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 18:22:33.984060 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726942 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 18:22:33.984060 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726944 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 18:22:33.984060 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726947 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 18:22:33.984060 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726950 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 18:22:33.984060 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726952 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 18:22:33.984060 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726955 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 21 18:22:33.984060 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726957 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 18:22:33.984060 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726960 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 18:22:33.985157 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726962 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 18:22:33.985157 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726965 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 18:22:33.985157 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726967 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 18:22:33.985157 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726970 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 18:22:33.985157 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726972 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 18:22:33.985157 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726975 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 18:22:33.985157 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726977 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 18:22:33.985157 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726982 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 18:22:33.985157 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726988 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 18:22:33.985157 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726992 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 18:22:33.985157 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726995 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 18:22:33.985157 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.726999 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 18:22:33.985157 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727002 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 18:22:33.985157 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727005 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 18:22:33.985157 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727008 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 18:22:33.985157 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727011 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 18:22:33.985157 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727014 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 18:22:33.985956 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.727019 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 18:22:33.985956 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727134 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 18:22:33.985956 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727138 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 18:22:33.985956 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727141 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 18:22:33.985956 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727144 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 18:22:33.985956 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727147 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 18:22:33.985956 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727150 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 18:22:33.985956 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727154 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 18:22:33.985956 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727157 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 18:22:33.985956 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727160 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 18:22:33.985956 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727163 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 18:22:33.985956 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727165 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 18:22:33.985956 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727168 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 18:22:33.985956 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727171 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 18:22:33.986603 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727173 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 18:22:33.986603 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727176 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 18:22:33.986603 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727178 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 18:22:33.986603 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727181 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 18:22:33.986603 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727184 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 18:22:33.986603 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727186 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 18:22:33.986603 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727189 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 18:22:33.986603 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727191 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 18:22:33.986603 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727194 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 18:22:33.986603 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727198 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 18:22:33.986603 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727201 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 18:22:33.986603 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727203 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 18:22:33.986603 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727206 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 18:22:33.986603 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727209 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 18:22:33.986603 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727211 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 18:22:33.986603 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727214 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 18:22:33.986603 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727216 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 18:22:33.986603 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727219 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 18:22:33.986603 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727222 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 18:22:33.986603 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727224 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 18:22:33.988192 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727226 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 18:22:33.988192 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727229 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 18:22:33.988192 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727232 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 18:22:33.988192 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727234 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 18:22:33.988192 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727237 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 18:22:33.988192 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727241 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 18:22:33.988192 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727243 2567 feature_gate.go:328] unrecognized feature gate: Example Jul 21 18:22:33.988192 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727246 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 18:22:33.988192 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727248 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 18:22:33.988192 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727251 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 18:22:33.988192 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727254 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 18:22:33.988192 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727257 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 18:22:33.988192 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727260 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 18:22:33.988192 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727262 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 18:22:33.988192 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727265 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 18:22:33.988192 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727268 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 18:22:33.988192 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727270 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 18:22:33.988192 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727273 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 18:22:33.988192 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727275 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 18:22:33.989079 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727278 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 18:22:33.989079 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727280 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 18:22:33.989079 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727285 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 18:22:33.989079 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727288 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 18:22:33.989079 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727291 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 18:22:33.989079 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727293 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 18:22:33.989079 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727296 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 18:22:33.989079 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727298 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 18:22:33.989079 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727300 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 18:22:33.989079 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727303 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 18:22:33.989079 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727306 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 18:22:33.989079 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727308 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 18:22:33.989079 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727311 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 18:22:33.989079 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727313 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 18:22:33.989079 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727316 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 18:22:33.989079 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727318 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 18:22:33.989079 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727321 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 18:22:33.989079 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727323 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 18:22:33.989079 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727327 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 18:22:33.989079 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727330 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 18:22:33.990384 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727332 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 18:22:33.990384 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727335 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 18:22:33.990384 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727338 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 18:22:33.990384 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727340 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 18:22:33.990384 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727342 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 18:22:33.990384 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727345 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 18:22:33.990384 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727348 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 18:22:33.990384 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727350 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 18:22:33.990384 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727353 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 18:22:33.990384 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727355 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 18:22:33.990384 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727359 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 18:22:33.990384 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727363 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 18:22:33.990384 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727366 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 18:22:33.990384 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727369 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 18:22:33.990384 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727373 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 18:22:33.990384 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727376 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 18:22:33.990384 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727378 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 18:22:33.990384 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727382 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 18:22:33.990384 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727384 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 18:22:33.991268 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727387 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 18:22:33.991268 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727389 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 18:22:33.991268 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727392 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 18:22:33.991268 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727395 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 18:22:33.991268 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727398 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 18:22:33.991268 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727400 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 18:22:33.991268 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727403 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 18:22:33.991268 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:33.727405 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 18:22:33.991268 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.727411 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 18:22:33.991268 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.727545 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jul 21 18:22:33.991268 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.730313 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 21 18:22:33.991268 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.731678 2567 server.go:1019] "Starting client certificate rotation" Jul 21 18:22:33.991268 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.731787 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 18:22:33.991268 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.731823 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 18:22:33.992372 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.735583 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 18:22:33.992372 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.738057 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 18:22:33.992372 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.750600 2567 log.go:25] "Validated CRI v1 runtime API" Jul 21 18:22:33.992372 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.752914 2567 log.go:25] "Validated CRI v1 image API" Jul 21 18:22:33.992372 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.753734 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 21 18:22:33.992372 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.758043 2567 fs.go:135] Filesystem UUIDs: map[1aee2453-20a9-4ca1-82ad-0cbfed543090:/dev/nvme0n1p3 3fe93970-8ab5-4fe6-aad8-0cf528b34ee0:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 21 18:22:33.992372 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.758064 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 21 18:22:33.993435 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.763646 2567 manager.go:216] Machine: {Timestamp:2026-07-21 18:22:33.762101321 +0000 UTC m=+0.385828541 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101079 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a5a44cef08416eaf5b2525e6d63df SystemUUID:ec2a5a44-cef0-8416-eaf5-b2525e6d63df BootID:716631ae-cc18-460d-9e23-7bbc41610a07 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3e:6d:2b:49:85 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3e:6d:2b:49:85 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:4d:29:60:6a:7b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 21 18:22:33.993435 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.763762 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 21 18:22:33.993435 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.763861 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 21 18:22:33.993435 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.766866 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 18:22:33.993435 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.767014 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 21 18:22:33.993435 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.767048 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-156.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 21 18:22:33.993435 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.768770 2567 topology_manager.go:138] "Creating topology manager with none policy" Jul 21 18:22:33.993435 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.768787 2567 container_manager_linux.go:309] "Creating device plugin manager" Jul 21 18:22:33.993435 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.768796 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 18:22:33.993435 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.769601 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 18:22:33.993435 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.770931 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 21 18:22:33.993435 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.774104 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 21 18:22:33.993435 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.774254 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 21 18:22:33.993435 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.774284 2567 kubelet.go:486] "Attempting to sync node with API server" Jul 21 18:22:33.993435 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.774295 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 21 18:22:33.993435 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.774313 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 21 18:22:33.993435 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.774323 2567 kubelet.go:398] "Adding apiserver pod source" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.774333 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.774717 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.774736 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.777131 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.779229 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.779258 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.780451 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.780480 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.780493 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.780506 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.780520 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.780532 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.780565 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.780573 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.780580 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.780585 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.780599 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.780622 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.781472 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.781483 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.790266 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-156.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:33.790461 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-156.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:33.790665 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.791249 2567 server.go:1268] "Started kubelet" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.791350 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.791348 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.791434 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.792229 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x9mw5" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.793231 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.793625 2567 server.go:310] "Adding debug handlers to kubelet server" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:33.796971 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:33.796372 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-156.ec2.internal.18c46122a63acb03 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-156.ec2.internal,UID:ip-10-0-140-156.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-156.ec2.internal,},FirstTimestamp:2026-07-21 18:22:33.791212291 +0000 UTC m=+0.414939510,LastTimestamp:2026-07-21 18:22:33.791212291 +0000 UTC m=+0.414939510,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-156.ec2.internal,}" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.799464 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.799668 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:33.799716 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-156.ec2.internal\" not found" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.800325 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.800332 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.800538 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.800623 2567 reconstruct.go:97] "Volume reconstruction finished" Jul 21 18:22:33.994299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.800629 2567 reconciler.go:29] "Reconciler: start to sync state" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.801111 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x9mw5" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.801744 2567 factory.go:55] Registering systemd factory Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.801785 2567 factory.go:223] Registration of the systemd container factory successfully Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.802014 2567 factory.go:153] Registering CRI-O factory Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.802026 2567 factory.go:223] Registration of the crio container factory successfully Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.802084 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.802108 2567 factory.go:103] Registering Raw factory Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.802124 2567 manager.go:1196] Started watching for new ooms in manager Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.803040 2567 manager.go:349] Starting recovery of all containers Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.821808 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.821984 2567 manager.go:354] Recovery completed Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:33.824409 2567 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-156.ec2.internal\" not found" node="ip-10-0-140-156.ec2.internal" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.829068 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.839118 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.839156 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.839170 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.839744 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.839747 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.839762 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.839785 2567 state_mem.go:36] "Initialized new in-memory state store" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.840481 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.840502 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.840511 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.841095 2567 policy_none.go:49] "None policy: Start" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.841108 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.841117 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.842363 2567 policy_none.go:47] "Start" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.886213 2567 manager.go:337] "Starting Device Plugin manager" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:33.886387 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.886400 2567 server.go:87] "Starting device plugin registration server" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.886599 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.886627 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.886728 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.886813 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.886821 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:33.887217 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:33.887261 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-156.ec2.internal\" not found" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.986756 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.987926 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.987952 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.987964 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:22:33.996450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.987990 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-156.ec2.internal" Jul 21 18:22:33.998166 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:33.997447 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-156.ec2.internal" Jul 21 18:22:33.998166 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:33.997466 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-156.ec2.internal\": node \"ip-10-0-140-156.ec2.internal\" not found" Jul 21 18:22:34.002360 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.001967 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 21 18:22:34.004242 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.003516 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 21 18:22:34.004242 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.003550 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 21 18:22:34.004242 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.003571 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jul 21 18:22:34.004242 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:34.003599 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.005232 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:34.048677 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-156.ec2.internal\" not found" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.103928 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-156.ec2.internal"] Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.103991 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.105739 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.105767 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.105777 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.107148 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.107246 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.107271 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.107825 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.107851 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.107825 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.107885 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.107896 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.107861 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.109212 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-156.ec2.internal" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.109234 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.109896 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.109925 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.109938 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:34.142182 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-156.ec2.internal\" not found" node="ip-10-0-140-156.ec2.internal" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:34.146346 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-156.ec2.internal\" not found" node="ip-10-0-140-156.ec2.internal" Jul 21 18:22:34.195376 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:34.149364 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-156.ec2.internal\" not found" Jul 21 18:22:34.203302 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.202803 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a19bbefe5c5e58222b8300cb25d56a97-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal\" (UID: \"a19bbefe5c5e58222b8300cb25d56a97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal" Jul 21 18:22:34.203302 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.202847 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a19bbefe5c5e58222b8300cb25d56a97-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal\" (UID: \"a19bbefe5c5e58222b8300cb25d56a97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal" Jul 21 18:22:34.203302 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.202871 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/caddfd40ee2f3e5aec0a7ccd950ec47a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-156.ec2.internal\" (UID: \"caddfd40ee2f3e5aec0a7ccd950ec47a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-156.ec2.internal" Jul 21 18:22:34.367207 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:34.250022 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-156.ec2.internal\" not found" Jul 21 18:22:34.367207 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.303825 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a19bbefe5c5e58222b8300cb25d56a97-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal\" (UID: \"a19bbefe5c5e58222b8300cb25d56a97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal" Jul 21 18:22:34.367207 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.303858 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a19bbefe5c5e58222b8300cb25d56a97-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal\" (UID: \"a19bbefe5c5e58222b8300cb25d56a97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal" Jul 21 18:22:34.367207 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.303876 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/caddfd40ee2f3e5aec0a7ccd950ec47a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-156.ec2.internal\" (UID: \"caddfd40ee2f3e5aec0a7ccd950ec47a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-156.ec2.internal" Jul 21 18:22:34.367207 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.303914 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a19bbefe5c5e58222b8300cb25d56a97-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal\" (UID: \"a19bbefe5c5e58222b8300cb25d56a97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal" Jul 21 18:22:34.367207 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.303928 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a19bbefe5c5e58222b8300cb25d56a97-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal\" (UID: \"a19bbefe5c5e58222b8300cb25d56a97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal" Jul 21 18:22:34.367207 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.303914 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/caddfd40ee2f3e5aec0a7ccd950ec47a-config\") pod \"kube-apiserver-proxy-ip-10-0-140-156.ec2.internal\" (UID: \"caddfd40ee2f3e5aec0a7ccd950ec47a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-156.ec2.internal" Jul 21 18:22:34.367207 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:34.350949 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-156.ec2.internal\" not found" Jul 21 18:22:34.524793 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.445462 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal" Jul 21 18:22:34.524793 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.449572 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-156.ec2.internal" Jul 21 18:22:34.524793 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:34.451689 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-156.ec2.internal\" not found" Jul 21 18:22:34.608973 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:34.552442 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-156.ec2.internal\" not found" Jul 21 18:22:34.743261 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:34.652922 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-156.ec2.internal\" not found" Jul 21 18:22:34.743261 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.731471 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 21 18:22:34.743261 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.731647 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 18:22:34.743261 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.731670 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 18:22:34.901102 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:34.753885 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-156.ec2.internal\" not found" Jul 21 18:22:34.901102 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.805903 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 18:17:33 +0000 UTC" deadline="2028-04-19 02:23:49.305326426 +0000 UTC" Jul 21 18:22:34.901102 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.805928 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15296h1m14.499402249s" Jul 21 18:22:34.901102 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:34.854703 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-156.ec2.internal\" not found" Jul 21 18:22:34.987553 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:34.916209 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 18:22:35.001830 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.001799 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal" Jul 21 18:22:35.016885 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.016866 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 18:22:35.019140 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.019126 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-156.ec2.internal" Jul 21 18:22:35.026802 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.026787 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 18:22:35.076835 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.076814 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 18:22:35.150948 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:35.150883 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda19bbefe5c5e58222b8300cb25d56a97.slice/crio-44e6a484a353ce5982fc2cd27e5fae817f1ed4d82b87c19e5a20b654c1884808 WatchSource:0}: Error finding container 44e6a484a353ce5982fc2cd27e5fae817f1ed4d82b87c19e5a20b654c1884808: Status 404 returned error can't find the container with id 44e6a484a353ce5982fc2cd27e5fae817f1ed4d82b87c19e5a20b654c1884808 Jul 21 18:22:35.151085 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:35.151072 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaddfd40ee2f3e5aec0a7ccd950ec47a.slice/crio-ccfceca3ff41f5358361fdb8f72dfaef6f38f8f3c387c3008418adf2a43496e5 WatchSource:0}: Error finding container ccfceca3ff41f5358361fdb8f72dfaef6f38f8f3c387c3008418adf2a43496e5: Status 404 returned error can't find the container with id ccfceca3ff41f5358361fdb8f72dfaef6f38f8f3c387c3008418adf2a43496e5 Jul 21 18:22:35.156416 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.156398 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 18:22:35.752939 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.752907 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 18:22:35.775844 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.775816 2567 apiserver.go:52] "Watching apiserver" Jul 21 18:22:35.786352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.786317 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 21 18:22:35.788543 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.788513 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj","openshift-cluster-node-tuning-operator/tuned-k4rw4","openshift-image-registry/node-ca-kr557","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal","openshift-multus/multus-additional-cni-plugins-84wqq","openshift-multus/network-metrics-daemon-r2m2h","kube-system/kube-apiserver-proxy-ip-10-0-140-156.ec2.internal","openshift-dns/node-resolver-gfxb8","openshift-multus/multus-cvvn6","openshift-network-diagnostics/network-check-target-cc6j9","openshift-network-operator/iptables-alerter-rz4tw","openshift-ovn-kubernetes/ovnkube-node-d9h24","kube-system/global-pull-secret-syncer-hcwt5","kube-system/konnectivity-agent-97zj8"] Jul 21 18:22:35.790771 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.790749 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:35.790872 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:35.790834 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcwt5" podUID="afb4b042-5e50-4298-af62-23c520feeb7c" Jul 21 18:22:35.793004 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.792982 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.795366 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.794687 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kr557" Jul 21 18:22:35.798352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.795833 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 21 18:22:35.798352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.796103 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 21 18:22:35.798352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.796326 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bvqrz\"" Jul 21 18:22:35.798352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.796560 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.798352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.796871 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 21 18:22:35.798352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.797334 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7bsg9\"" Jul 21 18:22:35.798352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.797531 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 21 18:22:35.798352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.797539 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 21 18:22:35.798352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.797782 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.799675 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.799074 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 21 18:22:35.799675 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.799287 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 21 18:22:35.799675 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.799467 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4nblt\"" Jul 21 18:22:35.799675 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.799469 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:35.799675 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.799498 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 21 18:22:35.799675 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:35.799595 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2m2h" podUID="32340abc-8237-453b-96e1-2ab5d9aa5d67" Jul 21 18:22:35.800078 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.800004 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 21 18:22:35.801798 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.800235 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 21 18:22:35.801798 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.800496 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 21 18:22:35.801798 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.801221 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-97zj8" Jul 21 18:22:35.802796 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.802096 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gfxb8" Jul 21 18:22:35.805787 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.804625 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 21 18:22:35.805787 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.804893 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jq7pn\"" Jul 21 18:22:35.805787 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.805009 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-snvvm\"" Jul 21 18:22:35.805787 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.805034 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pfw26\"" Jul 21 18:22:35.805787 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.805116 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 21 18:22:35.805787 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.805189 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 21 18:22:35.805787 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.805218 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 21 18:22:35.805787 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.805292 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 21 18:22:35.805787 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.805351 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.805787 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.805393 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 21 18:22:35.805787 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.805595 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 21 18:22:35.805787 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.805707 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:22:35.805787 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:35.805760 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc6j9" podUID="277cbd93-cf42-46f9-91d7-83d45fae8ae1" Jul 21 18:22:35.807003 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.806983 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rz4tw" Jul 21 18:22:35.808296 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.808283 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 21 18:22:35.808424 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.808403 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fkrqq\"" Jul 21 18:22:35.809040 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.809023 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.810622 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.810584 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 21 18:22:35.810749 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.810735 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 21 18:22:35.810858 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.810842 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 21 18:22:35.811098 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.811084 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jdhzw\"" Jul 21 18:22:35.811351 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.811325 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-etc-systemd\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.811489 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.811473 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/755ebec0-a61c-44f1-a421-d08da8909234-agent-certs\") pod \"konnectivity-agent-97zj8\" (UID: \"755ebec0-a61c-44f1-a421-d08da8909234\") " pod="kube-system/konnectivity-agent-97zj8" Jul 21 18:22:35.811650 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.811628 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.811737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.811663 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a23526ee-19c4-46c0-94e4-172fe1edcb9d-multus-daemon-config\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.811737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.811684 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6-serviceca\") pod \"node-ca-kr557\" (UID: \"b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6\") " pod="openshift-image-registry/node-ca-kr557" Jul 21 18:22:35.811737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.811708 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-run\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.811737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.811732 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/afb4b042-5e50-4298-af62-23c520feeb7c-dbus\") pod \"global-pull-secret-syncer-hcwt5\" (UID: \"afb4b042-5e50-4298-af62-23c520feeb7c\") " pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:35.811932 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.811753 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-etc-sysconfig\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.811932 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.811776 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/73ed484d-3b20-483f-a95f-21bab48a050d-etc-tuned\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.811932 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.811807 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6-host\") pod \"node-ca-kr557\" (UID: \"b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6\") " pod="openshift-image-registry/node-ca-kr557" Jul 21 18:22:35.811932 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.811831 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpnns\" (UniqueName: \"kubernetes.io/projected/b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6-kube-api-access-fpnns\") pod \"node-ca-kr557\" (UID: \"b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6\") " pod="openshift-image-registry/node-ca-kr557" Jul 21 18:22:35.811932 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.811860 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-multus-socket-dir-parent\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.811932 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.811886 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7487046-daae-4342-a332-ba55d432ab64-hosts-file\") pod \"node-resolver-gfxb8\" (UID: \"a7487046-daae-4342-a332-ba55d432ab64\") " pod="openshift-dns/node-resolver-gfxb8" Jul 21 18:22:35.811932 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.811910 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.812292 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.811934 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-cnibin\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.812292 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.811960 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs\") pod \"network-metrics-daemon-r2m2h\" (UID: \"32340abc-8237-453b-96e1-2ab5d9aa5d67\") " pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:35.812292 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.811980 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-cnibin\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.812292 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812001 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-host-run-k8s-cni-cncf-io\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.812292 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812024 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-etc-kubernetes\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.812292 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812048 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-etc-kubernetes\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.812292 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812071 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-sys-fs\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.812292 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812110 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-multus-cni-dir\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.812292 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812134 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/afb4b042-5e50-4298-af62-23c520feeb7c-kubelet-config\") pod \"global-pull-secret-syncer-hcwt5\" (UID: \"afb4b042-5e50-4298-af62-23c520feeb7c\") " pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:35.812292 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812166 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-etc-modprobe-d\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.812292 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812194 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7487046-daae-4342-a332-ba55d432ab64-tmp-dir\") pod \"node-resolver-gfxb8\" (UID: \"a7487046-daae-4342-a332-ba55d432ab64\") " pod="openshift-dns/node-resolver-gfxb8" Jul 21 18:22:35.812292 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812217 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-device-dir\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.812292 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812246 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-os-release\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.812292 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812269 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-host-var-lib-cni-multus\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.812966 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812297 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmvz5\" (UniqueName: \"kubernetes.io/projected/a23526ee-19c4-46c0-94e4-172fe1edcb9d-kube-api-access-zmvz5\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.812966 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812321 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.812966 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812346 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxgnq\" (UniqueName: \"kubernetes.io/projected/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-kube-api-access-sxgnq\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.812966 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812371 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-system-cni-dir\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.812966 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812393 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-system-cni-dir\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.812966 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812417 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-registration-dir\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.812966 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812445 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtw2c\" (UniqueName: \"kubernetes.io/projected/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-kube-api-access-vtw2c\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.812966 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812467 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a23526ee-19c4-46c0-94e4-172fe1edcb9d-cni-binary-copy\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.812966 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812493 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-host-var-lib-kubelet\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.812966 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812517 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-host-run-multus-certs\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.812966 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812540 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/755ebec0-a61c-44f1-a421-d08da8909234-konnectivity-ca\") pod \"konnectivity-agent-97zj8\" (UID: \"755ebec0-a61c-44f1-a421-d08da8909234\") " pod="kube-system/konnectivity-agent-97zj8" Jul 21 18:22:35.812966 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812565 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkjpg\" (UniqueName: \"kubernetes.io/projected/a7487046-daae-4342-a332-ba55d432ab64-kube-api-access-nkjpg\") pod \"node-resolver-gfxb8\" (UID: \"a7487046-daae-4342-a332-ba55d432ab64\") " pod="openshift-dns/node-resolver-gfxb8" Jul 21 18:22:35.812966 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812589 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-hostroot\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.812966 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812638 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-etc-sysctl-d\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.812966 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812663 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-var-lib-kubelet\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.812966 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812685 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73ed484d-3b20-483f-a95f-21bab48a050d-tmp\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.813737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812709 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret\") pod \"global-pull-secret-syncer-hcwt5\" (UID: \"afb4b042-5e50-4298-af62-23c520feeb7c\") " pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:35.813737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812734 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phsdx\" (UniqueName: \"kubernetes.io/projected/32340abc-8237-453b-96e1-2ab5d9aa5d67-kube-api-access-phsdx\") pod \"network-metrics-daemon-r2m2h\" (UID: \"32340abc-8237-453b-96e1-2ab5d9aa5d67\") " pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:35.813737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.812764 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-host-var-lib-cni-bin\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.813737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.813314 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-lib-modules\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.813737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.813342 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v86rx\" (UniqueName: \"kubernetes.io/projected/73ed484d-3b20-483f-a95f-21bab48a050d-kube-api-access-v86rx\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.813737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.813367 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-etc-selinux\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.813737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.813403 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-os-release\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.813737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.813426 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-multus-conf-dir\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.813737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.813451 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-etc-sysctl-conf\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.813737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.813477 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-sys\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.813737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.813504 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-host\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.813737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.813539 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-socket-dir\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.813737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.813564 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-cni-binary-copy\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.813737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.813599 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.813737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.813650 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-host-run-netns\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.816910 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.816886 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 21 18:22:35.817090 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.817060 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 21 18:22:35.817950 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.817932 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 21 18:22:35.818128 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.818107 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 21 18:22:35.818589 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.818570 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 21 18:22:35.818839 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.818819 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-slfzf\"" Jul 21 18:22:35.819437 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.819418 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 21 18:22:35.820017 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.819995 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 18:22:35.837254 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.837158 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zrpgr" Jul 21 18:22:35.844344 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.844321 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zrpgr" Jul 21 18:22:35.902057 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.902025 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 21 18:22:35.916340 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914269 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-etc-kubernetes\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.916340 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914335 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-etc-kubernetes\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.916340 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914364 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-sys-fs\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.916340 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914392 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-multus-cni-dir\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.916340 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914426 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/afb4b042-5e50-4298-af62-23c520feeb7c-kubelet-config\") pod \"global-pull-secret-syncer-hcwt5\" (UID: \"afb4b042-5e50-4298-af62-23c520feeb7c\") " pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:35.916340 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914449 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-etc-modprobe-d\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.916340 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914473 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7487046-daae-4342-a332-ba55d432ab64-tmp-dir\") pod \"node-resolver-gfxb8\" (UID: \"a7487046-daae-4342-a332-ba55d432ab64\") " pod="openshift-dns/node-resolver-gfxb8" Jul 21 18:22:35.916340 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914501 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt5qq\" (UniqueName: \"kubernetes.io/projected/ffea9ae8-d7cf-4f21-9622-6a1aca2b552f-kube-api-access-mt5qq\") pod \"iptables-alerter-rz4tw\" (UID: \"ffea9ae8-d7cf-4f21-9622-6a1aca2b552f\") " pod="openshift-network-operator/iptables-alerter-rz4tw" Jul 21 18:22:35.916340 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914529 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-kubelet\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.916340 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914553 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-device-dir\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.916340 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914577 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-os-release\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.916340 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914620 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-systemd-units\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.916340 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914647 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-host-var-lib-cni-multus\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.916340 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914681 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmvz5\" (UniqueName: \"kubernetes.io/projected/a23526ee-19c4-46c0-94e4-172fe1edcb9d-kube-api-access-zmvz5\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.916340 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914709 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.916340 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914735 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxgnq\" (UniqueName: \"kubernetes.io/projected/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-kube-api-access-sxgnq\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.916340 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914761 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-system-cni-dir\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.917352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914790 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffea9ae8-d7cf-4f21-9622-6a1aca2b552f-host-slash\") pod \"iptables-alerter-rz4tw\" (UID: \"ffea9ae8-d7cf-4f21-9622-6a1aca2b552f\") " pod="openshift-network-operator/iptables-alerter-rz4tw" Jul 21 18:22:35.917352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914826 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-slash\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.917352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914859 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-run-netns\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.917352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914888 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-system-cni-dir\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.917352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914912 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-registration-dir\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.917352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914926 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-device-dir\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.917352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914937 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtw2c\" (UniqueName: \"kubernetes.io/projected/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-kube-api-access-vtw2c\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.917352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914963 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.917352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914989 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-etc-kubernetes\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.917352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.914990 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cj4x\" (UniqueName: \"kubernetes.io/projected/2d61b564-c002-4dfa-95e2-3f2adbbde234-kube-api-access-7cj4x\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.917352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915032 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a23526ee-19c4-46c0-94e4-172fe1edcb9d-cni-binary-copy\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.917352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915050 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-etc-kubernetes\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.917352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915054 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-host-var-lib-kubelet\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.917352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915080 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-host-run-multus-certs\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.917352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915101 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-sys-fs\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.917352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915106 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/755ebec0-a61c-44f1-a421-d08da8909234-konnectivity-ca\") pod \"konnectivity-agent-97zj8\" (UID: \"755ebec0-a61c-44f1-a421-d08da8909234\") " pod="kube-system/konnectivity-agent-97zj8" Jul 21 18:22:35.917352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915146 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-os-release\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.918211 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915204 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-system-cni-dir\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.918211 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915222 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-host-var-lib-cni-multus\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.918211 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915259 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-registration-dir\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.918211 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915310 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-multus-cni-dir\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.918211 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915343 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkjpg\" (UniqueName: \"kubernetes.io/projected/a7487046-daae-4342-a332-ba55d432ab64-kube-api-access-nkjpg\") pod \"node-resolver-gfxb8\" (UID: \"a7487046-daae-4342-a332-ba55d432ab64\") " pod="openshift-dns/node-resolver-gfxb8" Jul 21 18:22:35.918211 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915371 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-hostroot\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.918211 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915395 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-etc-sysctl-d\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.918211 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915418 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-var-lib-kubelet\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.918211 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915459 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73ed484d-3b20-483f-a95f-21bab48a050d-tmp\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.918211 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915075 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-system-cni-dir\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.918211 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915516 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-host-var-lib-kubelet\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.918211 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915517 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-hostroot\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.918211 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915563 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-var-lib-kubelet\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.918211 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915787 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-log-socket\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.918211 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915818 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.918211 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915854 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7487046-daae-4342-a332-ba55d432ab64-tmp-dir\") pod \"node-resolver-gfxb8\" (UID: \"a7487046-daae-4342-a332-ba55d432ab64\") " pod="openshift-dns/node-resolver-gfxb8" Jul 21 18:22:35.918211 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915847 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret\") pod \"global-pull-secret-syncer-hcwt5\" (UID: \"afb4b042-5e50-4298-af62-23c520feeb7c\") " pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:35.918211 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915910 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phsdx\" (UniqueName: \"kubernetes.io/projected/32340abc-8237-453b-96e1-2ab5d9aa5d67-kube-api-access-phsdx\") pod \"network-metrics-daemon-r2m2h\" (UID: \"32340abc-8237-453b-96e1-2ab5d9aa5d67\") " pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:35.919171 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:35.915934 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:22:35.919171 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915938 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-host-var-lib-cni-bin\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.919171 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915565 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/afb4b042-5e50-4298-af62-23c520feeb7c-kubelet-config\") pod \"global-pull-secret-syncer-hcwt5\" (UID: \"afb4b042-5e50-4298-af62-23c520feeb7c\") " pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:35.919171 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:35.916026 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret podName:afb4b042-5e50-4298-af62-23c520feeb7c nodeName:}" failed. No retries permitted until 2026-07-21 18:22:36.416004872 +0000 UTC m=+3.039732083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret") pod "global-pull-secret-syncer-hcwt5" (UID: "afb4b042-5e50-4298-af62-23c520feeb7c") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:22:35.919171 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916039 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-etc-modprobe-d\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.919171 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.915775 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 21 18:22:35.919171 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916206 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-lib-modules\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.919171 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916249 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tcg2\" (UniqueName: \"kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2\") pod \"network-check-target-cc6j9\" (UID: \"277cbd93-cf42-46f9-91d7-83d45fae8ae1\") " pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:22:35.919171 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916277 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-host-var-lib-cni-bin\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.919171 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916279 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-var-lib-openvswitch\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.919171 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916324 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-run-ovn\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.919171 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916328 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.919171 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916350 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-cni-netd\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.919171 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916354 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/755ebec0-a61c-44f1-a421-d08da8909234-konnectivity-ca\") pod \"konnectivity-agent-97zj8\" (UID: \"755ebec0-a61c-44f1-a421-d08da8909234\") " pod="kube-system/konnectivity-agent-97zj8" Jul 21 18:22:35.919171 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916397 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-host-run-multus-certs\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.919171 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916635 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v86rx\" (UniqueName: \"kubernetes.io/projected/73ed484d-3b20-483f-a95f-21bab48a050d-kube-api-access-v86rx\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.919171 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916646 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-lib-modules\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.920064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916743 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-etc-selinux\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.920064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916753 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-etc-sysctl-d\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.920064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916773 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-os-release\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.920064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-multus-conf-dir\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.920064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916829 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-etc-sysctl-conf\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.920064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916854 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-sys\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.920064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916877 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-host\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.920064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916893 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-os-release\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.920064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916903 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-run-systemd\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.920064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916934 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a23526ee-19c4-46c0-94e4-172fe1edcb9d-cni-binary-copy\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.920064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916964 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-socket-dir\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.920064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916992 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-cni-binary-copy\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.920064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917018 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.920064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917028 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-host\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.920064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917042 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-host-run-netns\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.920064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917050 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-etc-sysctl-conf\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.920064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.916990 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-etc-selinux\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.920064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917067 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-sys\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.920989 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917117 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-multus-conf-dir\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.920989 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917149 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-etc-systemd\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.920989 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917175 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/755ebec0-a61c-44f1-a421-d08da8909234-agent-certs\") pod \"konnectivity-agent-97zj8\" (UID: \"755ebec0-a61c-44f1-a421-d08da8909234\") " pod="kube-system/konnectivity-agent-97zj8" Jul 21 18:22:35.920989 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917201 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-cni-bin\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.920989 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917223 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d61b564-c002-4dfa-95e2-3f2adbbde234-env-overrides\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.920989 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917315 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-host-run-netns\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.920989 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917370 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-node-log\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.920989 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917390 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.920989 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917436 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d61b564-c002-4dfa-95e2-3f2adbbde234-ovn-node-metrics-cert\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.920989 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917459 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-socket-dir\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.920989 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917466 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d61b564-c002-4dfa-95e2-3f2adbbde234-ovnkube-script-lib\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.920989 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917509 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.920989 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917511 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-etc-systemd\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.920989 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917563 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ffea9ae8-d7cf-4f21-9622-6a1aca2b552f-iptables-alerter-script\") pod \"iptables-alerter-rz4tw\" (UID: \"ffea9ae8-d7cf-4f21-9622-6a1aca2b552f\") " pod="openshift-network-operator/iptables-alerter-rz4tw" Jul 21 18:22:35.920989 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917594 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-run-openvswitch\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.920989 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917632 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d61b564-c002-4dfa-95e2-3f2adbbde234-ovnkube-config\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.920989 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917721 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a23526ee-19c4-46c0-94e4-172fe1edcb9d-multus-daemon-config\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.921810 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917755 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6-serviceca\") pod \"node-ca-kr557\" (UID: \"b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6\") " pod="openshift-image-registry/node-ca-kr557" Jul 21 18:22:35.921810 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917784 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-run\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.921810 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917811 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-etc-openvswitch\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:35.921810 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917821 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-cni-binary-copy\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.921810 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917839 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/afb4b042-5e50-4298-af62-23c520feeb7c-dbus\") pod \"global-pull-secret-syncer-hcwt5\" (UID: \"afb4b042-5e50-4298-af62-23c520feeb7c\") " pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:35.921810 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917892 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/afb4b042-5e50-4298-af62-23c520feeb7c-dbus\") pod \"global-pull-secret-syncer-hcwt5\" (UID: \"afb4b042-5e50-4298-af62-23c520feeb7c\") " pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:35.921810 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917935 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-run\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.921810 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917970 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-etc-sysconfig\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.921810 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.917995 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.921810 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.918003 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/73ed484d-3b20-483f-a95f-21bab48a050d-etc-tuned\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.921810 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.918028 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6-host\") pod \"node-ca-kr557\" (UID: \"b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6\") " pod="openshift-image-registry/node-ca-kr557" Jul 21 18:22:35.921810 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.918066 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpnns\" (UniqueName: \"kubernetes.io/projected/b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6-kube-api-access-fpnns\") pod \"node-ca-kr557\" (UID: \"b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6\") " pod="openshift-image-registry/node-ca-kr557" Jul 21 18:22:35.921810 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.918071 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6-host\") pod \"node-ca-kr557\" (UID: \"b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6\") " pod="openshift-image-registry/node-ca-kr557" Jul 21 18:22:35.921810 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.918094 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-multus-socket-dir-parent\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.921810 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.918139 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/73ed484d-3b20-483f-a95f-21bab48a050d-etc-sysconfig\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.921810 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.918166 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7487046-daae-4342-a332-ba55d432ab64-hosts-file\") pod \"node-resolver-gfxb8\" (UID: \"a7487046-daae-4342-a332-ba55d432ab64\") " pod="openshift-dns/node-resolver-gfxb8" Jul 21 18:22:35.921810 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.918174 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6-serviceca\") pod \"node-ca-kr557\" (UID: \"b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6\") " pod="openshift-image-registry/node-ca-kr557" Jul 21 18:22:35.921810 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.918200 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.922727 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.918224 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7487046-daae-4342-a332-ba55d432ab64-hosts-file\") pod \"node-resolver-gfxb8\" (UID: \"a7487046-daae-4342-a332-ba55d432ab64\") " pod="openshift-dns/node-resolver-gfxb8" Jul 21 18:22:35.922727 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.918263 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-cnibin\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.922727 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.918270 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a23526ee-19c4-46c0-94e4-172fe1edcb9d-multus-daemon-config\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.922727 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.918281 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-multus-socket-dir-parent\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.922727 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.918300 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs\") pod \"network-metrics-daemon-r2m2h\" (UID: \"32340abc-8237-453b-96e1-2ab5d9aa5d67\") " pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:35.922727 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.918328 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-cnibin\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.922727 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.918368 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-cnibin\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.922727 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.918406 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-host-run-k8s-cni-cncf-io\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.922727 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:35.918446 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:22:35.922727 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.918529 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-cnibin\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.922727 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:35.918552 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs podName:32340abc-8237-453b-96e1-2ab5d9aa5d67 nodeName:}" failed. No retries permitted until 2026-07-21 18:22:36.418533457 +0000 UTC m=+3.042260667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs") pod "network-metrics-daemon-r2m2h" (UID: "32340abc-8237-453b-96e1-2ab5d9aa5d67") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:22:35.922727 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.918561 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a23526ee-19c4-46c0-94e4-172fe1edcb9d-host-run-k8s-cni-cncf-io\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.922727 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.918704 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.922727 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.922030 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/73ed484d-3b20-483f-a95f-21bab48a050d-etc-tuned\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.922727 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.922249 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/755ebec0-a61c-44f1-a421-d08da8909234-agent-certs\") pod \"konnectivity-agent-97zj8\" (UID: \"755ebec0-a61c-44f1-a421-d08da8909234\") " pod="kube-system/konnectivity-agent-97zj8" Jul 21 18:22:35.924871 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.924848 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73ed484d-3b20-483f-a95f-21bab48a050d-tmp\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.925762 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.925739 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmvz5\" (UniqueName: \"kubernetes.io/projected/a23526ee-19c4-46c0-94e4-172fe1edcb9d-kube-api-access-zmvz5\") pod \"multus-cvvn6\" (UID: \"a23526ee-19c4-46c0-94e4-172fe1edcb9d\") " pod="openshift-multus/multus-cvvn6" Jul 21 18:22:35.929456 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.929407 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtw2c\" (UniqueName: \"kubernetes.io/projected/b9b7e34a-13a2-4a49-87b0-0e0258fd80db-kube-api-access-vtw2c\") pod \"multus-additional-cni-plugins-84wqq\" (UID: \"b9b7e34a-13a2-4a49-87b0-0e0258fd80db\") " pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:35.929788 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.929769 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxgnq\" (UniqueName: \"kubernetes.io/projected/b2a0a656-2f97-4a13-a9d7-bb14c2e02a90-kube-api-access-sxgnq\") pod \"aws-ebs-csi-driver-node-f95dj\" (UID: \"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:35.932797 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.932772 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v86rx\" (UniqueName: \"kubernetes.io/projected/73ed484d-3b20-483f-a95f-21bab48a050d-kube-api-access-v86rx\") pod \"tuned-k4rw4\" (UID: \"73ed484d-3b20-483f-a95f-21bab48a050d\") " pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:35.936460 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.936437 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpnns\" (UniqueName: \"kubernetes.io/projected/b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6-kube-api-access-fpnns\") pod \"node-ca-kr557\" (UID: \"b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6\") " pod="openshift-image-registry/node-ca-kr557" Jul 21 18:22:35.937301 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.937258 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkjpg\" (UniqueName: \"kubernetes.io/projected/a7487046-daae-4342-a332-ba55d432ab64-kube-api-access-nkjpg\") pod \"node-resolver-gfxb8\" (UID: \"a7487046-daae-4342-a332-ba55d432ab64\") " pod="openshift-dns/node-resolver-gfxb8" Jul 21 18:22:35.937516 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:35.937491 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phsdx\" (UniqueName: \"kubernetes.io/projected/32340abc-8237-453b-96e1-2ab5d9aa5d67-kube-api-access-phsdx\") pod \"network-metrics-daemon-r2m2h\" (UID: \"32340abc-8237-453b-96e1-2ab5d9aa5d67\") " pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:36.008757 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.008641 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal" event={"ID":"a19bbefe5c5e58222b8300cb25d56a97","Type":"ContainerStarted","Data":"44e6a484a353ce5982fc2cd27e5fae817f1ed4d82b87c19e5a20b654c1884808"} Jul 21 18:22:36.009836 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.009808 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-156.ec2.internal" event={"ID":"caddfd40ee2f3e5aec0a7ccd950ec47a","Type":"ContainerStarted","Data":"ccfceca3ff41f5358361fdb8f72dfaef6f38f8f3c387c3008418adf2a43496e5"} Jul 21 18:22:36.019361 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019325 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt5qq\" (UniqueName: \"kubernetes.io/projected/ffea9ae8-d7cf-4f21-9622-6a1aca2b552f-kube-api-access-mt5qq\") pod \"iptables-alerter-rz4tw\" (UID: \"ffea9ae8-d7cf-4f21-9622-6a1aca2b552f\") " pod="openshift-network-operator/iptables-alerter-rz4tw" Jul 21 18:22:36.019361 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019366 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-kubelet\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.019561 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019386 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-systemd-units\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.019561 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019412 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffea9ae8-d7cf-4f21-9622-6a1aca2b552f-host-slash\") pod \"iptables-alerter-rz4tw\" (UID: \"ffea9ae8-d7cf-4f21-9622-6a1aca2b552f\") " pod="openshift-network-operator/iptables-alerter-rz4tw" Jul 21 18:22:36.019561 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019436 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-slash\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.019561 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019446 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-kubelet\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.019561 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019459 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-systemd-units\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.019561 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019474 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-run-netns\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.019561 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019510 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-slash\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.019561 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019525 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.019561 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019549 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffea9ae8-d7cf-4f21-9622-6a1aca2b552f-host-slash\") pod \"iptables-alerter-rz4tw\" (UID: \"ffea9ae8-d7cf-4f21-9622-6a1aca2b552f\") " pod="openshift-network-operator/iptables-alerter-rz4tw" Jul 21 18:22:36.019561 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019553 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cj4x\" (UniqueName: \"kubernetes.io/projected/2d61b564-c002-4dfa-95e2-3f2adbbde234-kube-api-access-7cj4x\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020042 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019586 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-log-socket\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020042 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019602 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020042 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019627 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020042 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019587 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-run-netns\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020042 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019682 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-log-socket\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020042 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019697 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tcg2\" (UniqueName: \"kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2\") pod \"network-check-target-cc6j9\" (UID: \"277cbd93-cf42-46f9-91d7-83d45fae8ae1\") " pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:22:36.020042 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019751 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020042 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019752 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-var-lib-openvswitch\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020042 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019788 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-var-lib-openvswitch\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020042 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019792 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-run-ovn\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020042 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019896 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-cni-netd\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020042 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019899 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-run-ovn\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020042 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019931 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-run-systemd\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020042 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.019992 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-cni-netd\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020042 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.020030 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-cni-bin\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020741 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.020056 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d61b564-c002-4dfa-95e2-3f2adbbde234-env-overrides\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020741 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.020059 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-run-systemd\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020741 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.020089 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-host-cni-bin\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020741 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.020128 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-node-log\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020741 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.020154 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d61b564-c002-4dfa-95e2-3f2adbbde234-ovn-node-metrics-cert\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020741 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.020180 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d61b564-c002-4dfa-95e2-3f2adbbde234-ovnkube-script-lib\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020741 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.020205 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ffea9ae8-d7cf-4f21-9622-6a1aca2b552f-iptables-alerter-script\") pod \"iptables-alerter-rz4tw\" (UID: \"ffea9ae8-d7cf-4f21-9622-6a1aca2b552f\") " pod="openshift-network-operator/iptables-alerter-rz4tw" Jul 21 18:22:36.020741 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.020227 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-run-openvswitch\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020741 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.020251 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d61b564-c002-4dfa-95e2-3f2adbbde234-ovnkube-config\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020741 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.020276 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-etc-openvswitch\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020741 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.020349 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-etc-openvswitch\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020741 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.020392 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-node-log\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.020741 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.020565 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d61b564-c002-4dfa-95e2-3f2adbbde234-env-overrides\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.021374 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.020739 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d61b564-c002-4dfa-95e2-3f2adbbde234-run-openvswitch\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.021374 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.020996 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ffea9ae8-d7cf-4f21-9622-6a1aca2b552f-iptables-alerter-script\") pod \"iptables-alerter-rz4tw\" (UID: \"ffea9ae8-d7cf-4f21-9622-6a1aca2b552f\") " pod="openshift-network-operator/iptables-alerter-rz4tw" Jul 21 18:22:36.021374 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.021296 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d61b564-c002-4dfa-95e2-3f2adbbde234-ovnkube-script-lib\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.022138 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.022094 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d61b564-c002-4dfa-95e2-3f2adbbde234-ovnkube-config\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.023565 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.023541 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d61b564-c002-4dfa-95e2-3f2adbbde234-ovn-node-metrics-cert\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.026506 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:36.026480 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:22:36.026628 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:36.026512 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:22:36.026628 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:36.026525 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9tcg2 for pod openshift-network-diagnostics/network-check-target-cc6j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:22:36.026628 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:36.026581 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2 podName:277cbd93-cf42-46f9-91d7-83d45fae8ae1 nodeName:}" failed. No retries permitted until 2026-07-21 18:22:36.526564591 +0000 UTC m=+3.150291811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9tcg2" (UniqueName: "kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2") pod "network-check-target-cc6j9" (UID: "277cbd93-cf42-46f9-91d7-83d45fae8ae1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:22:36.028845 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.028816 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cj4x\" (UniqueName: \"kubernetes.io/projected/2d61b564-c002-4dfa-95e2-3f2adbbde234-kube-api-access-7cj4x\") pod \"ovnkube-node-d9h24\" (UID: \"2d61b564-c002-4dfa-95e2-3f2adbbde234\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.028979 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.028958 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt5qq\" (UniqueName: \"kubernetes.io/projected/ffea9ae8-d7cf-4f21-9622-6a1aca2b552f-kube-api-access-mt5qq\") pod \"iptables-alerter-rz4tw\" (UID: \"ffea9ae8-d7cf-4f21-9622-6a1aca2b552f\") " pod="openshift-network-operator/iptables-alerter-rz4tw" Jul 21 18:22:36.033828 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.033807 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 18:22:36.108967 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.108931 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" Jul 21 18:22:36.124198 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.124165 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kr557" Jul 21 18:22:36.134248 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.134212 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" Jul 21 18:22:36.140248 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.140222 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-84wqq" Jul 21 18:22:36.147326 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.147304 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-97zj8" Jul 21 18:22:36.156253 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.156220 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gfxb8" Jul 21 18:22:36.163336 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.163314 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cvvn6" Jul 21 18:22:36.173144 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.173124 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rz4tw" Jul 21 18:22:36.180397 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.180376 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:22:36.422779 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.422682 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs\") pod \"network-metrics-daemon-r2m2h\" (UID: \"32340abc-8237-453b-96e1-2ab5d9aa5d67\") " pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:36.422779 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.422759 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret\") pod \"global-pull-secret-syncer-hcwt5\" (UID: \"afb4b042-5e50-4298-af62-23c520feeb7c\") " pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:36.422955 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:36.422800 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:22:36.422955 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:36.422868 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs podName:32340abc-8237-453b-96e1-2ab5d9aa5d67 nodeName:}" failed. No retries permitted until 2026-07-21 18:22:37.422852133 +0000 UTC m=+4.046579338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs") pod "network-metrics-daemon-r2m2h" (UID: "32340abc-8237-453b-96e1-2ab5d9aa5d67") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:22:36.422955 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:36.422904 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:22:36.423050 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:36.422964 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret podName:afb4b042-5e50-4298-af62-23c520feeb7c nodeName:}" failed. No retries permitted until 2026-07-21 18:22:37.422947318 +0000 UTC m=+4.046674524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret") pod "global-pull-secret-syncer-hcwt5" (UID: "afb4b042-5e50-4298-af62-23c520feeb7c") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:22:36.623826 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.623789 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tcg2\" (UniqueName: \"kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2\") pod \"network-check-target-cc6j9\" (UID: \"277cbd93-cf42-46f9-91d7-83d45fae8ae1\") " pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:22:36.624014 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:36.623988 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:22:36.624014 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:36.624014 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:22:36.624122 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:36.624029 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9tcg2 for pod openshift-network-diagnostics/network-check-target-cc6j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:22:36.624122 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:36.624097 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2 podName:277cbd93-cf42-46f9-91d7-83d45fae8ae1 nodeName:}" failed. No retries permitted until 2026-07-21 18:22:37.624073876 +0000 UTC m=+4.247801129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9tcg2" (UniqueName: "kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2") pod "network-check-target-cc6j9" (UID: "277cbd93-cf42-46f9-91d7-83d45fae8ae1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:22:36.846751 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.846668 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 18:17:35 +0000 UTC" deadline="2028-05-02 18:16:28.685369086 +0000 UTC" Jul 21 18:22:36.846751 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:36.846699 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15623h53m51.838673439s" Jul 21 18:22:37.004751 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:37.004718 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:37.004943 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:37.004832 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:22:37.004943 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:37.004842 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcwt5" podUID="afb4b042-5e50-4298-af62-23c520feeb7c" Jul 21 18:22:37.004943 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:37.004860 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:37.005107 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:37.004954 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc6j9" podUID="277cbd93-cf42-46f9-91d7-83d45fae8ae1" Jul 21 18:22:37.005107 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:37.005020 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2m2h" podUID="32340abc-8237-453b-96e1-2ab5d9aa5d67" Jul 21 18:22:37.070830 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:37.070790 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ed484d_3b20_483f_a95f_21bab48a050d.slice/crio-efa9cb515e951f6bef719575c8a5024797931a0d5ff48a713a46b75dfefe7925 WatchSource:0}: Error finding container efa9cb515e951f6bef719575c8a5024797931a0d5ff48a713a46b75dfefe7925: Status 404 returned error can't find the container with id efa9cb515e951f6bef719575c8a5024797931a0d5ff48a713a46b75dfefe7925 Jul 21 18:22:37.093016 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:37.092988 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod755ebec0_a61c_44f1_a421_d08da8909234.slice/crio-f7f5670734c5dac13f33b8c3b5a02496aa45b72fed7f225f098a7183f659e872 WatchSource:0}: Error finding container f7f5670734c5dac13f33b8c3b5a02496aa45b72fed7f225f098a7183f659e872: Status 404 returned error can't find the container with id f7f5670734c5dac13f33b8c3b5a02496aa45b72fed7f225f098a7183f659e872 Jul 21 18:22:37.093659 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:37.093632 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffea9ae8_d7cf_4f21_9622_6a1aca2b552f.slice/crio-a8491cd9d8eeb2000448055be152d14ca7239ac95b4df1227117ba977643be00 WatchSource:0}: Error finding container a8491cd9d8eeb2000448055be152d14ca7239ac95b4df1227117ba977643be00: Status 404 returned error can't find the container with id a8491cd9d8eeb2000448055be152d14ca7239ac95b4df1227117ba977643be00 Jul 21 18:22:37.094390 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:37.094312 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33a6147_9b6b_4b35_b8d0_8ac9b92d26d6.slice/crio-01ce62e43eeda83118e2c42ab186dd59d70fb63eae69b8cf3e1c7a576d3fd30a WatchSource:0}: Error finding container 01ce62e43eeda83118e2c42ab186dd59d70fb63eae69b8cf3e1c7a576d3fd30a: Status 404 returned error can't find the container with id 01ce62e43eeda83118e2c42ab186dd59d70fb63eae69b8cf3e1c7a576d3fd30a Jul 21 18:22:37.095339 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:37.095235 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d61b564_c002_4dfa_95e2_3f2adbbde234.slice/crio-e67487e1817002c0528be449ba1ccd3ecbbdbb79eacae744a8bf0d5705a03fb3 WatchSource:0}: Error finding container e67487e1817002c0528be449ba1ccd3ecbbdbb79eacae744a8bf0d5705a03fb3: Status 404 returned error can't find the container with id e67487e1817002c0528be449ba1ccd3ecbbdbb79eacae744a8bf0d5705a03fb3 Jul 21 18:22:37.096465 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:37.096263 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a0a656_2f97_4a13_a9d7_bb14c2e02a90.slice/crio-43c4e7b3802374180a1a3c1477c542cde0eb5334ea4cecbdab5a01b8e10e1ecb WatchSource:0}: Error finding container 43c4e7b3802374180a1a3c1477c542cde0eb5334ea4cecbdab5a01b8e10e1ecb: Status 404 returned error can't find the container with id 43c4e7b3802374180a1a3c1477c542cde0eb5334ea4cecbdab5a01b8e10e1ecb Jul 21 18:22:37.099137 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:37.099115 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9b7e34a_13a2_4a49_87b0_0e0258fd80db.slice/crio-a29c6804ca3bb35e844fc650248abac9728beabcaa53675363740e4abb9f9313 WatchSource:0}: Error finding container a29c6804ca3bb35e844fc650248abac9728beabcaa53675363740e4abb9f9313: Status 404 returned error can't find the container with id a29c6804ca3bb35e844fc650248abac9728beabcaa53675363740e4abb9f9313 Jul 21 18:22:37.100513 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:22:37.100487 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda23526ee_19c4_46c0_94e4_172fe1edcb9d.slice/crio-8fc6368494024dbd88ab988623ed37951823f4324cb3e0eca27531f9e7140bd5 WatchSource:0}: Error finding container 8fc6368494024dbd88ab988623ed37951823f4324cb3e0eca27531f9e7140bd5: Status 404 returned error can't find the container with id 8fc6368494024dbd88ab988623ed37951823f4324cb3e0eca27531f9e7140bd5 Jul 21 18:22:37.430175 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:37.429930 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret\") pod \"global-pull-secret-syncer-hcwt5\" (UID: \"afb4b042-5e50-4298-af62-23c520feeb7c\") " pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:37.430175 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:37.430159 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs\") pod \"network-metrics-daemon-r2m2h\" (UID: \"32340abc-8237-453b-96e1-2ab5d9aa5d67\") " pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:37.430354 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:37.430090 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:22:37.430354 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:37.430231 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret podName:afb4b042-5e50-4298-af62-23c520feeb7c nodeName:}" failed. No retries permitted until 2026-07-21 18:22:39.430215468 +0000 UTC m=+6.053942676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret") pod "global-pull-secret-syncer-hcwt5" (UID: "afb4b042-5e50-4298-af62-23c520feeb7c") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:22:37.430354 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:37.430253 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:22:37.430354 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:37.430301 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs podName:32340abc-8237-453b-96e1-2ab5d9aa5d67 nodeName:}" failed. No retries permitted until 2026-07-21 18:22:39.430285137 +0000 UTC m=+6.054012343 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs") pod "network-metrics-daemon-r2m2h" (UID: "32340abc-8237-453b-96e1-2ab5d9aa5d67") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:22:37.632278 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:37.631629 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tcg2\" (UniqueName: \"kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2\") pod \"network-check-target-cc6j9\" (UID: \"277cbd93-cf42-46f9-91d7-83d45fae8ae1\") " pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:22:37.632278 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:37.631845 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:22:37.632278 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:37.631868 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:22:37.632278 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:37.631882 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9tcg2 for pod openshift-network-diagnostics/network-check-target-cc6j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:22:37.632278 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:37.631939 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2 podName:277cbd93-cf42-46f9-91d7-83d45fae8ae1 nodeName:}" failed. No retries permitted until 2026-07-21 18:22:39.631919844 +0000 UTC m=+6.255647066 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9tcg2" (UniqueName: "kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2") pod "network-check-target-cc6j9" (UID: "277cbd93-cf42-46f9-91d7-83d45fae8ae1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:22:37.847690 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:37.847589 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 18:17:35 +0000 UTC" deadline="2027-12-20 15:30:47.111378448 +0000 UTC" Jul 21 18:22:37.847690 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:37.847660 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12405h8m9.263722417s" Jul 21 18:22:38.021587 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:38.021434 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cvvn6" event={"ID":"a23526ee-19c4-46c0-94e4-172fe1edcb9d","Type":"ContainerStarted","Data":"8fc6368494024dbd88ab988623ed37951823f4324cb3e0eca27531f9e7140bd5"} Jul 21 18:22:38.028115 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:38.028082 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84wqq" event={"ID":"b9b7e34a-13a2-4a49-87b0-0e0258fd80db","Type":"ContainerStarted","Data":"a29c6804ca3bb35e844fc650248abac9728beabcaa53675363740e4abb9f9313"} Jul 21 18:22:38.031793 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:38.031767 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gfxb8" event={"ID":"a7487046-daae-4342-a332-ba55d432ab64","Type":"ContainerStarted","Data":"618ebbba1ecbfd3f258a974810e207883886e3645484f407719412cea9b96f93"} Jul 21 18:22:38.048052 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:38.047829 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rz4tw" event={"ID":"ffea9ae8-d7cf-4f21-9622-6a1aca2b552f","Type":"ContainerStarted","Data":"a8491cd9d8eeb2000448055be152d14ca7239ac95b4df1227117ba977643be00"} Jul 21 18:22:38.061744 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:38.061715 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-97zj8" event={"ID":"755ebec0-a61c-44f1-a421-d08da8909234","Type":"ContainerStarted","Data":"f7f5670734c5dac13f33b8c3b5a02496aa45b72fed7f225f098a7183f659e872"} Jul 21 18:22:38.072456 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:38.072427 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" event={"ID":"73ed484d-3b20-483f-a95f-21bab48a050d","Type":"ContainerStarted","Data":"efa9cb515e951f6bef719575c8a5024797931a0d5ff48a713a46b75dfefe7925"} Jul 21 18:22:38.082601 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:38.082573 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-156.ec2.internal" event={"ID":"caddfd40ee2f3e5aec0a7ccd950ec47a","Type":"ContainerStarted","Data":"f29d2f87fa90d397f667ebb009ef280fc12956369b182f39643abfd347950ca1"} Jul 21 18:22:38.096036 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:38.096006 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" event={"ID":"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90","Type":"ContainerStarted","Data":"43c4e7b3802374180a1a3c1477c542cde0eb5334ea4cecbdab5a01b8e10e1ecb"} Jul 21 18:22:38.097985 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:38.097912 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-156.ec2.internal" podStartSLOduration=3.097895068 podStartE2EDuration="3.097895068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:22:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:22:38.0972241 +0000 UTC m=+4.720951328" watchObservedRunningTime="2026-07-21 18:22:38.097895068 +0000 UTC m=+4.721622296" Jul 21 18:22:38.112563 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:38.112443 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" event={"ID":"2d61b564-c002-4dfa-95e2-3f2adbbde234","Type":"ContainerStarted","Data":"e67487e1817002c0528be449ba1ccd3ecbbdbb79eacae744a8bf0d5705a03fb3"} Jul 21 18:22:38.125330 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:38.125303 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kr557" event={"ID":"b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6","Type":"ContainerStarted","Data":"01ce62e43eeda83118e2c42ab186dd59d70fb63eae69b8cf3e1c7a576d3fd30a"} Jul 21 18:22:38.136805 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:38.136777 2567 generic.go:356] "Generic (PLEG): container finished" podID="a19bbefe5c5e58222b8300cb25d56a97" containerID="e8829e74cdaceff7eb0e79a8b4486002feece89b598c7e46c9fca1044ccf16f1" exitCode=0 Jul 21 18:22:38.136931 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:38.136817 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal" event={"ID":"a19bbefe5c5e58222b8300cb25d56a97","Type":"ContainerDied","Data":"e8829e74cdaceff7eb0e79a8b4486002feece89b598c7e46c9fca1044ccf16f1"} Jul 21 18:22:39.003962 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:39.003931 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:22:39.004320 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:39.004081 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc6j9" podUID="277cbd93-cf42-46f9-91d7-83d45fae8ae1" Jul 21 18:22:39.004320 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:39.004164 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:39.004320 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:39.004238 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcwt5" podUID="afb4b042-5e50-4298-af62-23c520feeb7c" Jul 21 18:22:39.004320 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:39.004296 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:39.004440 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:39.004375 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2m2h" podUID="32340abc-8237-453b-96e1-2ab5d9aa5d67" Jul 21 18:22:39.161112 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:39.161073 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal" event={"ID":"a19bbefe5c5e58222b8300cb25d56a97","Type":"ContainerStarted","Data":"3fc582d616eb6aa60906874e30986717421959f8fab55b131231f1630800bb39"} Jul 21 18:22:39.449813 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:39.449720 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs\") pod \"network-metrics-daemon-r2m2h\" (UID: \"32340abc-8237-453b-96e1-2ab5d9aa5d67\") " pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:39.449813 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:39.449799 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret\") pod \"global-pull-secret-syncer-hcwt5\" (UID: \"afb4b042-5e50-4298-af62-23c520feeb7c\") " pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:39.450037 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:39.449939 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:22:39.450037 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:39.450003 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret podName:afb4b042-5e50-4298-af62-23c520feeb7c nodeName:}" failed. No retries permitted until 2026-07-21 18:22:43.449984344 +0000 UTC m=+10.073711552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret") pod "global-pull-secret-syncer-hcwt5" (UID: "afb4b042-5e50-4298-af62-23c520feeb7c") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:22:39.450037 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:39.450013 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:22:39.450199 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:39.450078 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs podName:32340abc-8237-453b-96e1-2ab5d9aa5d67 nodeName:}" failed. No retries permitted until 2026-07-21 18:22:43.450059706 +0000 UTC m=+10.073786925 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs") pod "network-metrics-daemon-r2m2h" (UID: "32340abc-8237-453b-96e1-2ab5d9aa5d67") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:22:39.652276 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:39.651676 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tcg2\" (UniqueName: \"kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2\") pod \"network-check-target-cc6j9\" (UID: \"277cbd93-cf42-46f9-91d7-83d45fae8ae1\") " pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:22:39.652276 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:39.651844 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:22:39.652276 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:39.651866 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:22:39.652276 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:39.651880 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9tcg2 for pod openshift-network-diagnostics/network-check-target-cc6j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:22:39.652276 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:39.651938 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2 podName:277cbd93-cf42-46f9-91d7-83d45fae8ae1 nodeName:}" failed. No retries permitted until 2026-07-21 18:22:43.651919107 +0000 UTC m=+10.275646315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9tcg2" (UniqueName: "kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2") pod "network-check-target-cc6j9" (UID: "277cbd93-cf42-46f9-91d7-83d45fae8ae1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:22:41.003799 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:41.003766 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:22:41.004213 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:41.003889 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc6j9" podUID="277cbd93-cf42-46f9-91d7-83d45fae8ae1" Jul 21 18:22:41.004213 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:41.004040 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:41.004213 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:41.004164 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2m2h" podUID="32340abc-8237-453b-96e1-2ab5d9aa5d67" Jul 21 18:22:41.004213 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:41.004212 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:41.004388 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:41.004299 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcwt5" podUID="afb4b042-5e50-4298-af62-23c520feeb7c" Jul 21 18:22:43.004677 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:43.004647 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:43.004677 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:43.004678 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:43.005171 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:43.004678 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:22:43.005171 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:43.004770 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcwt5" podUID="afb4b042-5e50-4298-af62-23c520feeb7c" Jul 21 18:22:43.005171 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:43.004909 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2m2h" podUID="32340abc-8237-453b-96e1-2ab5d9aa5d67" Jul 21 18:22:43.005171 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:43.004975 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc6j9" podUID="277cbd93-cf42-46f9-91d7-83d45fae8ae1" Jul 21 18:22:43.483946 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:43.483862 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret\") pod \"global-pull-secret-syncer-hcwt5\" (UID: \"afb4b042-5e50-4298-af62-23c520feeb7c\") " pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:43.483946 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:43.483943 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs\") pod \"network-metrics-daemon-r2m2h\" (UID: \"32340abc-8237-453b-96e1-2ab5d9aa5d67\") " pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:43.484134 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:43.484065 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:22:43.484134 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:43.484128 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs podName:32340abc-8237-453b-96e1-2ab5d9aa5d67 nodeName:}" failed. No retries permitted until 2026-07-21 18:22:51.484114169 +0000 UTC m=+18.107841375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs") pod "network-metrics-daemon-r2m2h" (UID: "32340abc-8237-453b-96e1-2ab5d9aa5d67") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:22:43.484363 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:43.484340 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:22:43.484480 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:43.484411 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret podName:afb4b042-5e50-4298-af62-23c520feeb7c nodeName:}" failed. No retries permitted until 2026-07-21 18:22:51.484392601 +0000 UTC m=+18.108119808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret") pod "global-pull-secret-syncer-hcwt5" (UID: "afb4b042-5e50-4298-af62-23c520feeb7c") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:22:43.685565 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:43.685384 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tcg2\" (UniqueName: \"kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2\") pod \"network-check-target-cc6j9\" (UID: \"277cbd93-cf42-46f9-91d7-83d45fae8ae1\") " pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:22:43.685764 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:43.685586 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:22:43.685764 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:43.685628 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:22:43.685764 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:43.685643 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9tcg2 for pod openshift-network-diagnostics/network-check-target-cc6j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:22:43.685764 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:43.685704 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2 podName:277cbd93-cf42-46f9-91d7-83d45fae8ae1 nodeName:}" failed. No retries permitted until 2026-07-21 18:22:51.68568491 +0000 UTC m=+18.309412120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9tcg2" (UniqueName: "kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2") pod "network-check-target-cc6j9" (UID: "277cbd93-cf42-46f9-91d7-83d45fae8ae1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:22:45.004585 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:45.004418 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:22:45.004585 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:45.004466 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:45.004585 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:45.004466 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:45.004585 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:45.004551 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc6j9" podUID="277cbd93-cf42-46f9-91d7-83d45fae8ae1" Jul 21 18:22:45.005178 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:45.004698 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcwt5" podUID="afb4b042-5e50-4298-af62-23c520feeb7c" Jul 21 18:22:45.005178 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:45.004819 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2m2h" podUID="32340abc-8237-453b-96e1-2ab5d9aa5d67" Jul 21 18:22:47.004543 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:47.004494 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:47.005034 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:47.004640 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcwt5" podUID="afb4b042-5e50-4298-af62-23c520feeb7c" Jul 21 18:22:47.005034 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:47.005007 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:22:47.005034 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:47.005036 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:47.005207 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:47.005120 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc6j9" podUID="277cbd93-cf42-46f9-91d7-83d45fae8ae1" Jul 21 18:22:47.005262 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:47.005214 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2m2h" podUID="32340abc-8237-453b-96e1-2ab5d9aa5d67" Jul 21 18:22:49.004468 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:49.004427 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:49.004919 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:49.004547 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:49.004919 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:49.004551 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcwt5" podUID="afb4b042-5e50-4298-af62-23c520feeb7c" Jul 21 18:22:49.004919 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:49.004693 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2m2h" podUID="32340abc-8237-453b-96e1-2ab5d9aa5d67" Jul 21 18:22:49.004919 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:49.004731 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:22:49.004919 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:49.004795 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc6j9" podUID="277cbd93-cf42-46f9-91d7-83d45fae8ae1" Jul 21 18:22:51.005853 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:51.003784 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:51.005853 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:51.003805 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:51.005853 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:51.003912 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:22:51.005853 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:51.003930 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2m2h" podUID="32340abc-8237-453b-96e1-2ab5d9aa5d67" Jul 21 18:22:51.005853 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:51.004008 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcwt5" podUID="afb4b042-5e50-4298-af62-23c520feeb7c" Jul 21 18:22:51.005853 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:51.004067 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc6j9" podUID="277cbd93-cf42-46f9-91d7-83d45fae8ae1" Jul 21 18:22:51.543755 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:51.543715 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret\") pod \"global-pull-secret-syncer-hcwt5\" (UID: \"afb4b042-5e50-4298-af62-23c520feeb7c\") " pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:51.543941 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:51.543884 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:22:51.543941 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:51.543885 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs\") pod \"network-metrics-daemon-r2m2h\" (UID: \"32340abc-8237-453b-96e1-2ab5d9aa5d67\") " pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:51.544063 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:51.543959 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret podName:afb4b042-5e50-4298-af62-23c520feeb7c nodeName:}" failed. No retries permitted until 2026-07-21 18:23:07.543938477 +0000 UTC m=+34.167665686 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret") pod "global-pull-secret-syncer-hcwt5" (UID: "afb4b042-5e50-4298-af62-23c520feeb7c") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:22:51.544063 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:51.543973 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:22:51.544063 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:51.544028 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs podName:32340abc-8237-453b-96e1-2ab5d9aa5d67 nodeName:}" failed. No retries permitted until 2026-07-21 18:23:07.54401264 +0000 UTC m=+34.167739854 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs") pod "network-metrics-daemon-r2m2h" (UID: "32340abc-8237-453b-96e1-2ab5d9aa5d67") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:22:51.745131 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:51.745100 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tcg2\" (UniqueName: \"kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2\") pod \"network-check-target-cc6j9\" (UID: \"277cbd93-cf42-46f9-91d7-83d45fae8ae1\") " pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:22:51.745286 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:51.745242 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:22:51.745286 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:51.745260 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:22:51.745286 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:51.745269 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9tcg2 for pod openshift-network-diagnostics/network-check-target-cc6j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:22:51.745471 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:51.745332 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2 podName:277cbd93-cf42-46f9-91d7-83d45fae8ae1 nodeName:}" failed. No retries permitted until 2026-07-21 18:23:07.745317063 +0000 UTC m=+34.369044286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9tcg2" (UniqueName: "kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2") pod "network-check-target-cc6j9" (UID: "277cbd93-cf42-46f9-91d7-83d45fae8ae1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:22:53.004374 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:53.004342 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:53.004809 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:53.004342 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:53.004809 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:53.004477 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcwt5" podUID="afb4b042-5e50-4298-af62-23c520feeb7c" Jul 21 18:22:53.004809 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:53.004342 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:22:53.004809 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:53.004585 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2m2h" podUID="32340abc-8237-453b-96e1-2ab5d9aa5d67" Jul 21 18:22:53.004809 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:53.004691 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc6j9" podUID="277cbd93-cf42-46f9-91d7-83d45fae8ae1" Jul 21 18:22:55.004119 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:55.004080 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:55.004567 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:55.004163 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:55.004567 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:55.004173 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:22:55.004567 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:55.004286 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2m2h" podUID="32340abc-8237-453b-96e1-2ab5d9aa5d67" Jul 21 18:22:55.004567 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:55.004355 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcwt5" podUID="afb4b042-5e50-4298-af62-23c520feeb7c" Jul 21 18:22:55.004567 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:55.004440 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc6j9" podUID="277cbd93-cf42-46f9-91d7-83d45fae8ae1" Jul 21 18:22:56.194891 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:56.194539 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cvvn6" event={"ID":"a23526ee-19c4-46c0-94e4-172fe1edcb9d","Type":"ContainerStarted","Data":"71e524db55948b766d54c21878afdb027759ae5c8d5f2d24c842623f71b7638f"} Jul 21 18:22:56.195996 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:56.195973 2567 generic.go:356] "Generic (PLEG): container finished" podID="b9b7e34a-13a2-4a49-87b0-0e0258fd80db" containerID="d13a7504ebcf37d8b832927a48e2f0563a5e28c79370662829e4e91864a28fe7" exitCode=0 Jul 21 18:22:56.196081 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:56.196036 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84wqq" event={"ID":"b9b7e34a-13a2-4a49-87b0-0e0258fd80db","Type":"ContainerDied","Data":"d13a7504ebcf37d8b832927a48e2f0563a5e28c79370662829e4e91864a28fe7"} Jul 21 18:22:56.197475 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:56.197399 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gfxb8" event={"ID":"a7487046-daae-4342-a332-ba55d432ab64","Type":"ContainerStarted","Data":"73600bee5fa72a1e63a6f84ede1ed44a8a6f3ee580c2ee824cf22347415010ef"} Jul 21 18:22:56.199034 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:56.198989 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-97zj8" event={"ID":"755ebec0-a61c-44f1-a421-d08da8909234","Type":"ContainerStarted","Data":"2f68db32ff0c0616610f192b07107ef46277641fb5a824cb51842421d476bb8a"} Jul 21 18:22:56.200374 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:56.200356 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" event={"ID":"73ed484d-3b20-483f-a95f-21bab48a050d","Type":"ContainerStarted","Data":"37d0b36a618c63e1633754e2681742a1b74b46ed8b2d8506cf3fe50068806bb7"} Jul 21 18:22:56.201701 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:56.201678 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" event={"ID":"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90","Type":"ContainerStarted","Data":"de4ec04c8b49f6b49c1b374663bc4e3cd9485930061bcc1b8f910bb57723933c"} Jul 21 18:22:56.203497 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:56.203462 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9h24_2d61b564-c002-4dfa-95e2-3f2adbbde234/ovn-acl-logging/0.log" Jul 21 18:22:56.203925 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:56.203907 2567 generic.go:356] "Generic (PLEG): container finished" podID="2d61b564-c002-4dfa-95e2-3f2adbbde234" containerID="e03b70eeba7f086a337175e9e2f2c115e1947ee5c19ff9a34471b566f827e8e7" exitCode=1 Jul 21 18:22:56.204000 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:56.203956 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" event={"ID":"2d61b564-c002-4dfa-95e2-3f2adbbde234","Type":"ContainerStarted","Data":"721ae45b7dd22b9f6fa41f60f2ef9e4481b0c6f4dc2d71431cbd8b4e1e54ccaf"} Jul 21 18:22:56.204058 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:56.204012 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" event={"ID":"2d61b564-c002-4dfa-95e2-3f2adbbde234","Type":"ContainerDied","Data":"e03b70eeba7f086a337175e9e2f2c115e1947ee5c19ff9a34471b566f827e8e7"} Jul 21 18:22:56.204058 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:56.204052 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" event={"ID":"2d61b564-c002-4dfa-95e2-3f2adbbde234","Type":"ContainerStarted","Data":"0076cce7b18099654ef40444b3abe7242da38a9d76de3c262e62727545763200"} Jul 21 18:22:56.205189 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:56.205170 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kr557" event={"ID":"b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6","Type":"ContainerStarted","Data":"9f429a78b7d6a2cc28dea38adbba76f3e63fd7612bd93c47347687f94ecf9630"} Jul 21 18:22:56.219820 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:56.219782 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-156.ec2.internal" podStartSLOduration=21.219769843999998 podStartE2EDuration="21.219769844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:22:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:22:39.183453882 +0000 UTC m=+5.807181109" watchObservedRunningTime="2026-07-21 18:22:56.219769844 +0000 UTC m=+22.843497072" Jul 21 18:22:56.219996 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:56.219978 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cvvn6" podStartSLOduration=3.612820425 podStartE2EDuration="22.219973883s" totalImagesPullingTime="18.607153458s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:22:56.219474468 +0000 UTC m=+22.843201686" watchObservedRunningTime="2026-07-21 18:22:56.219973883 +0000 UTC m=+22.843701109" Jul 21 18:22:56.282237 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:56.282188 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gfxb8" podStartSLOduration=3.7280155969999997 podStartE2EDuration="22.28217616s" totalImagesPullingTime="18.554160563s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:22:56.282135088 +0000 UTC m=+22.905862315" watchObservedRunningTime="2026-07-21 18:22:56.28217616 +0000 UTC m=+22.905903387" Jul 21 18:22:56.282508 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:56.282487 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-97zj8" podStartSLOduration=11.840481994 podStartE2EDuration="22.282480739s" totalImagesPullingTime="10.441998745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:22:56.261916699 +0000 UTC m=+22.885643926" watchObservedRunningTime="2026-07-21 18:22:56.282480739 +0000 UTC m=+22.906208037" Jul 21 18:22:56.305749 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:56.305705 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k4rw4" podStartSLOduration=3.733537131 podStartE2EDuration="22.305691525s" totalImagesPullingTime="18.572154394s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:22:56.303635041 +0000 UTC m=+22.927362269" watchObservedRunningTime="2026-07-21 18:22:56.305691525 +0000 UTC m=+22.929418752" Jul 21 18:22:56.995785 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:56.995753 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-97zj8" Jul 21 18:22:56.996300 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:56.996284 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-97zj8" Jul 21 18:22:57.003795 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:57.003763 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:22:57.003899 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:57.003862 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:57.003899 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:57.003873 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc6j9" podUID="277cbd93-cf42-46f9-91d7-83d45fae8ae1" Jul 21 18:22:57.003899 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:57.003886 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:57.004017 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:57.003944 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcwt5" podUID="afb4b042-5e50-4298-af62-23c520feeb7c" Jul 21 18:22:57.004068 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:57.004030 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2m2h" podUID="32340abc-8237-453b-96e1-2ab5d9aa5d67" Jul 21 18:22:57.016021 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:57.015983 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kr557" podStartSLOduration=4.461235675 podStartE2EDuration="23.015963047s" totalImagesPullingTime="18.554727372s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:22:56.328102491 +0000 UTC m=+22.951829718" watchObservedRunningTime="2026-07-21 18:22:57.015963047 +0000 UTC m=+23.639690274" Jul 21 18:22:57.209404 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:57.209368 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rz4tw" event={"ID":"ffea9ae8-d7cf-4f21-9622-6a1aca2b552f","Type":"ContainerStarted","Data":"ccc1425d3e91f81927f23ed461c925c5e54927a4d8232c7bfff26beff85298f3"} Jul 21 18:22:57.213431 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:57.213367 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9h24_2d61b564-c002-4dfa-95e2-3f2adbbde234/ovn-acl-logging/0.log" Jul 21 18:22:57.213997 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:57.213967 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" event={"ID":"2d61b564-c002-4dfa-95e2-3f2adbbde234","Type":"ContainerStarted","Data":"5497ea21cc9c2a15e082096bc81b3d726e38de770189e75e5a8ba51f492b0e12"} Jul 21 18:22:57.214101 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:57.214048 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" event={"ID":"2d61b564-c002-4dfa-95e2-3f2adbbde234","Type":"ContainerStarted","Data":"b58f820d9cbf20e767913cb0a7983aa434042d5babedd9a5104451e67ee0a17f"} Jul 21 18:22:57.214101 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:57.214100 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" event={"ID":"2d61b564-c002-4dfa-95e2-3f2adbbde234","Type":"ContainerStarted","Data":"9236b2190a64fc3cc044d3e0ac2688b6f214af03b771b835e00913eee1a8a1a4"} Jul 21 18:22:57.214688 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:57.214460 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-97zj8" Jul 21 18:22:57.215152 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:57.215134 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-97zj8" Jul 21 18:22:57.230433 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:57.230385 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rz4tw" podStartSLOduration=4.673508495 podStartE2EDuration="23.230367275s" totalImagesPullingTime="18.55685878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:22:57.229934902 +0000 UTC m=+23.853662129" watchObservedRunningTime="2026-07-21 18:22:57.230367275 +0000 UTC m=+23.854094503" Jul 21 18:22:57.329085 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:57.329061 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 21 18:22:57.904368 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:57.904236 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T18:22:57.329080854Z","UUID":"08108ea9-7dde-4a7a-90db-f3165f63756c","Handler":null,"Name":"","Endpoint":""} Jul 21 18:22:57.907831 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:57.907807 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 21 18:22:57.907982 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:57.907844 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 21 18:22:58.220080 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:58.219597 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" event={"ID":"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90","Type":"ContainerStarted","Data":"ba7b7c73334020a11de4dc65f150427fbf7a34cabee3d2ca7722e98f532f947c"} Jul 21 18:22:59.004253 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:59.004023 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:22:59.004493 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:59.004051 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:22:59.004493 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:59.004097 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:22:59.004493 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:59.004361 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcwt5" podUID="afb4b042-5e50-4298-af62-23c520feeb7c" Jul 21 18:22:59.004677 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:59.004491 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2m2h" podUID="32340abc-8237-453b-96e1-2ab5d9aa5d67" Jul 21 18:22:59.004677 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:22:59.004593 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc6j9" podUID="277cbd93-cf42-46f9-91d7-83d45fae8ae1" Jul 21 18:22:59.224497 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:59.224462 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" event={"ID":"b2a0a656-2f97-4a13-a9d7-bb14c2e02a90","Type":"ContainerStarted","Data":"dc95f7d226030cc6ffdf092e37f218512266b53b8ce61f04bf784e0bac7002d1"} Jul 21 18:22:59.228083 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:59.228064 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9h24_2d61b564-c002-4dfa-95e2-3f2adbbde234/ovn-acl-logging/0.log" Jul 21 18:22:59.228537 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:59.228510 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" event={"ID":"2d61b564-c002-4dfa-95e2-3f2adbbde234","Type":"ContainerStarted","Data":"dac6c3646a9223705213a32de9065bfd9403dfc1350b72d93308349e62341688"} Jul 21 18:22:59.244136 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:22:59.244096 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f95dj" podStartSLOduration=4.096632884 podStartE2EDuration="25.244078182s" totalImagesPullingTime="21.147445298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:22:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:22:59.24396353 +0000 UTC m=+25.867690757" watchObservedRunningTime="2026-07-21 18:22:59.244078182 +0000 UTC m=+25.867805412" Jul 21 18:23:01.004635 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:01.004471 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:23:01.005171 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:01.004492 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:23:01.005171 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:01.004730 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc6j9" podUID="277cbd93-cf42-46f9-91d7-83d45fae8ae1" Jul 21 18:23:01.005171 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:01.004494 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:23:01.005171 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:01.004779 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcwt5" podUID="afb4b042-5e50-4298-af62-23c520feeb7c" Jul 21 18:23:01.005171 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:01.004877 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2m2h" podUID="32340abc-8237-453b-96e1-2ab5d9aa5d67" Jul 21 18:23:01.236155 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:01.236060 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9h24_2d61b564-c002-4dfa-95e2-3f2adbbde234/ovn-acl-logging/0.log" Jul 21 18:23:01.236390 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:01.236367 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" event={"ID":"2d61b564-c002-4dfa-95e2-3f2adbbde234","Type":"ContainerStarted","Data":"54bcf4de7147be1c31c4176814247027cd5cbc3e127859561f807554ce4c6aee"} Jul 21 18:23:01.236684 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:01.236603 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:23:01.236954 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:01.236926 2567 scope.go:117] "RemoveContainer" containerID="e03b70eeba7f086a337175e9e2f2c115e1947ee5c19ff9a34471b566f827e8e7" Jul 21 18:23:01.238274 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:01.238249 2567 generic.go:356] "Generic (PLEG): container finished" podID="b9b7e34a-13a2-4a49-87b0-0e0258fd80db" containerID="a97ab9dd7831f31b073221af282b683ebe335806b59e316bd0a7ce2215342fff" exitCode=0 Jul 21 18:23:01.238358 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:01.238299 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84wqq" event={"ID":"b9b7e34a-13a2-4a49-87b0-0e0258fd80db","Type":"ContainerDied","Data":"a97ab9dd7831f31b073221af282b683ebe335806b59e316bd0a7ce2215342fff"} Jul 21 18:23:01.253576 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:01.253552 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:23:02.245874 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:02.245850 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9h24_2d61b564-c002-4dfa-95e2-3f2adbbde234/ovn-acl-logging/0.log" Jul 21 18:23:02.246359 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:02.246207 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" event={"ID":"2d61b564-c002-4dfa-95e2-3f2adbbde234","Type":"ContainerStarted","Data":"5296eeead9e48a2c0eebd4cd43734d1709d83d17a08c39f03a8229e785f73c9a"} Jul 21 18:23:02.246513 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:02.246495 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:23:02.246649 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:02.246634 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:23:02.261332 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:02.261313 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:23:02.274441 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:02.274400 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" podStartSLOduration=9.655953663 podStartE2EDuration="28.274385682s" totalImagesPullingTime="18.618432019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:23:02.273159195 +0000 UTC m=+28.896886422" watchObservedRunningTime="2026-07-21 18:23:02.274385682 +0000 UTC m=+28.898112906" Jul 21 18:23:03.004804 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:03.004633 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:23:03.005002 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:03.004639 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:23:03.005002 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:03.004892 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcwt5" podUID="afb4b042-5e50-4298-af62-23c520feeb7c" Jul 21 18:23:03.005002 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:03.004664 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:23:03.005002 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:03.004951 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2m2h" podUID="32340abc-8237-453b-96e1-2ab5d9aa5d67" Jul 21 18:23:03.005153 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:03.005002 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc6j9" podUID="277cbd93-cf42-46f9-91d7-83d45fae8ae1" Jul 21 18:23:03.089831 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:03.089798 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r2m2h"] Jul 21 18:23:03.090522 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:03.090499 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hcwt5"] Jul 21 18:23:03.092304 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:03.092283 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cc6j9"] Jul 21 18:23:03.250500 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:03.250469 2567 generic.go:356] "Generic (PLEG): container finished" podID="b9b7e34a-13a2-4a49-87b0-0e0258fd80db" containerID="05dd031a5a0dce9adce50236f93e7c8079ff2e10ae6d72e52fa03ecdfc8e81c5" exitCode=0 Jul 21 18:23:03.251052 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:03.250541 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:23:03.251052 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:03.250566 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84wqq" event={"ID":"b9b7e34a-13a2-4a49-87b0-0e0258fd80db","Type":"ContainerDied","Data":"05dd031a5a0dce9adce50236f93e7c8079ff2e10ae6d72e52fa03ecdfc8e81c5"} Jul 21 18:23:03.251052 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:03.250641 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:23:03.251052 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:03.250758 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc6j9" podUID="277cbd93-cf42-46f9-91d7-83d45fae8ae1" Jul 21 18:23:03.251365 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:03.251066 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:23:03.251365 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:03.251152 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2m2h" podUID="32340abc-8237-453b-96e1-2ab5d9aa5d67" Jul 21 18:23:03.251365 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:03.251209 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcwt5" podUID="afb4b042-5e50-4298-af62-23c520feeb7c" Jul 21 18:23:05.004767 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:05.004732 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:23:05.005402 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:05.004845 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:23:05.005402 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:05.004858 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc6j9" podUID="277cbd93-cf42-46f9-91d7-83d45fae8ae1" Jul 21 18:23:05.005402 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:05.004874 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:23:05.005402 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:05.004947 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcwt5" podUID="afb4b042-5e50-4298-af62-23c520feeb7c" Jul 21 18:23:05.005402 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:05.005012 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2m2h" podUID="32340abc-8237-453b-96e1-2ab5d9aa5d67" Jul 21 18:23:05.257822 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:05.257791 2567 generic.go:356] "Generic (PLEG): container finished" podID="b9b7e34a-13a2-4a49-87b0-0e0258fd80db" containerID="7594c0fcc003980757dca09630fc83d774318a0bf6c92056eb8059afd5bc4614" exitCode=0 Jul 21 18:23:05.257990 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:05.257832 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84wqq" event={"ID":"b9b7e34a-13a2-4a49-87b0-0e0258fd80db","Type":"ContainerDied","Data":"7594c0fcc003980757dca09630fc83d774318a0bf6c92056eb8059afd5bc4614"} Jul 21 18:23:07.004139 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:07.004104 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:23:07.004714 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:07.004146 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:23:07.004714 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:07.004146 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:23:07.004714 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:07.004229 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc6j9" podUID="277cbd93-cf42-46f9-91d7-83d45fae8ae1" Jul 21 18:23:07.004714 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:07.004306 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcwt5" podUID="afb4b042-5e50-4298-af62-23c520feeb7c" Jul 21 18:23:07.004714 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:07.004377 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2m2h" podUID="32340abc-8237-453b-96e1-2ab5d9aa5d67" Jul 21 18:23:07.565601 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:07.565564 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs\") pod \"network-metrics-daemon-r2m2h\" (UID: \"32340abc-8237-453b-96e1-2ab5d9aa5d67\") " pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:23:07.565780 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:07.565650 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret\") pod \"global-pull-secret-syncer-hcwt5\" (UID: \"afb4b042-5e50-4298-af62-23c520feeb7c\") " pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:23:07.565780 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:07.565731 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:23:07.565780 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:07.565763 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:23:07.565939 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:07.565811 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs podName:32340abc-8237-453b-96e1-2ab5d9aa5d67 nodeName:}" failed. No retries permitted until 2026-07-21 18:23:39.565790801 +0000 UTC m=+66.189518010 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs") pod "network-metrics-daemon-r2m2h" (UID: "32340abc-8237-453b-96e1-2ab5d9aa5d67") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:23:07.565939 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:07.565831 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret podName:afb4b042-5e50-4298-af62-23c520feeb7c nodeName:}" failed. No retries permitted until 2026-07-21 18:23:39.565820962 +0000 UTC m=+66.189548166 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret") pod "global-pull-secret-syncer-hcwt5" (UID: "afb4b042-5e50-4298-af62-23c520feeb7c") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:23:07.767366 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:07.767334 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tcg2\" (UniqueName: \"kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2\") pod \"network-check-target-cc6j9\" (UID: \"277cbd93-cf42-46f9-91d7-83d45fae8ae1\") " pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:23:07.767535 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:07.767490 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:23:07.767535 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:07.767508 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:23:07.767535 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:07.767518 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9tcg2 for pod openshift-network-diagnostics/network-check-target-cc6j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:23:07.767678 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:07.767570 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2 podName:277cbd93-cf42-46f9-91d7-83d45fae8ae1 nodeName:}" failed. No retries permitted until 2026-07-21 18:23:39.767553047 +0000 UTC m=+66.391280272 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9tcg2" (UniqueName: "kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2") pod "network-check-target-cc6j9" (UID: "277cbd93-cf42-46f9-91d7-83d45fae8ae1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:23:07.913721 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:07.913696 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gfxb8_a7487046-daae-4342-a332-ba55d432ab64/dns-node-resolver/0.log" Jul 21 18:23:08.684458 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:08.684431 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kr557_b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6/node-ca/0.log" Jul 21 18:23:09.004754 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:09.004721 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:23:09.004929 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:09.004833 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:23:09.004929 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:09.004841 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hcwt5" podUID="afb4b042-5e50-4298-af62-23c520feeb7c" Jul 21 18:23:09.005029 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:09.004961 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r2m2h" podUID="32340abc-8237-453b-96e1-2ab5d9aa5d67" Jul 21 18:23:09.005029 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:09.004843 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:23:09.005112 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:09.005052 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc6j9" podUID="277cbd93-cf42-46f9-91d7-83d45fae8ae1" Jul 21 18:23:09.535408 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:09.535382 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-156.ec2.internal" event="NodeReady" Jul 21 18:23:09.535585 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:09.535532 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 21 18:23:10.273142 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:10.272964 2567 generic.go:356] "Generic (PLEG): container finished" podID="b9b7e34a-13a2-4a49-87b0-0e0258fd80db" containerID="2901ee51d4649c9dd02c15d998b2a2c7c37a687afcd44594952092e189eb9702" exitCode=0 Jul 21 18:23:10.273142 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:10.273043 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84wqq" event={"ID":"b9b7e34a-13a2-4a49-87b0-0e0258fd80db","Type":"ContainerDied","Data":"2901ee51d4649c9dd02c15d998b2a2c7c37a687afcd44594952092e189eb9702"} Jul 21 18:23:11.003999 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:11.003968 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:23:11.004199 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:11.004006 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:23:11.004199 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:11.003969 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:23:11.008081 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:11.007936 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qslh2\"" Jul 21 18:23:11.008081 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:11.007961 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wsd6r\"" Jul 21 18:23:11.008081 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:11.007969 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 18:23:11.008081 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:11.007947 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 18:23:11.008081 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:11.007985 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 18:23:11.008081 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:11.008064 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 18:23:11.278281 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:11.278195 2567 generic.go:356] "Generic (PLEG): container finished" podID="b9b7e34a-13a2-4a49-87b0-0e0258fd80db" containerID="5dae3b7b8dcb2ef88e5bfffb77fd67a27116d2459211e9d132302712d0248f44" exitCode=0 Jul 21 18:23:11.278715 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:11.278273 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84wqq" event={"ID":"b9b7e34a-13a2-4a49-87b0-0e0258fd80db","Type":"ContainerDied","Data":"5dae3b7b8dcb2ef88e5bfffb77fd67a27116d2459211e9d132302712d0248f44"} Jul 21 18:23:12.283158 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:12.283129 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84wqq" event={"ID":"b9b7e34a-13a2-4a49-87b0-0e0258fd80db","Type":"ContainerStarted","Data":"bda08aacf236febcdfee54517ad573994f54db81d911a9fd1c1ae3ecb4e3f6d1"} Jul 21 18:23:12.309411 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:12.309333 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-84wqq" podStartSLOduration=8.077195985 podStartE2EDuration="38.309316991s" totalImagesPullingTime="30.232121006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:22:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:23:12.307788836 +0000 UTC m=+38.931516062" watchObservedRunningTime="2026-07-21 18:23:12.309316991 +0000 UTC m=+38.933044217" Jul 21 18:23:28.294454 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.294420 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5t8n8"] Jul 21 18:23:28.325358 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.325333 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-q9p7m"] Jul 21 18:23:28.325495 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.325443 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5t8n8" Jul 21 18:23:28.328343 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.328320 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 21 18:23:28.328462 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.328351 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 21 18:23:28.328462 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.328352 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n69vd\"" Jul 21 18:23:28.328696 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.328680 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 21 18:23:28.339246 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.339227 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5t8n8"] Jul 21 18:23:28.339339 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.339256 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q9p7m"] Jul 21 18:23:28.339339 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.339273 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4jc74"] Jul 21 18:23:28.339409 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.339348 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q9p7m" Jul 21 18:23:28.341705 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.341686 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ksc4f\"" Jul 21 18:23:28.341802 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.341786 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 21 18:23:28.342011 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.341998 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 21 18:23:28.357360 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.357344 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4jc74"] Jul 21 18:23:28.357446 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.357437 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4jc74" Jul 21 18:23:28.360259 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.360232 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9qnd5\"" Jul 21 18:23:28.360361 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.360241 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 21 18:23:28.360361 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.360243 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 21 18:23:28.360361 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.360278 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 21 18:23:28.360361 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.360242 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 21 18:23:28.410542 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.410515 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88bsm\" (UniqueName: \"kubernetes.io/projected/134b26f8-0815-49bc-94ed-c418fbd78c95-kube-api-access-88bsm\") pod \"ingress-canary-5t8n8\" (UID: \"134b26f8-0815-49bc-94ed-c418fbd78c95\") " pod="openshift-ingress-canary/ingress-canary-5t8n8" Jul 21 18:23:28.410692 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.410548 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/134b26f8-0815-49bc-94ed-c418fbd78c95-cert\") pod \"ingress-canary-5t8n8\" (UID: \"134b26f8-0815-49bc-94ed-c418fbd78c95\") " pod="openshift-ingress-canary/ingress-canary-5t8n8" Jul 21 18:23:28.511015 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.510988 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88bsm\" (UniqueName: \"kubernetes.io/projected/134b26f8-0815-49bc-94ed-c418fbd78c95-kube-api-access-88bsm\") pod \"ingress-canary-5t8n8\" (UID: \"134b26f8-0815-49bc-94ed-c418fbd78c95\") " pod="openshift-ingress-canary/ingress-canary-5t8n8" Jul 21 18:23:28.511180 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.511022 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2665ac35-c08f-4e0b-821a-8c6745208ffd-data-volume\") pod \"insights-runtime-extractor-4jc74\" (UID: \"2665ac35-c08f-4e0b-821a-8c6745208ffd\") " pod="openshift-insights/insights-runtime-extractor-4jc74" Jul 21 18:23:28.511180 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.511044 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87b4900f-e337-4ce2-9421-5e92113d7489-metrics-tls\") pod \"dns-default-q9p7m\" (UID: \"87b4900f-e337-4ce2-9421-5e92113d7489\") " pod="openshift-dns/dns-default-q9p7m" Jul 21 18:23:28.511180 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.511062 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/134b26f8-0815-49bc-94ed-c418fbd78c95-cert\") pod \"ingress-canary-5t8n8\" (UID: \"134b26f8-0815-49bc-94ed-c418fbd78c95\") " pod="openshift-ingress-canary/ingress-canary-5t8n8" Jul 21 18:23:28.511180 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.511079 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/87b4900f-e337-4ce2-9421-5e92113d7489-config-volume\") pod \"dns-default-q9p7m\" (UID: \"87b4900f-e337-4ce2-9421-5e92113d7489\") " pod="openshift-dns/dns-default-q9p7m" Jul 21 18:23:28.511180 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.511146 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtf9b\" (UniqueName: \"kubernetes.io/projected/87b4900f-e337-4ce2-9421-5e92113d7489-kube-api-access-vtf9b\") pod \"dns-default-q9p7m\" (UID: \"87b4900f-e337-4ce2-9421-5e92113d7489\") " pod="openshift-dns/dns-default-q9p7m" Jul 21 18:23:28.511352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.511182 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2665ac35-c08f-4e0b-821a-8c6745208ffd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4jc74\" (UID: \"2665ac35-c08f-4e0b-821a-8c6745208ffd\") " pod="openshift-insights/insights-runtime-extractor-4jc74" Jul 21 18:23:28.511352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.511205 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2665ac35-c08f-4e0b-821a-8c6745208ffd-crio-socket\") pod \"insights-runtime-extractor-4jc74\" (UID: \"2665ac35-c08f-4e0b-821a-8c6745208ffd\") " pod="openshift-insights/insights-runtime-extractor-4jc74" Jul 21 18:23:28.511352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.511222 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2665ac35-c08f-4e0b-821a-8c6745208ffd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4jc74\" (UID: \"2665ac35-c08f-4e0b-821a-8c6745208ffd\") " pod="openshift-insights/insights-runtime-extractor-4jc74" Jul 21 18:23:28.511352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.511253 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc4xc\" (UniqueName: \"kubernetes.io/projected/2665ac35-c08f-4e0b-821a-8c6745208ffd-kube-api-access-zc4xc\") pod \"insights-runtime-extractor-4jc74\" (UID: \"2665ac35-c08f-4e0b-821a-8c6745208ffd\") " pod="openshift-insights/insights-runtime-extractor-4jc74" Jul 21 18:23:28.511352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.511269 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87b4900f-e337-4ce2-9421-5e92113d7489-tmp-dir\") pod \"dns-default-q9p7m\" (UID: \"87b4900f-e337-4ce2-9421-5e92113d7489\") " pod="openshift-dns/dns-default-q9p7m" Jul 21 18:23:28.515234 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.515214 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/134b26f8-0815-49bc-94ed-c418fbd78c95-cert\") pod \"ingress-canary-5t8n8\" (UID: \"134b26f8-0815-49bc-94ed-c418fbd78c95\") " pod="openshift-ingress-canary/ingress-canary-5t8n8" Jul 21 18:23:28.518674 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.518653 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88bsm\" (UniqueName: \"kubernetes.io/projected/134b26f8-0815-49bc-94ed-c418fbd78c95-kube-api-access-88bsm\") pod \"ingress-canary-5t8n8\" (UID: \"134b26f8-0815-49bc-94ed-c418fbd78c95\") " pod="openshift-ingress-canary/ingress-canary-5t8n8" Jul 21 18:23:28.611678 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.611573 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc4xc\" (UniqueName: \"kubernetes.io/projected/2665ac35-c08f-4e0b-821a-8c6745208ffd-kube-api-access-zc4xc\") pod \"insights-runtime-extractor-4jc74\" (UID: \"2665ac35-c08f-4e0b-821a-8c6745208ffd\") " pod="openshift-insights/insights-runtime-extractor-4jc74" Jul 21 18:23:28.611678 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.611628 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87b4900f-e337-4ce2-9421-5e92113d7489-tmp-dir\") pod \"dns-default-q9p7m\" (UID: \"87b4900f-e337-4ce2-9421-5e92113d7489\") " pod="openshift-dns/dns-default-q9p7m" Jul 21 18:23:28.611849 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.611721 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2665ac35-c08f-4e0b-821a-8c6745208ffd-data-volume\") pod \"insights-runtime-extractor-4jc74\" (UID: \"2665ac35-c08f-4e0b-821a-8c6745208ffd\") " pod="openshift-insights/insights-runtime-extractor-4jc74" Jul 21 18:23:28.611849 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.611751 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87b4900f-e337-4ce2-9421-5e92113d7489-metrics-tls\") pod \"dns-default-q9p7m\" (UID: \"87b4900f-e337-4ce2-9421-5e92113d7489\") " pod="openshift-dns/dns-default-q9p7m" Jul 21 18:23:28.611849 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.611779 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/87b4900f-e337-4ce2-9421-5e92113d7489-config-volume\") pod \"dns-default-q9p7m\" (UID: \"87b4900f-e337-4ce2-9421-5e92113d7489\") " pod="openshift-dns/dns-default-q9p7m" Jul 21 18:23:28.611849 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.611807 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtf9b\" (UniqueName: \"kubernetes.io/projected/87b4900f-e337-4ce2-9421-5e92113d7489-kube-api-access-vtf9b\") pod \"dns-default-q9p7m\" (UID: \"87b4900f-e337-4ce2-9421-5e92113d7489\") " pod="openshift-dns/dns-default-q9p7m" Jul 21 18:23:28.612037 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.611850 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2665ac35-c08f-4e0b-821a-8c6745208ffd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4jc74\" (UID: \"2665ac35-c08f-4e0b-821a-8c6745208ffd\") " pod="openshift-insights/insights-runtime-extractor-4jc74" Jul 21 18:23:28.612037 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.611876 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2665ac35-c08f-4e0b-821a-8c6745208ffd-crio-socket\") pod \"insights-runtime-extractor-4jc74\" (UID: \"2665ac35-c08f-4e0b-821a-8c6745208ffd\") " pod="openshift-insights/insights-runtime-extractor-4jc74" Jul 21 18:23:28.612037 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.611901 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2665ac35-c08f-4e0b-821a-8c6745208ffd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4jc74\" (UID: \"2665ac35-c08f-4e0b-821a-8c6745208ffd\") " pod="openshift-insights/insights-runtime-extractor-4jc74" Jul 21 18:23:28.612181 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.612071 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87b4900f-e337-4ce2-9421-5e92113d7489-tmp-dir\") pod \"dns-default-q9p7m\" (UID: \"87b4900f-e337-4ce2-9421-5e92113d7489\") " pod="openshift-dns/dns-default-q9p7m" Jul 21 18:23:28.612229 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.612198 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2665ac35-c08f-4e0b-821a-8c6745208ffd-data-volume\") pod \"insights-runtime-extractor-4jc74\" (UID: \"2665ac35-c08f-4e0b-821a-8c6745208ffd\") " pod="openshift-insights/insights-runtime-extractor-4jc74" Jul 21 18:23:28.612288 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.612261 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2665ac35-c08f-4e0b-821a-8c6745208ffd-crio-socket\") pod \"insights-runtime-extractor-4jc74\" (UID: \"2665ac35-c08f-4e0b-821a-8c6745208ffd\") " pod="openshift-insights/insights-runtime-extractor-4jc74" Jul 21 18:23:28.612450 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.612428 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/87b4900f-e337-4ce2-9421-5e92113d7489-config-volume\") pod \"dns-default-q9p7m\" (UID: \"87b4900f-e337-4ce2-9421-5e92113d7489\") " pod="openshift-dns/dns-default-q9p7m" Jul 21 18:23:28.612491 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.612431 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2665ac35-c08f-4e0b-821a-8c6745208ffd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4jc74\" (UID: \"2665ac35-c08f-4e0b-821a-8c6745208ffd\") " pod="openshift-insights/insights-runtime-extractor-4jc74" Jul 21 18:23:28.614121 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.614099 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2665ac35-c08f-4e0b-821a-8c6745208ffd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4jc74\" (UID: \"2665ac35-c08f-4e0b-821a-8c6745208ffd\") " pod="openshift-insights/insights-runtime-extractor-4jc74" Jul 21 18:23:28.614223 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.614126 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87b4900f-e337-4ce2-9421-5e92113d7489-metrics-tls\") pod \"dns-default-q9p7m\" (UID: \"87b4900f-e337-4ce2-9421-5e92113d7489\") " pod="openshift-dns/dns-default-q9p7m" Jul 21 18:23:28.620875 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.620856 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtf9b\" (UniqueName: \"kubernetes.io/projected/87b4900f-e337-4ce2-9421-5e92113d7489-kube-api-access-vtf9b\") pod \"dns-default-q9p7m\" (UID: \"87b4900f-e337-4ce2-9421-5e92113d7489\") " pod="openshift-dns/dns-default-q9p7m" Jul 21 18:23:28.620982 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.620892 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc4xc\" (UniqueName: \"kubernetes.io/projected/2665ac35-c08f-4e0b-821a-8c6745208ffd-kube-api-access-zc4xc\") pod \"insights-runtime-extractor-4jc74\" (UID: \"2665ac35-c08f-4e0b-821a-8c6745208ffd\") " pod="openshift-insights/insights-runtime-extractor-4jc74" Jul 21 18:23:28.633748 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.633731 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5t8n8" Jul 21 18:23:28.646837 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.646818 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q9p7m" Jul 21 18:23:28.664828 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.664805 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4jc74" Jul 21 18:23:28.877531 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:28.877452 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q9p7m"] Jul 21 18:23:28.881377 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:23:28.881353 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87b4900f_e337_4ce2_9421_5e92113d7489.slice/crio-a7c9beffbb4ea69ec2256eab620521f3c40d685973d04ba60e5a6e321e332b50 WatchSource:0}: Error finding container a7c9beffbb4ea69ec2256eab620521f3c40d685973d04ba60e5a6e321e332b50: Status 404 returned error can't find the container with id a7c9beffbb4ea69ec2256eab620521f3c40d685973d04ba60e5a6e321e332b50 Jul 21 18:23:29.049466 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.049435 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74c585cdfd-fqwws"] Jul 21 18:23:29.082302 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.082263 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74c585cdfd-fqwws"] Jul 21 18:23:29.082485 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.082376 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:29.083025 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.083003 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5t8n8"] Jul 21 18:23:29.085861 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.085833 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 21 18:23:29.086085 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.086065 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 21 18:23:29.087474 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.086957 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4kcmh\"" Jul 21 18:23:29.088499 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.088469 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 21 18:23:29.088596 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.088517 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 21 18:23:29.089140 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.089120 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 21 18:23:29.089296 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.089278 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 21 18:23:29.097992 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.097956 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 21 18:23:29.099429 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.099409 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4jc74"] Jul 21 18:23:29.114489 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.114464 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-console-oauth-config\") pod \"console-74c585cdfd-fqwws\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:29.114572 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.114534 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-console-config\") pod \"console-74c585cdfd-fqwws\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:29.114572 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.114555 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-service-ca\") pod \"console-74c585cdfd-fqwws\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:29.114678 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.114573 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-oauth-serving-cert\") pod \"console-74c585cdfd-fqwws\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:29.114717 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.114688 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-console-serving-cert\") pod \"console-74c585cdfd-fqwws\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:29.114717 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.114706 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgb85\" (UniqueName: \"kubernetes.io/projected/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-kube-api-access-tgb85\") pod \"console-74c585cdfd-fqwws\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:29.215938 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.215854 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-service-ca\") pod \"console-74c585cdfd-fqwws\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:29.215938 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.215892 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-oauth-serving-cert\") pod \"console-74c585cdfd-fqwws\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:29.215938 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.215938 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-console-serving-cert\") pod \"console-74c585cdfd-fqwws\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:29.216165 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.215952 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgb85\" (UniqueName: \"kubernetes.io/projected/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-kube-api-access-tgb85\") pod \"console-74c585cdfd-fqwws\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:29.216165 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.215977 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-console-oauth-config\") pod \"console-74c585cdfd-fqwws\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:29.216165 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.216012 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-console-config\") pod \"console-74c585cdfd-fqwws\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:29.216624 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.216592 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-service-ca\") pod \"console-74c585cdfd-fqwws\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:29.216769 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.216724 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-console-config\") pod \"console-74c585cdfd-fqwws\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:29.216769 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.216736 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-oauth-serving-cert\") pod \"console-74c585cdfd-fqwws\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:29.218908 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.218880 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-console-oauth-config\") pod \"console-74c585cdfd-fqwws\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:29.218981 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.218883 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-console-serving-cert\") pod \"console-74c585cdfd-fqwws\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:29.223576 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.223556 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgb85\" (UniqueName: \"kubernetes.io/projected/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-kube-api-access-tgb85\") pod \"console-74c585cdfd-fqwws\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:29.322812 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.322774 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q9p7m" event={"ID":"87b4900f-e337-4ce2-9421-5e92113d7489","Type":"ContainerStarted","Data":"a7c9beffbb4ea69ec2256eab620521f3c40d685973d04ba60e5a6e321e332b50"} Jul 21 18:23:29.324041 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.323986 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4jc74" event={"ID":"2665ac35-c08f-4e0b-821a-8c6745208ffd","Type":"ContainerStarted","Data":"37b136cfe641cbe37d7f1dba812f071be9e0b2c62cf5b634e403b59aaf5e4109"} Jul 21 18:23:29.325214 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.325184 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5t8n8" event={"ID":"134b26f8-0815-49bc-94ed-c418fbd78c95","Type":"ContainerStarted","Data":"ef0c483293961c6cb8e7c65d9718c57ddfcecef4583063fa8cd445f6146b9f3c"} Jul 21 18:23:29.401623 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.401580 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:29.560064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:29.559988 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74c585cdfd-fqwws"] Jul 21 18:23:29.563969 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:23:29.563924 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod813af2b5_49cc_4d2f_b37d_fff34d8cd5a2.slice/crio-4e46be5a6bff1c07f7b9d52cdb3879ad9e3456b804de1da6dd39dfa1bade21c2 WatchSource:0}: Error finding container 4e46be5a6bff1c07f7b9d52cdb3879ad9e3456b804de1da6dd39dfa1bade21c2: Status 404 returned error can't find the container with id 4e46be5a6bff1c07f7b9d52cdb3879ad9e3456b804de1da6dd39dfa1bade21c2 Jul 21 18:23:30.330300 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:30.330226 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c585cdfd-fqwws" event={"ID":"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2","Type":"ContainerStarted","Data":"4e46be5a6bff1c07f7b9d52cdb3879ad9e3456b804de1da6dd39dfa1bade21c2"} Jul 21 18:23:31.337052 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.336991 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q9p7m" event={"ID":"87b4900f-e337-4ce2-9421-5e92113d7489","Type":"ContainerStarted","Data":"1b3b48299b1c385eef2e852e28032a43749ce363c97706c58d09387f4b1daa7f"} Jul 21 18:23:31.357095 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.357065 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm"] Jul 21 18:23:31.374758 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.374538 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm" Jul 21 18:23:31.375311 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.374411 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm"] Jul 21 18:23:31.377471 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.377446 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 21 18:23:31.377802 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.377450 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 21 18:23:31.379740 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.379455 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-875bb\"" Jul 21 18:23:31.379740 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.379505 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 21 18:23:31.379740 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.379526 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 21 18:23:31.379740 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.379506 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 21 18:23:31.431785 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.431759 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh9n2\" (UniqueName: \"kubernetes.io/projected/a68d1c4b-e317-43ad-858f-5785999f6912-kube-api-access-fh9n2\") pod \"prometheus-operator-5945b5cfd-fkwcm\" (UID: \"a68d1c4b-e317-43ad-858f-5785999f6912\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm" Jul 21 18:23:31.431897 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.431796 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a68d1c4b-e317-43ad-858f-5785999f6912-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-fkwcm\" (UID: \"a68d1c4b-e317-43ad-858f-5785999f6912\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm" Jul 21 18:23:31.431897 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.431881 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a68d1c4b-e317-43ad-858f-5785999f6912-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-fkwcm\" (UID: \"a68d1c4b-e317-43ad-858f-5785999f6912\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm" Jul 21 18:23:31.431990 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.431913 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a68d1c4b-e317-43ad-858f-5785999f6912-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-fkwcm\" (UID: \"a68d1c4b-e317-43ad-858f-5785999f6912\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm" Jul 21 18:23:31.532469 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.532439 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a68d1c4b-e317-43ad-858f-5785999f6912-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-fkwcm\" (UID: \"a68d1c4b-e317-43ad-858f-5785999f6912\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm" Jul 21 18:23:31.532469 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.532482 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a68d1c4b-e317-43ad-858f-5785999f6912-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-fkwcm\" (UID: \"a68d1c4b-e317-43ad-858f-5785999f6912\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm" Jul 21 18:23:31.532755 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.532531 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh9n2\" (UniqueName: \"kubernetes.io/projected/a68d1c4b-e317-43ad-858f-5785999f6912-kube-api-access-fh9n2\") pod \"prometheus-operator-5945b5cfd-fkwcm\" (UID: \"a68d1c4b-e317-43ad-858f-5785999f6912\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm" Jul 21 18:23:31.532755 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.532561 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a68d1c4b-e317-43ad-858f-5785999f6912-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-fkwcm\" (UID: \"a68d1c4b-e317-43ad-858f-5785999f6912\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm" Jul 21 18:23:31.532755 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:31.532707 2567 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 21 18:23:31.532895 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:31.532771 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a68d1c4b-e317-43ad-858f-5785999f6912-prometheus-operator-tls podName:a68d1c4b-e317-43ad-858f-5785999f6912 nodeName:}" failed. No retries permitted until 2026-07-21 18:23:32.032751115 +0000 UTC m=+58.656478334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a68d1c4b-e317-43ad-858f-5785999f6912-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-fkwcm" (UID: "a68d1c4b-e317-43ad-858f-5785999f6912") : secret "prometheus-operator-tls" not found Jul 21 18:23:31.534065 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.534016 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a68d1c4b-e317-43ad-858f-5785999f6912-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-fkwcm\" (UID: \"a68d1c4b-e317-43ad-858f-5785999f6912\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm" Jul 21 18:23:31.536331 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.536300 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a68d1c4b-e317-43ad-858f-5785999f6912-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-fkwcm\" (UID: \"a68d1c4b-e317-43ad-858f-5785999f6912\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm" Jul 21 18:23:31.541945 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:31.541901 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh9n2\" (UniqueName: \"kubernetes.io/projected/a68d1c4b-e317-43ad-858f-5785999f6912-kube-api-access-fh9n2\") pod \"prometheus-operator-5945b5cfd-fkwcm\" (UID: \"a68d1c4b-e317-43ad-858f-5785999f6912\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm" Jul 21 18:23:32.037376 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:32.037342 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a68d1c4b-e317-43ad-858f-5785999f6912-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-fkwcm\" (UID: \"a68d1c4b-e317-43ad-858f-5785999f6912\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm" Jul 21 18:23:32.037562 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:32.037465 2567 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 21 18:23:32.037562 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:32.037544 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a68d1c4b-e317-43ad-858f-5785999f6912-prometheus-operator-tls podName:a68d1c4b-e317-43ad-858f-5785999f6912 nodeName:}" failed. No retries permitted until 2026-07-21 18:23:33.03752495 +0000 UTC m=+59.661252161 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a68d1c4b-e317-43ad-858f-5785999f6912-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-fkwcm" (UID: "a68d1c4b-e317-43ad-858f-5785999f6912") : secret "prometheus-operator-tls" not found Jul 21 18:23:32.342620 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:32.342521 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q9p7m" event={"ID":"87b4900f-e337-4ce2-9421-5e92113d7489","Type":"ContainerStarted","Data":"9569d651b51b07b382dd0a4f1be3b246fdaff796fae66d1568707fecfb18989d"} Jul 21 18:23:32.343120 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:32.343097 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-q9p7m" Jul 21 18:23:32.362089 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:32.362035 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-q9p7m" podStartSLOduration=2.043963553 podStartE2EDuration="4.362020415s" totalImagesPullingTime="2.318056862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:23:32.360738705 +0000 UTC m=+58.984465932" watchObservedRunningTime="2026-07-21 18:23:32.362020415 +0000 UTC m=+58.985747642" Jul 21 18:23:33.046730 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:33.046695 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a68d1c4b-e317-43ad-858f-5785999f6912-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-fkwcm\" (UID: \"a68d1c4b-e317-43ad-858f-5785999f6912\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm" Jul 21 18:23:33.049116 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:33.049090 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a68d1c4b-e317-43ad-858f-5785999f6912-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-fkwcm\" (UID: \"a68d1c4b-e317-43ad-858f-5785999f6912\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm" Jul 21 18:23:33.194335 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:33.194297 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm" Jul 21 18:23:34.265499 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:34.265471 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9h24" Jul 21 18:23:36.149153 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:36.148507 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm"] Jul 21 18:23:36.155046 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:23:36.155009 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda68d1c4b_e317_43ad_858f_5785999f6912.slice/crio-2e21146b277fa3838ace9b65c8dbb921af4d282356b4d885c016595c118b4e12 WatchSource:0}: Error finding container 2e21146b277fa3838ace9b65c8dbb921af4d282356b4d885c016595c118b4e12: Status 404 returned error can't find the container with id 2e21146b277fa3838ace9b65c8dbb921af4d282356b4d885c016595c118b4e12 Jul 21 18:23:36.355813 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:36.355730 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5t8n8" event={"ID":"134b26f8-0815-49bc-94ed-c418fbd78c95","Type":"ContainerStarted","Data":"6ea890d29ab864d1495e63240103035e42dcdcb072b8d6e430e491a18baaf0cb"} Jul 21 18:23:36.357146 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:36.357121 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c585cdfd-fqwws" event={"ID":"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2","Type":"ContainerStarted","Data":"fdc2d7ed0b092cd479d5b1544e37299f504adbccad3a399eb7d6718b4ff2b3b2"} Jul 21 18:23:36.358481 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:36.358457 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4jc74" event={"ID":"2665ac35-c08f-4e0b-821a-8c6745208ffd","Type":"ContainerStarted","Data":"b02fb88411b47d252ed9f6eae8035d38e3d6080db82bfe47830716de136fd499"} Jul 21 18:23:36.359438 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:36.359418 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm" event={"ID":"a68d1c4b-e317-43ad-858f-5785999f6912","Type":"ContainerStarted","Data":"2e21146b277fa3838ace9b65c8dbb921af4d282356b4d885c016595c118b4e12"} Jul 21 18:23:36.371070 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:36.371031 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5t8n8" podStartSLOduration=1.45666953 podStartE2EDuration="8.371018234s" totalImagesPullingTime="6.914348704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:23:36.370475153 +0000 UTC m=+62.994202380" watchObservedRunningTime="2026-07-21 18:23:36.371018234 +0000 UTC m=+62.994745457" Jul 21 18:23:36.391537 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:36.391498 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74c585cdfd-fqwws" podStartSLOduration=0.919497188 podStartE2EDuration="7.391485456s" totalImagesPullingTime="6.471988268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:23:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:23:36.391010915 +0000 UTC m=+63.014738145" watchObservedRunningTime="2026-07-21 18:23:36.391485456 +0000 UTC m=+63.015212682" Jul 21 18:23:39.402585 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:39.402550 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:39.403056 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:39.402634 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:23:39.404024 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:39.403999 2567 patch_prober.go:28] interesting pod/console-74c585cdfd-fqwws container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.9:8443/health\": dial tcp 10.133.0.9:8443: connect: connection refused" start-of-body= Jul 21 18:23:39.404128 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:39.404041 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-74c585cdfd-fqwws" podUID="813af2b5-49cc-4d2f-b37d-fff34d8cd5a2" containerName="console" probeResult="failure" output="Get \"https://10.133.0.9:8443/health\": dial tcp 10.133.0.9:8443: connect: connection refused" Jul 21 18:23:39.596674 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:39.596650 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret\") pod \"global-pull-secret-syncer-hcwt5\" (UID: \"afb4b042-5e50-4298-af62-23c520feeb7c\") " pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:23:39.596761 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:39.596738 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs\") pod \"network-metrics-daemon-r2m2h\" (UID: \"32340abc-8237-453b-96e1-2ab5d9aa5d67\") " pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:23:39.599369 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:39.599349 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 18:23:39.599480 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:39.599372 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 18:23:39.609013 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:39.608955 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/afb4b042-5e50-4298-af62-23c520feeb7c-original-pull-secret\") pod \"global-pull-secret-syncer-hcwt5\" (UID: \"afb4b042-5e50-4298-af62-23c520feeb7c\") " pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:23:39.609126 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:39.609044 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32340abc-8237-453b-96e1-2ab5d9aa5d67-metrics-certs\") pod \"network-metrics-daemon-r2m2h\" (UID: \"32340abc-8237-453b-96e1-2ab5d9aa5d67\") " pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:23:39.798138 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:39.798105 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tcg2\" (UniqueName: \"kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2\") pod \"network-check-target-cc6j9\" (UID: \"277cbd93-cf42-46f9-91d7-83d45fae8ae1\") " pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:23:39.801088 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:39.801068 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 18:23:39.811187 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:39.811171 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 18:23:39.813293 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:39.813278 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hcwt5" Jul 21 18:23:39.821510 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:39.821491 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tcg2\" (UniqueName: \"kubernetes.io/projected/277cbd93-cf42-46f9-91d7-83d45fae8ae1-kube-api-access-9tcg2\") pod \"network-check-target-cc6j9\" (UID: \"277cbd93-cf42-46f9-91d7-83d45fae8ae1\") " pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:23:39.826025 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:39.826006 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wsd6r\"" Jul 21 18:23:39.834016 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:39.833994 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r2m2h" Jul 21 18:23:39.941766 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:39.941739 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hcwt5"] Jul 21 18:23:39.944911 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:23:39.944886 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafb4b042_5e50_4298_af62_23c520feeb7c.slice/crio-0987c887c53bb148c7f0afa47bafef28a1e15cbafd2ce776ed5393a4f3dafe7c WatchSource:0}: Error finding container 0987c887c53bb148c7f0afa47bafef28a1e15cbafd2ce776ed5393a4f3dafe7c: Status 404 returned error can't find the container with id 0987c887c53bb148c7f0afa47bafef28a1e15cbafd2ce776ed5393a4f3dafe7c Jul 21 18:23:39.963353 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:39.963310 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r2m2h"] Jul 21 18:23:39.966821 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:23:39.966790 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32340abc_8237_453b_96e1_2ab5d9aa5d67.slice/crio-8b0d4b460bda3bf78b85426fc51a4e72f5063ef88b8e261555b1c11892933432 WatchSource:0}: Error finding container 8b0d4b460bda3bf78b85426fc51a4e72f5063ef88b8e261555b1c11892933432: Status 404 returned error can't find the container with id 8b0d4b460bda3bf78b85426fc51a4e72f5063ef88b8e261555b1c11892933432 Jul 21 18:23:40.122090 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:40.122016 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qslh2\"" Jul 21 18:23:40.130299 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:40.130278 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:23:40.265439 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:40.265411 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cc6j9"] Jul 21 18:23:40.269033 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:23:40.268999 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod277cbd93_cf42_46f9_91d7_83d45fae8ae1.slice/crio-d5564e40d4aa8ecdc75d928b300e6de5d96ce54781f7780f26702ac946cd8edd WatchSource:0}: Error finding container d5564e40d4aa8ecdc75d928b300e6de5d96ce54781f7780f26702ac946cd8edd: Status 404 returned error can't find the container with id d5564e40d4aa8ecdc75d928b300e6de5d96ce54781f7780f26702ac946cd8edd Jul 21 18:23:40.377131 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:40.377057 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4jc74" event={"ID":"2665ac35-c08f-4e0b-821a-8c6745208ffd","Type":"ContainerStarted","Data":"7cbf5239954935e39888580f9306f335e19bea12806f39824f2f7acf32f72d5e"} Jul 21 18:23:40.379167 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:40.379143 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm" event={"ID":"a68d1c4b-e317-43ad-858f-5785999f6912","Type":"ContainerStarted","Data":"5d56d7a7596f3fe6ebb4a7fe5f6bd93dec7fdab982a8643d8c4ca63eb9510c5e"} Jul 21 18:23:40.379283 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:40.379188 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm" event={"ID":"a68d1c4b-e317-43ad-858f-5785999f6912","Type":"ContainerStarted","Data":"641909d5ab89c6a94534929c88d774d5cbb8ff0161cbccd2a1fee9e78a5cf87e"} Jul 21 18:23:40.380662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:40.380638 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cc6j9" event={"ID":"277cbd93-cf42-46f9-91d7-83d45fae8ae1","Type":"ContainerStarted","Data":"d5564e40d4aa8ecdc75d928b300e6de5d96ce54781f7780f26702ac946cd8edd"} Jul 21 18:23:40.382009 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:40.381981 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r2m2h" event={"ID":"32340abc-8237-453b-96e1-2ab5d9aa5d67","Type":"ContainerStarted","Data":"8b0d4b460bda3bf78b85426fc51a4e72f5063ef88b8e261555b1c11892933432"} Jul 21 18:23:40.383282 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:40.383256 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hcwt5" event={"ID":"afb4b042-5e50-4298-af62-23c520feeb7c","Type":"ContainerStarted","Data":"0987c887c53bb148c7f0afa47bafef28a1e15cbafd2ce776ed5393a4f3dafe7c"} Jul 21 18:23:40.395798 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:40.395755 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fkwcm" podStartSLOduration=6.063447096 podStartE2EDuration="9.395740099s" totalImagesPullingTime="3.332293003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:23:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:23:40.395453514 +0000 UTC m=+67.019180745" watchObservedRunningTime="2026-07-21 18:23:40.395740099 +0000 UTC m=+67.019467326" Jul 21 18:23:41.390186 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:41.390157 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r2m2h" event={"ID":"32340abc-8237-453b-96e1-2ab5d9aa5d67","Type":"ContainerStarted","Data":"a26483de62f762d3c90c4eaaf7e964da31fa33f4da5a9458a110c22f7bfda6a1"} Jul 21 18:23:42.348863 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.348230 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-q9p7m" Jul 21 18:23:42.398349 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.398191 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r2m2h" event={"ID":"32340abc-8237-453b-96e1-2ab5d9aa5d67","Type":"ContainerStarted","Data":"512a37f62b923b9a0d866d298efaeb91b19b8594d18e85795514d4924da120ae"} Jul 21 18:23:42.423762 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.423145 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r2m2h" podStartSLOduration=67.213858678 podStartE2EDuration="1m8.423124288s" totalImagesPullingTime="1.20926561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:23:42.422259005 +0000 UTC m=+69.045986233" watchObservedRunningTime="2026-07-21 18:23:42.423124288 +0000 UTC m=+69.046851517" Jul 21 18:23:42.725627 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.725537 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5l5t7"] Jul 21 18:23:42.736882 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.736475 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.739530 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.739367 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 21 18:23:42.739672 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.739632 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bs952\"" Jul 21 18:23:42.739744 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.739669 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 21 18:23:42.740047 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.740029 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 21 18:23:42.823803 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.823750 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92f3b164-d490-40d1-b4a1-7ab9c8df860d-metrics-client-ca\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.823803 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.823795 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92f3b164-d490-40d1-b4a1-7ab9c8df860d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.824031 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.823830 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92f3b164-d490-40d1-b4a1-7ab9c8df860d-node-exporter-accelerators-collector-config\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.824031 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.823878 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvmxd\" (UniqueName: \"kubernetes.io/projected/92f3b164-d490-40d1-b4a1-7ab9c8df860d-kube-api-access-lvmxd\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.824031 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.823943 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92f3b164-d490-40d1-b4a1-7ab9c8df860d-sys\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.824031 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.823992 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92f3b164-d490-40d1-b4a1-7ab9c8df860d-root\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.824031 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.824024 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92f3b164-d490-40d1-b4a1-7ab9c8df860d-node-exporter-tls\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.824283 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.824093 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92f3b164-d490-40d1-b4a1-7ab9c8df860d-node-exporter-textfile\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.824283 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.824133 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92f3b164-d490-40d1-b4a1-7ab9c8df860d-node-exporter-wtmp\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.925189 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.925157 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92f3b164-d490-40d1-b4a1-7ab9c8df860d-sys\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.925360 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.925202 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92f3b164-d490-40d1-b4a1-7ab9c8df860d-root\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.925360 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.925227 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92f3b164-d490-40d1-b4a1-7ab9c8df860d-node-exporter-tls\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.925360 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.925285 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92f3b164-d490-40d1-b4a1-7ab9c8df860d-node-exporter-textfile\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.925360 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.925311 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92f3b164-d490-40d1-b4a1-7ab9c8df860d-node-exporter-wtmp\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.925360 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.925326 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92f3b164-d490-40d1-b4a1-7ab9c8df860d-sys\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.925360 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.925326 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92f3b164-d490-40d1-b4a1-7ab9c8df860d-root\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.925684 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.925392 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92f3b164-d490-40d1-b4a1-7ab9c8df860d-metrics-client-ca\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.925684 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.925427 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92f3b164-d490-40d1-b4a1-7ab9c8df860d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.925684 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.925463 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92f3b164-d490-40d1-b4a1-7ab9c8df860d-node-exporter-accelerators-collector-config\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.925684 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.925471 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92f3b164-d490-40d1-b4a1-7ab9c8df860d-node-exporter-wtmp\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.925684 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.925487 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvmxd\" (UniqueName: \"kubernetes.io/projected/92f3b164-d490-40d1-b4a1-7ab9c8df860d-kube-api-access-lvmxd\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.925684 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.925658 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92f3b164-d490-40d1-b4a1-7ab9c8df860d-node-exporter-textfile\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.926230 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.926169 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92f3b164-d490-40d1-b4a1-7ab9c8df860d-node-exporter-accelerators-collector-config\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.926691 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.926666 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92f3b164-d490-40d1-b4a1-7ab9c8df860d-metrics-client-ca\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.928321 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.928302 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92f3b164-d490-40d1-b4a1-7ab9c8df860d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.928599 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.928584 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92f3b164-d490-40d1-b4a1-7ab9c8df860d-node-exporter-tls\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:42.939898 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:42.939874 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvmxd\" (UniqueName: \"kubernetes.io/projected/92f3b164-d490-40d1-b4a1-7ab9c8df860d-kube-api-access-lvmxd\") pod \"node-exporter-5l5t7\" (UID: \"92f3b164-d490-40d1-b4a1-7ab9c8df860d\") " pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:43.048981 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.048945 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5l5t7" Jul 21 18:23:43.782004 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.781929 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 18:23:43.812494 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.812468 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 18:23:43.812660 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.812630 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.816134 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.816111 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 21 18:23:43.816637 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.816443 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 21 18:23:43.816637 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.816443 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mq7c9\"" Jul 21 18:23:43.816637 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.816544 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 21 18:23:43.816637 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.816559 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 21 18:23:43.816637 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.816582 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 21 18:23:43.816968 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.816787 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 21 18:23:43.816968 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.816826 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 21 18:23:43.816968 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.816858 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 21 18:23:43.816968 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.816884 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 21 18:23:43.832949 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.832930 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-config-out\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.833075 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.832964 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vlzd\" (UniqueName: \"kubernetes.io/projected/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-kube-api-access-4vlzd\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.833075 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.832997 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.833075 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.833053 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-config-volume\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.833202 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.833090 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.833202 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.833130 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.833202 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.833161 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-web-config\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.833202 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.833186 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.833365 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.833236 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.833365 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.833266 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.833365 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.833291 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.833464 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.833386 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.833464 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.833423 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.934239 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.934203 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-config-volume\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.934418 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.934250 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.934418 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.934276 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.934418 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.934305 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-web-config\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.934575 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:43.934469 2567 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 21 18:23:43.934575 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:43.934531 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-main-tls podName:e34c7708-ca55-4f7a-9c1c-0989e784cd3a nodeName:}" failed. No retries permitted until 2026-07-21 18:23:44.434509784 +0000 UTC m=+71.058237009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e34c7708-ca55-4f7a-9c1c-0989e784cd3a") : secret "alertmanager-main-tls" not found Jul 21 18:23:43.934575 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.934557 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.934737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.934602 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.934737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.934658 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.934737 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.934699 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.934737 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:43.934718 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-alertmanager-trusted-ca-bundle podName:e34c7708-ca55-4f7a-9c1c-0989e784cd3a nodeName:}" failed. No retries permitted until 2026-07-21 18:23:44.43469919 +0000 UTC m=+71.058426411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "e34c7708-ca55-4f7a-9c1c-0989e784cd3a") : configmap references non-existent config key: ca-bundle.crt Jul 21 18:23:43.934917 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.934774 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.934917 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.934803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.934917 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.934847 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-config-out\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.934917 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.934874 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vlzd\" (UniqueName: \"kubernetes.io/projected/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-kube-api-access-4vlzd\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.934917 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.934905 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.936672 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.936148 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.936672 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.936235 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.938276 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.938257 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-web-config\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.938369 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.938272 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.939391 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.939369 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-config-volume\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.939554 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.939458 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.939681 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.939541 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.940303 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.940179 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.940895 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.940870 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-config-out\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.941365 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.941345 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:43.946267 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:43.946245 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vlzd\" (UniqueName: \"kubernetes.io/projected/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-kube-api-access-4vlzd\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:44.437931 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:44.437892 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:44.438130 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:44.437949 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:44.438933 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:44.438910 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:44.440701 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:44.440678 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:44.723785 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:44.723711 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:23:45.803956 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.803921 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7f4c47448b-tpl6v"] Jul 21 18:23:45.807838 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.807812 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.811439 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.811415 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 21 18:23:45.811567 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.811418 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 21 18:23:45.811865 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.811774 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 21 18:23:45.811865 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.811808 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 21 18:23:45.812289 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.812273 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 21 18:23:45.812371 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.812319 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5atap88ojssop\"" Jul 21 18:23:45.812560 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.812540 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-t2f65\"" Jul 21 18:23:45.823268 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.823249 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f4c47448b-tpl6v"] Jul 21 18:23:45.849071 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.848850 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ee787b3e-9103-4bfb-969e-3a457499ff82-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.849071 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.848905 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee787b3e-9103-4bfb-969e-3a457499ff82-metrics-client-ca\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.849071 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.848945 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ee787b3e-9103-4bfb-969e-3a457499ff82-secret-grpc-tls\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.849071 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.849034 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttr57\" (UniqueName: \"kubernetes.io/projected/ee787b3e-9103-4bfb-969e-3a457499ff82-kube-api-access-ttr57\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.849355 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.849076 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ee787b3e-9103-4bfb-969e-3a457499ff82-secret-thanos-querier-tls\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.849355 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.849111 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee787b3e-9103-4bfb-969e-3a457499ff82-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.849532 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.849509 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ee787b3e-9103-4bfb-969e-3a457499ff82-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.849635 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.849550 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee787b3e-9103-4bfb-969e-3a457499ff82-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.950487 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.950443 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ee787b3e-9103-4bfb-969e-3a457499ff82-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.950487 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.950488 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee787b3e-9103-4bfb-969e-3a457499ff82-metrics-client-ca\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.950765 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.950514 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ee787b3e-9103-4bfb-969e-3a457499ff82-secret-grpc-tls\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.950765 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.950546 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttr57\" (UniqueName: \"kubernetes.io/projected/ee787b3e-9103-4bfb-969e-3a457499ff82-kube-api-access-ttr57\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.950765 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.950578 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ee787b3e-9103-4bfb-969e-3a457499ff82-secret-thanos-querier-tls\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.950765 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.950625 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee787b3e-9103-4bfb-969e-3a457499ff82-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.950765 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.950668 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ee787b3e-9103-4bfb-969e-3a457499ff82-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.950765 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.950698 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee787b3e-9103-4bfb-969e-3a457499ff82-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.951322 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.951291 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee787b3e-9103-4bfb-969e-3a457499ff82-metrics-client-ca\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.953791 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.953767 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ee787b3e-9103-4bfb-969e-3a457499ff82-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.953917 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.953823 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee787b3e-9103-4bfb-969e-3a457499ff82-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.953917 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.953825 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ee787b3e-9103-4bfb-969e-3a457499ff82-secret-grpc-tls\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.954467 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.954442 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee787b3e-9103-4bfb-969e-3a457499ff82-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.954702 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.954642 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ee787b3e-9103-4bfb-969e-3a457499ff82-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.954810 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.954799 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ee787b3e-9103-4bfb-969e-3a457499ff82-secret-thanos-querier-tls\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:45.959350 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:45.959330 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttr57\" (UniqueName: \"kubernetes.io/projected/ee787b3e-9103-4bfb-969e-3a457499ff82-kube-api-access-ttr57\") pod \"thanos-querier-7f4c47448b-tpl6v\" (UID: \"ee787b3e-9103-4bfb-969e-3a457499ff82\") " pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:46.119166 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:46.119091 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:46.156546 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:23:46.156482 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92f3b164_d490_40d1_b4a1_7ab9c8df860d.slice/crio-4ca6de2dc40accc9c922543a606bac0957761b3481d7fc359fcaec9ad61cf04c WatchSource:0}: Error finding container 4ca6de2dc40accc9c922543a606bac0957761b3481d7fc359fcaec9ad61cf04c: Status 404 returned error can't find the container with id 4ca6de2dc40accc9c922543a606bac0957761b3481d7fc359fcaec9ad61cf04c Jul 21 18:23:46.313049 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:46.313011 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 18:23:46.318082 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:23:46.318051 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode34c7708_ca55_4f7a_9c1c_0989e784cd3a.slice/crio-eed99fc1109bf87b781b6430e6c42f9810c891b428fce5eb69ca8149e887d202 WatchSource:0}: Error finding container eed99fc1109bf87b781b6430e6c42f9810c891b428fce5eb69ca8149e887d202: Status 404 returned error can't find the container with id eed99fc1109bf87b781b6430e6c42f9810c891b428fce5eb69ca8149e887d202 Jul 21 18:23:46.335154 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:46.335126 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f4c47448b-tpl6v"] Jul 21 18:23:46.336449 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:23:46.336424 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee787b3e_9103_4bfb_969e_3a457499ff82.slice/crio-519fef700cfa00067cb601051a58a48ae8967f22c717186ce1f525d50f371c55 WatchSource:0}: Error finding container 519fef700cfa00067cb601051a58a48ae8967f22c717186ce1f525d50f371c55: Status 404 returned error can't find the container with id 519fef700cfa00067cb601051a58a48ae8967f22c717186ce1f525d50f371c55 Jul 21 18:23:46.415223 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:46.415134 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4jc74" event={"ID":"2665ac35-c08f-4e0b-821a-8c6745208ffd","Type":"ContainerStarted","Data":"24a3c91072ad25978808ab2323e77d1c8cf94cca9260f85f5fc7968b0fac76f9"} Jul 21 18:23:46.416720 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:46.416694 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cc6j9" event={"ID":"277cbd93-cf42-46f9-91d7-83d45fae8ae1","Type":"ContainerStarted","Data":"58f02c4a7f13fcf09fc9a95bd9338bf2f13107e27bf47d02ec4facf5beceae40"} Jul 21 18:23:46.416841 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:46.416826 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:23:46.417920 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:46.417899 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5l5t7" event={"ID":"92f3b164-d490-40d1-b4a1-7ab9c8df860d","Type":"ContainerStarted","Data":"4ca6de2dc40accc9c922543a606bac0957761b3481d7fc359fcaec9ad61cf04c"} Jul 21 18:23:46.419462 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:46.419440 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hcwt5" event={"ID":"afb4b042-5e50-4298-af62-23c520feeb7c","Type":"ContainerStarted","Data":"771b1233efdbe68775316c210a7118f4c3d73e51bb6bbf6ad81c3d398bfe7bbf"} Jul 21 18:23:46.420556 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:46.420534 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" event={"ID":"ee787b3e-9103-4bfb-969e-3a457499ff82","Type":"ContainerStarted","Data":"519fef700cfa00067cb601051a58a48ae8967f22c717186ce1f525d50f371c55"} Jul 21 18:23:46.421601 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:46.421580 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34c7708-ca55-4f7a-9c1c-0989e784cd3a","Type":"ContainerStarted","Data":"eed99fc1109bf87b781b6430e6c42f9810c891b428fce5eb69ca8149e887d202"} Jul 21 18:23:46.440853 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:46.440811 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4jc74" podStartSLOduration=1.527943222 podStartE2EDuration="18.44079923s" totalImagesPullingTime="16.912856008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:23:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:23:46.44029361 +0000 UTC m=+73.064020838" watchObservedRunningTime="2026-07-21 18:23:46.44079923 +0000 UTC m=+73.064526476" Jul 21 18:23:46.460165 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:46.460125 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cc6j9" podStartSLOduration=66.57597425 podStartE2EDuration="1m12.460113596s" totalImagesPullingTime="5.884139346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:23:46.459059539 +0000 UTC m=+73.082786774" watchObservedRunningTime="2026-07-21 18:23:46.460113596 +0000 UTC m=+73.083840822" Jul 21 18:23:46.483011 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:46.482971 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hcwt5" podStartSLOduration=66.27058229 podStartE2EDuration="1m12.482959933s" totalImagesPullingTime="6.212377643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:23:46.482295147 +0000 UTC m=+73.106022375" watchObservedRunningTime="2026-07-21 18:23:46.482959933 +0000 UTC m=+73.106687158" Jul 21 18:23:46.553716 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:46.553687 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74c585cdfd-fqwws"] Jul 21 18:23:47.009772 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.009718 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5746d7c95f-zm829"] Jul 21 18:23:47.012428 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.012386 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.020639 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.018556 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-47r6p\"" Jul 21 18:23:47.020639 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.018827 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 21 18:23:47.020639 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.019038 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-eeinkmdiq7rt1\"" Jul 21 18:23:47.020639 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.019229 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 21 18:23:47.020639 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.019409 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 21 18:23:47.020639 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.019639 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 21 18:23:47.027712 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.027680 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5746d7c95f-zm829"] Jul 21 18:23:47.057288 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.057259 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b3f89c19-022a-4d65-9b27-141073b90745-audit-log\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.057439 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.057348 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b3f89c19-022a-4d65-9b27-141073b90745-metrics-server-audit-profiles\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.057439 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.057401 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b3f89c19-022a-4d65-9b27-141073b90745-secret-metrics-server-tls\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.057439 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.057431 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2msc\" (UniqueName: \"kubernetes.io/projected/b3f89c19-022a-4d65-9b27-141073b90745-kube-api-access-z2msc\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.057595 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.057494 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b3f89c19-022a-4d65-9b27-141073b90745-secret-metrics-server-client-certs\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.057595 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.057519 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3f89c19-022a-4d65-9b27-141073b90745-client-ca-bundle\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.057595 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.057545 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3f89c19-022a-4d65-9b27-141073b90745-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.158385 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.158353 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b3f89c19-022a-4d65-9b27-141073b90745-audit-log\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.158512 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.158415 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b3f89c19-022a-4d65-9b27-141073b90745-metrics-server-audit-profiles\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.158512 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.158453 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b3f89c19-022a-4d65-9b27-141073b90745-secret-metrics-server-tls\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.158512 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.158485 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2msc\" (UniqueName: \"kubernetes.io/projected/b3f89c19-022a-4d65-9b27-141073b90745-kube-api-access-z2msc\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.158690 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.158542 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b3f89c19-022a-4d65-9b27-141073b90745-secret-metrics-server-client-certs\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.158690 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.158587 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3f89c19-022a-4d65-9b27-141073b90745-client-ca-bundle\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.158690 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.158647 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3f89c19-022a-4d65-9b27-141073b90745-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.158859 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.158739 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b3f89c19-022a-4d65-9b27-141073b90745-audit-log\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.159704 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.159681 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b3f89c19-022a-4d65-9b27-141073b90745-metrics-server-audit-profiles\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.160040 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.160014 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3f89c19-022a-4d65-9b27-141073b90745-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.161729 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.161697 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b3f89c19-022a-4d65-9b27-141073b90745-secret-metrics-server-client-certs\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.162310 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.162264 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3f89c19-022a-4d65-9b27-141073b90745-client-ca-bundle\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.162514 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.162495 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b3f89c19-022a-4d65-9b27-141073b90745-secret-metrics-server-tls\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.168050 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.168030 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2msc\" (UniqueName: \"kubernetes.io/projected/b3f89c19-022a-4d65-9b27-141073b90745-kube-api-access-z2msc\") pod \"metrics-server-5746d7c95f-zm829\" (UID: \"b3f89c19-022a-4d65-9b27-141073b90745\") " pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.331913 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.331844 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:23:47.429034 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.428997 2567 generic.go:356] "Generic (PLEG): container finished" podID="92f3b164-d490-40d1-b4a1-7ab9c8df860d" containerID="ab71a4ae0694df2ad1ad981566cf0f695cbc013d51648339828ad0f71f08e7f4" exitCode=0 Jul 21 18:23:47.429200 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.429040 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5l5t7" event={"ID":"92f3b164-d490-40d1-b4a1-7ab9c8df860d","Type":"ContainerDied","Data":"ab71a4ae0694df2ad1ad981566cf0f695cbc013d51648339828ad0f71f08e7f4"} Jul 21 18:23:47.510339 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.510301 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vb6pl"] Jul 21 18:23:47.513368 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.513284 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vb6pl" Jul 21 18:23:47.516246 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.516220 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jmpwj\"" Jul 21 18:23:47.516373 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.516232 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 21 18:23:47.521484 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.521425 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vb6pl"] Jul 21 18:23:47.563340 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.563299 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d0a3e577-e6b4-4a27-98a2-c3171ffda9d9-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-vb6pl\" (UID: \"d0a3e577-e6b4-4a27-98a2-c3171ffda9d9\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vb6pl" Jul 21 18:23:47.563520 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.563390 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfthh\" (UniqueName: \"kubernetes.io/projected/d0a3e577-e6b4-4a27-98a2-c3171ffda9d9-kube-api-access-nfthh\") pod \"monitoring-plugin-7b7b7bc8bf-vb6pl\" (UID: \"d0a3e577-e6b4-4a27-98a2-c3171ffda9d9\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vb6pl" Jul 21 18:23:47.663926 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.663761 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d0a3e577-e6b4-4a27-98a2-c3171ffda9d9-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-vb6pl\" (UID: \"d0a3e577-e6b4-4a27-98a2-c3171ffda9d9\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vb6pl" Jul 21 18:23:47.663926 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.663803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfthh\" (UniqueName: \"kubernetes.io/projected/d0a3e577-e6b4-4a27-98a2-c3171ffda9d9-kube-api-access-nfthh\") pod \"monitoring-plugin-7b7b7bc8bf-vb6pl\" (UID: \"d0a3e577-e6b4-4a27-98a2-c3171ffda9d9\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vb6pl" Jul 21 18:23:47.664278 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:47.664056 2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 21 18:23:47.664278 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:23:47.664120 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a3e577-e6b4-4a27-98a2-c3171ffda9d9-monitoring-plugin-cert podName:d0a3e577-e6b4-4a27-98a2-c3171ffda9d9 nodeName:}" failed. No retries permitted until 2026-07-21 18:23:48.164101303 +0000 UTC m=+74.787828507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/d0a3e577-e6b4-4a27-98a2-c3171ffda9d9-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-vb6pl" (UID: "d0a3e577-e6b4-4a27-98a2-c3171ffda9d9") : secret "monitoring-plugin-cert" not found Jul 21 18:23:47.672791 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.672748 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfthh\" (UniqueName: \"kubernetes.io/projected/d0a3e577-e6b4-4a27-98a2-c3171ffda9d9-kube-api-access-nfthh\") pod \"monitoring-plugin-7b7b7bc8bf-vb6pl\" (UID: \"d0a3e577-e6b4-4a27-98a2-c3171ffda9d9\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vb6pl" Jul 21 18:23:47.729268 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:47.729242 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5746d7c95f-zm829"] Jul 21 18:23:47.756817 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:23:47.756781 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f89c19_022a_4d65_9b27_141073b90745.slice/crio-07d2487ef43db16839e37e9f1f657d9b3292e4449bc34b8d4bd9310215a1055e WatchSource:0}: Error finding container 07d2487ef43db16839e37e9f1f657d9b3292e4449bc34b8d4bd9310215a1055e: Status 404 returned error can't find the container with id 07d2487ef43db16839e37e9f1f657d9b3292e4449bc34b8d4bd9310215a1055e Jul 21 18:23:48.169359 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.169315 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d0a3e577-e6b4-4a27-98a2-c3171ffda9d9-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-vb6pl\" (UID: \"d0a3e577-e6b4-4a27-98a2-c3171ffda9d9\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vb6pl" Jul 21 18:23:48.172121 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.172092 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d0a3e577-e6b4-4a27-98a2-c3171ffda9d9-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-vb6pl\" (UID: \"d0a3e577-e6b4-4a27-98a2-c3171ffda9d9\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vb6pl" Jul 21 18:23:48.425948 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.425866 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vb6pl" Jul 21 18:23:48.435744 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.435717 2567 generic.go:356] "Generic (PLEG): container finished" podID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerID="d031f54e72c2ad40434652fd245c10c32748f0cb738a821231f073ee5b5b3f6a" exitCode=0 Jul 21 18:23:48.435856 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.435807 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34c7708-ca55-4f7a-9c1c-0989e784cd3a","Type":"ContainerDied","Data":"d031f54e72c2ad40434652fd245c10c32748f0cb738a821231f073ee5b5b3f6a"} Jul 21 18:23:48.438144 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.438099 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5l5t7" event={"ID":"92f3b164-d490-40d1-b4a1-7ab9c8df860d","Type":"ContainerStarted","Data":"dd6cb74e2e91dd9093a0c8590c4b0559b8f1754ea7ce4916503bc10c9e5d03ea"} Jul 21 18:23:48.438258 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.438173 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5l5t7" event={"ID":"92f3b164-d490-40d1-b4a1-7ab9c8df860d","Type":"ContainerStarted","Data":"200deca14c1b60346490cfd591302271fbf20f6333c8f664cad19c1a84b11cc8"} Jul 21 18:23:48.439194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.439175 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" event={"ID":"b3f89c19-022a-4d65-9b27-141073b90745","Type":"ContainerStarted","Data":"07d2487ef43db16839e37e9f1f657d9b3292e4449bc34b8d4bd9310215a1055e"} Jul 21 18:23:48.483104 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.483055 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5l5t7" podStartSLOduration=5.494885492 podStartE2EDuration="6.483039259s" totalImagesPullingTime="910.263882ms" totalInitContainerRuntime="77.889885ms" isStatefulPod=true podCreationTimestamp="2026-07-21 18:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:23:48.482092372 +0000 UTC m=+75.105819602" watchObservedRunningTime="2026-07-21 18:23:48.483039259 +0000 UTC m=+75.106766487" Jul 21 18:23:48.591814 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.591746 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vb6pl"] Jul 21 18:23:48.596972 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:23:48.596943 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0a3e577_e6b4_4a27_98a2_c3171ffda9d9.slice/crio-ba34e611a22d3dd01427d5fcab83df0ceb5dd238f542c3e77f5c7bf486c77c03 WatchSource:0}: Error finding container ba34e611a22d3dd01427d5fcab83df0ceb5dd238f542c3e77f5c7bf486c77c03: Status 404 returned error can't find the container with id ba34e611a22d3dd01427d5fcab83df0ceb5dd238f542c3e77f5c7bf486c77c03 Jul 21 18:23:48.825347 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.825316 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56db8f5f95-g9nn9"] Jul 21 18:23:48.827542 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.827525 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.835120 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.835095 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 21 18:23:48.839807 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.839782 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56db8f5f95-g9nn9"] Jul 21 18:23:48.875429 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.875357 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-oauth-serving-cert\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.875429 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.875394 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vdq4\" (UniqueName: \"kubernetes.io/projected/0cabf4b2-7080-4f16-be94-a036ef4c28be-kube-api-access-5vdq4\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.875945 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.875434 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-trusted-ca-bundle\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.875945 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.875499 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cabf4b2-7080-4f16-be94-a036ef4c28be-console-oauth-config\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.875945 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.875546 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cabf4b2-7080-4f16-be94-a036ef4c28be-console-serving-cert\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.875945 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.875595 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-service-ca\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.875945 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.875659 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-console-config\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.919898 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.919869 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 18:23:48.923362 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.923338 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.929109 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.926039 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 21 18:23:48.929393 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.929372 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 21 18:23:48.929547 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.929389 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 21 18:23:48.930017 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.929988 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 21 18:23:48.930508 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.929582 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2cgmleh1t79em\"" Jul 21 18:23:48.930508 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.929911 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 21 18:23:48.930508 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.930290 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4qm5z\"" Jul 21 18:23:48.930508 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.929942 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 21 18:23:48.930508 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.929444 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 21 18:23:48.932040 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.932001 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 21 18:23:48.932321 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.932262 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 21 18:23:48.932682 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.932667 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 21 18:23:48.932912 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.932896 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 21 18:23:48.934639 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.934598 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 21 18:23:48.934732 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.934712 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 21 18:23:48.936094 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.936072 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 21 18:23:48.940849 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.940828 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 18:23:48.976371 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976345 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.976518 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976380 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.976518 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976410 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-console-config\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.976518 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976429 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-oauth-serving-cert\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.976518 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976455 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vdq4\" (UniqueName: \"kubernetes.io/projected/0cabf4b2-7080-4f16-be94-a036ef4c28be-kube-api-access-5vdq4\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.976518 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976480 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.976518 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976506 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.976884 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976528 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.976884 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976560 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-trusted-ca-bundle\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.976884 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976583 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.976884 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976625 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0199315d-1730-405c-bec6-6648509b7da1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.976884 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976653 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0199315d-1730-405c-bec6-6648509b7da1-config-out\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.976884 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976688 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.976884 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976737 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cabf4b2-7080-4f16-be94-a036ef4c28be-console-oauth-config\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.976884 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976759 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.976884 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976782 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.976884 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976838 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cabf4b2-7080-4f16-be94-a036ef4c28be-console-serving-cert\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.976884 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976872 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.977443 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976907 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.977443 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976936 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.977443 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976964 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.977443 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.976992 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.977443 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.977016 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgrfl\" (UniqueName: \"kubernetes.io/projected/0199315d-1730-405c-bec6-6648509b7da1-kube-api-access-kgrfl\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.977443 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.977043 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.977443 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.977073 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-service-ca\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.977443 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.977093 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-config\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.977443 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.977120 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-web-config\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:48.977443 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.977232 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-oauth-serving-cert\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.977443 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.977262 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-console-config\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.978080 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.977897 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-service-ca\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.979975 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.978211 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-trusted-ca-bundle\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.980852 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.980833 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cabf4b2-7080-4f16-be94-a036ef4c28be-console-oauth-config\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.981789 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.981768 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cabf4b2-7080-4f16-be94-a036ef4c28be-console-serving-cert\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:48.985994 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:48.985958 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vdq4\" (UniqueName: \"kubernetes.io/projected/0cabf4b2-7080-4f16-be94-a036ef4c28be-kube-api-access-5vdq4\") pod \"console-56db8f5f95-g9nn9\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:49.077986 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.077957 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.078177 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.078017 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.078177 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.078045 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.078177 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.078088 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.078177 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.078117 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.078177 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.078141 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.078177 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.078167 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.078485 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.078195 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.078485 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.078215 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgrfl\" (UniqueName: \"kubernetes.io/projected/0199315d-1730-405c-bec6-6648509b7da1-kube-api-access-kgrfl\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.078485 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.078248 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.078485 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.078277 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-config\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.078485 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.078302 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-web-config\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.078485 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.078332 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.078485 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.078365 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.078485 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.078405 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.078485 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.078430 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.078485 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.078451 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.079010 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.078491 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.079010 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.078534 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0199315d-1730-405c-bec6-6648509b7da1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.079010 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.078566 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0199315d-1730-405c-bec6-6648509b7da1-config-out\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.083372 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.079448 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.083372 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.080114 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.083372 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.080396 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.083372 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.080724 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.083372 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.081286 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.083372 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.081587 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.083372 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.081799 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-web-config\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.083372 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.082096 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.083372 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.082112 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.083372 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.082212 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.083372 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.082889 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.083372 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.082990 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0199315d-1730-405c-bec6-6648509b7da1-config-out\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.084531 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.084508 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.084885 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.084808 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.084885 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.084827 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.085521 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.085201 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-config\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.085753 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.085714 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.086354 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.086329 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0199315d-1730-405c-bec6-6648509b7da1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.086511 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.086433 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.090704 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.090685 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgrfl\" (UniqueName: \"kubernetes.io/projected/0199315d-1730-405c-bec6-6648509b7da1-kube-api-access-kgrfl\") pod \"prometheus-k8s-0\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.138163 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.138139 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:49.243153 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.242783 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:49.311375 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.311290 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56db8f5f95-g9nn9"] Jul 21 18:23:49.320325 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:23:49.320285 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cabf4b2_7080_4f16_be94_a036ef4c28be.slice/crio-7fd4bfd448e4fb7a5e64e05f05de2e87045f98b324faec1933c16d1073a05dfc WatchSource:0}: Error finding container 7fd4bfd448e4fb7a5e64e05f05de2e87045f98b324faec1933c16d1073a05dfc: Status 404 returned error can't find the container with id 7fd4bfd448e4fb7a5e64e05f05de2e87045f98b324faec1933c16d1073a05dfc Jul 21 18:23:49.447490 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.447445 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56db8f5f95-g9nn9" event={"ID":"0cabf4b2-7080-4f16-be94-a036ef4c28be","Type":"ContainerStarted","Data":"897989635a0484b75a4c5dcfb3cbe383aa40358d4eb1c7d0957a6b155ba1cd60"} Jul 21 18:23:49.447674 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.447535 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56db8f5f95-g9nn9" event={"ID":"0cabf4b2-7080-4f16-be94-a036ef4c28be","Type":"ContainerStarted","Data":"7fd4bfd448e4fb7a5e64e05f05de2e87045f98b324faec1933c16d1073a05dfc"} Jul 21 18:23:49.450208 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.450181 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 18:23:49.450338 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.450276 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vb6pl" event={"ID":"d0a3e577-e6b4-4a27-98a2-c3171ffda9d9","Type":"ContainerStarted","Data":"ba34e611a22d3dd01427d5fcab83df0ceb5dd238f542c3e77f5c7bf486c77c03"} Jul 21 18:23:49.455082 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.455022 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" event={"ID":"ee787b3e-9103-4bfb-969e-3a457499ff82","Type":"ContainerStarted","Data":"a58014e94b78acaa0610b850dbb41b596023e23d38f9baf096825adcaacf781d"} Jul 21 18:23:49.455269 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.455249 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" event={"ID":"ee787b3e-9103-4bfb-969e-3a457499ff82","Type":"ContainerStarted","Data":"3fb59ecf37f1d1e1f2c48893328e2f5fb53eac4f1883c8fc964596080b9cd312"} Jul 21 18:23:49.455890 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.455663 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" event={"ID":"ee787b3e-9103-4bfb-969e-3a457499ff82","Type":"ContainerStarted","Data":"4fb022af69849d174164436112c86291f4bf6079c0def081f95a20592402dcea"} Jul 21 18:23:49.470264 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:49.469490 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56db8f5f95-g9nn9" podStartSLOduration=1.469468201 podStartE2EDuration="1.469468201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:23:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:23:49.46813199 +0000 UTC m=+76.091859217" watchObservedRunningTime="2026-07-21 18:23:49.469468201 +0000 UTC m=+76.093195411" Jul 21 18:23:49.896239 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:23:49.896207 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0199315d_1730_405c_bec6_6648509b7da1.slice/crio-0b48fa1a97ebc118949cc257152221b9e1d24e1609e2e0a09e74f3d615918909 WatchSource:0}: Error finding container 0b48fa1a97ebc118949cc257152221b9e1d24e1609e2e0a09e74f3d615918909: Status 404 returned error can't find the container with id 0b48fa1a97ebc118949cc257152221b9e1d24e1609e2e0a09e74f3d615918909 Jul 21 18:23:50.464459 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:50.464421 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0199315d-1730-405c-bec6-6648509b7da1","Type":"ContainerStarted","Data":"0b48fa1a97ebc118949cc257152221b9e1d24e1609e2e0a09e74f3d615918909"} Jul 21 18:23:51.470522 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:51.470486 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" event={"ID":"b3f89c19-022a-4d65-9b27-141073b90745","Type":"ContainerStarted","Data":"9a51ee5b3311c4969129c2a77aefbdc2e2b98af1b0be5db70c5124c01c1ee94f"} Jul 21 18:23:51.473186 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:51.473163 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" event={"ID":"ee787b3e-9103-4bfb-969e-3a457499ff82","Type":"ContainerStarted","Data":"f604384e1b6a65e114db22dbbc136a802bd7f466bc737474802b3eb166246a22"} Jul 21 18:23:51.473309 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:51.473215 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" event={"ID":"ee787b3e-9103-4bfb-969e-3a457499ff82","Type":"ContainerStarted","Data":"6ea280237e420742523ad76314518edfedc3d11a2ac0270204de7d1c2a2892a5"} Jul 21 18:23:51.473309 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:51.473240 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" event={"ID":"ee787b3e-9103-4bfb-969e-3a457499ff82","Type":"ContainerStarted","Data":"9854eac61c6c52072673e0eb658a1833bb0477a6a12c75e35b6dd8fa84b042de"} Jul 21 18:23:51.473309 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:51.473274 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:51.476454 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:51.476430 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34c7708-ca55-4f7a-9c1c-0989e784cd3a","Type":"ContainerStarted","Data":"478630bcf9c8ed80cc0c2e6577008073ffe98e1320523c088e10eec69c4e3700"} Jul 21 18:23:51.476571 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:51.476503 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34c7708-ca55-4f7a-9c1c-0989e784cd3a","Type":"ContainerStarted","Data":"b67440b1eda10bb5995c7ad9f2fb52080db0e2cbf9a632244c68cc894dd3aa87"} Jul 21 18:23:51.476571 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:51.476544 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34c7708-ca55-4f7a-9c1c-0989e784cd3a","Type":"ContainerStarted","Data":"a554b441cee6aa7509531a7d0d5f23d910d6ffac3622726dd293012c0f32fa9e"} Jul 21 18:23:51.476710 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:51.476584 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34c7708-ca55-4f7a-9c1c-0989e784cd3a","Type":"ContainerStarted","Data":"d32e05b6dc7c4591015654eecfbaf03cc27afd92a85e40def49be9ee3af9420c"} Jul 21 18:23:51.476710 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:51.476655 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34c7708-ca55-4f7a-9c1c-0989e784cd3a","Type":"ContainerStarted","Data":"9d2383eece3dcae7b821b277097f226f2d56cee9c4b4b9258f81f30c33950ab4"} Jul 21 18:23:51.476710 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:51.476698 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34c7708-ca55-4f7a-9c1c-0989e784cd3a","Type":"ContainerStarted","Data":"f25c4ba043f71f7c1ddfd9a52cbc70c852928bd3d767ce4a94d35b03af2c35d8"} Jul 21 18:23:51.477839 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:51.477819 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vb6pl" event={"ID":"d0a3e577-e6b4-4a27-98a2-c3171ffda9d9","Type":"ContainerStarted","Data":"61840ad5bbbac16d0ee3f19a406a4df857f5de7622c93151cbc207e0dca0caef"} Jul 21 18:23:51.477968 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:51.477952 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vb6pl" Jul 21 18:23:51.479394 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:51.479374 2567 generic.go:356] "Generic (PLEG): container finished" podID="0199315d-1730-405c-bec6-6648509b7da1" containerID="db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d" exitCode=0 Jul 21 18:23:51.479504 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:51.479434 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0199315d-1730-405c-bec6-6648509b7da1","Type":"ContainerDied","Data":"db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d"} Jul 21 18:23:51.483109 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:51.483060 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vb6pl" Jul 21 18:23:51.499731 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:51.498086 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" podStartSLOduration=2.546223614 podStartE2EDuration="5.498067652s" totalImagesPullingTime="2.951844038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:23:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:23:51.495601973 +0000 UTC m=+78.119329204" watchObservedRunningTime="2026-07-21 18:23:51.498067652 +0000 UTC m=+78.121794885" Jul 21 18:23:51.515566 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:51.515520 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-vb6pl" podStartSLOduration=2.399978537 podStartE2EDuration="4.515506648s" totalImagesPullingTime="2.115528111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:23:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:23:51.513995948 +0000 UTC m=+78.137723175" watchObservedRunningTime="2026-07-21 18:23:51.515506648 +0000 UTC m=+78.139233876" Jul 21 18:23:51.536976 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:51.536920 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" podStartSLOduration=2.366071276 podStartE2EDuration="6.536902919s" totalImagesPullingTime="4.170831643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:23:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:23:51.535116819 +0000 UTC m=+78.158844074" watchObservedRunningTime="2026-07-21 18:23:51.536902919 +0000 UTC m=+78.160630147" Jul 21 18:23:51.596237 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:51.596185 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.005544068 podStartE2EDuration="8.596169768s" totalImagesPullingTime="3.568554953s" totalInitContainerRuntime="22.070747ms" isStatefulPod=false podCreationTimestamp="2026-07-21 18:23:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:23:51.59498418 +0000 UTC m=+78.218711407" watchObservedRunningTime="2026-07-21 18:23:51.596169768 +0000 UTC m=+78.219896995" Jul 21 18:23:55.501548 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:55.501514 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0199315d-1730-405c-bec6-6648509b7da1","Type":"ContainerStarted","Data":"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f"} Jul 21 18:23:55.501922 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:55.501579 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0199315d-1730-405c-bec6-6648509b7da1","Type":"ContainerStarted","Data":"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a"} Jul 21 18:23:55.501922 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:55.501628 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0199315d-1730-405c-bec6-6648509b7da1","Type":"ContainerStarted","Data":"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d"} Jul 21 18:23:55.501922 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:55.501657 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0199315d-1730-405c-bec6-6648509b7da1","Type":"ContainerStarted","Data":"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91"} Jul 21 18:23:55.501922 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:55.501680 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0199315d-1730-405c-bec6-6648509b7da1","Type":"ContainerStarted","Data":"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350"} Jul 21 18:23:55.501922 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:55.501704 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0199315d-1730-405c-bec6-6648509b7da1","Type":"ContainerStarted","Data":"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7"} Jul 21 18:23:55.534392 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:55.534342 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.434017024 podStartE2EDuration="7.534325579s" totalImagesPullingTime="3.072959723s" totalInitContainerRuntime="27.348832ms" isStatefulPod=false podCreationTimestamp="2026-07-21 18:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:23:55.532165039 +0000 UTC m=+82.155892304" watchObservedRunningTime="2026-07-21 18:23:55.534325579 +0000 UTC m=+82.158052806" Jul 21 18:23:57.490925 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:57.490897 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7f4c47448b-tpl6v" Jul 21 18:23:59.138528 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:59.138498 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:59.139004 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:59.138554 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:59.144002 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:59.143981 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:23:59.243858 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:59.243833 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:23:59.523954 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:23:59.523921 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:24:07.332744 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:07.332707 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:24:07.333201 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:07.332781 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:24:11.573388 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:11.573324 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74c585cdfd-fqwws" podUID="813af2b5-49cc-4d2f-b37d-fff34d8cd5a2" containerName="console" containerID="cri-o://fdc2d7ed0b092cd479d5b1544e37299f504adbccad3a399eb7d6718b4ff2b3b2" gracePeriod=15 Jul 21 18:24:12.374451 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.374423 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:24:12.490050 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.490024 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-console-serving-cert\") pod \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " Jul 21 18:24:12.490214 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.490093 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-service-ca\") pod \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " Jul 21 18:24:12.490214 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.490119 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-console-oauth-config\") pod \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " Jul 21 18:24:12.490214 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.490158 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgb85\" (UniqueName: \"kubernetes.io/projected/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-kube-api-access-tgb85\") pod \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " Jul 21 18:24:12.490214 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.490191 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-console-config\") pod \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " Jul 21 18:24:12.490437 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.490220 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-oauth-serving-cert\") pod \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\" (UID: \"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2\") " Jul 21 18:24:12.490536 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.490503 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-service-ca" (OuterVolumeSpecName: "service-ca") pod "813af2b5-49cc-4d2f-b37d-fff34d8cd5a2" (UID: "813af2b5-49cc-4d2f-b37d-fff34d8cd5a2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:24:12.490666 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.490601 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-console-config" (OuterVolumeSpecName: "console-config") pod "813af2b5-49cc-4d2f-b37d-fff34d8cd5a2" (UID: "813af2b5-49cc-4d2f-b37d-fff34d8cd5a2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:24:12.490735 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.490660 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "813af2b5-49cc-4d2f-b37d-fff34d8cd5a2" (UID: "813af2b5-49cc-4d2f-b37d-fff34d8cd5a2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:24:12.492488 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.492467 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "813af2b5-49cc-4d2f-b37d-fff34d8cd5a2" (UID: "813af2b5-49cc-4d2f-b37d-fff34d8cd5a2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:24:12.492582 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.492505 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-kube-api-access-tgb85" (OuterVolumeSpecName: "kube-api-access-tgb85") pod "813af2b5-49cc-4d2f-b37d-fff34d8cd5a2" (UID: "813af2b5-49cc-4d2f-b37d-fff34d8cd5a2"). InnerVolumeSpecName "kube-api-access-tgb85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:24:12.492582 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.492535 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "813af2b5-49cc-4d2f-b37d-fff34d8cd5a2" (UID: "813af2b5-49cc-4d2f-b37d-fff34d8cd5a2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:24:12.568800 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.568770 2567 generic.go:356] "Generic (PLEG): container finished" podID="813af2b5-49cc-4d2f-b37d-fff34d8cd5a2" containerID="fdc2d7ed0b092cd479d5b1544e37299f504adbccad3a399eb7d6718b4ff2b3b2" exitCode=0 Jul 21 18:24:12.568930 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.568812 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c585cdfd-fqwws" event={"ID":"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2","Type":"ContainerDied","Data":"fdc2d7ed0b092cd479d5b1544e37299f504adbccad3a399eb7d6718b4ff2b3b2"} Jul 21 18:24:12.568930 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.568820 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c585cdfd-fqwws" Jul 21 18:24:12.568930 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.568852 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c585cdfd-fqwws" event={"ID":"813af2b5-49cc-4d2f-b37d-fff34d8cd5a2","Type":"ContainerDied","Data":"4e46be5a6bff1c07f7b9d52cdb3879ad9e3456b804de1da6dd39dfa1bade21c2"} Jul 21 18:24:12.568930 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.568871 2567 scope.go:117] "RemoveContainer" containerID="fdc2d7ed0b092cd479d5b1544e37299f504adbccad3a399eb7d6718b4ff2b3b2" Jul 21 18:24:12.577794 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.577694 2567 scope.go:117] "RemoveContainer" containerID="fdc2d7ed0b092cd479d5b1544e37299f504adbccad3a399eb7d6718b4ff2b3b2" Jul 21 18:24:12.578008 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:24:12.577933 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdc2d7ed0b092cd479d5b1544e37299f504adbccad3a399eb7d6718b4ff2b3b2\": container with ID starting with fdc2d7ed0b092cd479d5b1544e37299f504adbccad3a399eb7d6718b4ff2b3b2 not found: ID does not exist" containerID="fdc2d7ed0b092cd479d5b1544e37299f504adbccad3a399eb7d6718b4ff2b3b2" Jul 21 18:24:12.578008 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.577967 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdc2d7ed0b092cd479d5b1544e37299f504adbccad3a399eb7d6718b4ff2b3b2"} err="failed to get container status \"fdc2d7ed0b092cd479d5b1544e37299f504adbccad3a399eb7d6718b4ff2b3b2\": rpc error: code = NotFound desc = could not find container \"fdc2d7ed0b092cd479d5b1544e37299f504adbccad3a399eb7d6718b4ff2b3b2\": container with ID starting with fdc2d7ed0b092cd479d5b1544e37299f504adbccad3a399eb7d6718b4ff2b3b2 not found: ID does not exist" Jul 21 18:24:12.589559 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.589536 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74c585cdfd-fqwws"] Jul 21 18:24:12.591548 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.591432 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-console-serving-cert\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:24:12.591548 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.591457 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-service-ca\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:24:12.591548 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.591535 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-console-oauth-config\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:24:12.591548 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.591550 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgb85\" (UniqueName: \"kubernetes.io/projected/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-kube-api-access-tgb85\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:24:12.591849 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.591565 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-console-config\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:24:12.591849 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.591577 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2-oauth-serving-cert\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:24:12.593048 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:12.593029 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74c585cdfd-fqwws"] Jul 21 18:24:14.009095 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:14.009062 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="813af2b5-49cc-4d2f-b37d-fff34d8cd5a2" path="/var/lib/kubelet/pods/813af2b5-49cc-4d2f-b37d-fff34d8cd5a2/volumes" Jul 21 18:24:14.679240 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:14.679206 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56db8f5f95-g9nn9"] Jul 21 18:24:17.431983 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:17.431949 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cc6j9" Jul 21 18:24:27.337377 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:27.337350 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:24:27.341095 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:27.341076 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5746d7c95f-zm829" Jul 21 18:24:30.753375 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:30.753348 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5t8n8_134b26f8-0815-49bc-94ed-c418fbd78c95/serve-healthcheck-canary/0.log" Jul 21 18:24:39.699486 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:39.699423 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56db8f5f95-g9nn9" podUID="0cabf4b2-7080-4f16-be94-a036ef4c28be" containerName="console" containerID="cri-o://897989635a0484b75a4c5dcfb3cbe383aa40358d4eb1c7d0957a6b155ba1cd60" gracePeriod=15 Jul 21 18:24:39.943493 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:39.943472 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:24:40.019325 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.019306 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-service-ca\") pod \"0cabf4b2-7080-4f16-be94-a036ef4c28be\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " Jul 21 18:24:40.019458 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.019342 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cabf4b2-7080-4f16-be94-a036ef4c28be-console-serving-cert\") pod \"0cabf4b2-7080-4f16-be94-a036ef4c28be\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " Jul 21 18:24:40.019458 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.019366 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-oauth-serving-cert\") pod \"0cabf4b2-7080-4f16-be94-a036ef4c28be\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " Jul 21 18:24:40.019458 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.019409 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vdq4\" (UniqueName: \"kubernetes.io/projected/0cabf4b2-7080-4f16-be94-a036ef4c28be-kube-api-access-5vdq4\") pod \"0cabf4b2-7080-4f16-be94-a036ef4c28be\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " Jul 21 18:24:40.019458 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.019424 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-trusted-ca-bundle\") pod \"0cabf4b2-7080-4f16-be94-a036ef4c28be\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " Jul 21 18:24:40.019458 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.019453 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-console-config\") pod \"0cabf4b2-7080-4f16-be94-a036ef4c28be\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " Jul 21 18:24:40.019713 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.019489 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cabf4b2-7080-4f16-be94-a036ef4c28be-console-oauth-config\") pod \"0cabf4b2-7080-4f16-be94-a036ef4c28be\" (UID: \"0cabf4b2-7080-4f16-be94-a036ef4c28be\") " Jul 21 18:24:40.019866 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.019831 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-service-ca" (OuterVolumeSpecName: "service-ca") pod "0cabf4b2-7080-4f16-be94-a036ef4c28be" (UID: "0cabf4b2-7080-4f16-be94-a036ef4c28be"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:24:40.019866 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.019856 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0cabf4b2-7080-4f16-be94-a036ef4c28be" (UID: "0cabf4b2-7080-4f16-be94-a036ef4c28be"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:24:40.020030 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.019975 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0cabf4b2-7080-4f16-be94-a036ef4c28be" (UID: "0cabf4b2-7080-4f16-be94-a036ef4c28be"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:24:40.020118 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.020072 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-console-config" (OuterVolumeSpecName: "console-config") pod "0cabf4b2-7080-4f16-be94-a036ef4c28be" (UID: "0cabf4b2-7080-4f16-be94-a036ef4c28be"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:24:40.021673 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.021651 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cabf4b2-7080-4f16-be94-a036ef4c28be-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0cabf4b2-7080-4f16-be94-a036ef4c28be" (UID: "0cabf4b2-7080-4f16-be94-a036ef4c28be"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:24:40.021760 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.021673 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cabf4b2-7080-4f16-be94-a036ef4c28be-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0cabf4b2-7080-4f16-be94-a036ef4c28be" (UID: "0cabf4b2-7080-4f16-be94-a036ef4c28be"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:24:40.021807 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.021762 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cabf4b2-7080-4f16-be94-a036ef4c28be-kube-api-access-5vdq4" (OuterVolumeSpecName: "kube-api-access-5vdq4") pod "0cabf4b2-7080-4f16-be94-a036ef4c28be" (UID: "0cabf4b2-7080-4f16-be94-a036ef4c28be"). InnerVolumeSpecName "kube-api-access-5vdq4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:24:40.120346 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.120323 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-console-config\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:24:40.120346 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.120342 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0cabf4b2-7080-4f16-be94-a036ef4c28be-console-oauth-config\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:24:40.120488 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.120351 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-service-ca\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:24:40.120488 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.120362 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0cabf4b2-7080-4f16-be94-a036ef4c28be-console-serving-cert\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:24:40.120488 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.120370 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-oauth-serving-cert\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:24:40.120488 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.120379 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vdq4\" (UniqueName: \"kubernetes.io/projected/0cabf4b2-7080-4f16-be94-a036ef4c28be-kube-api-access-5vdq4\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:24:40.120488 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.120387 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cabf4b2-7080-4f16-be94-a036ef4c28be-trusted-ca-bundle\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:24:40.674484 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.674447 2567 generic.go:356] "Generic (PLEG): container finished" podID="0cabf4b2-7080-4f16-be94-a036ef4c28be" containerID="897989635a0484b75a4c5dcfb3cbe383aa40358d4eb1c7d0957a6b155ba1cd60" exitCode=0 Jul 21 18:24:40.674484 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.674488 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56db8f5f95-g9nn9" Jul 21 18:24:40.674705 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.674536 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56db8f5f95-g9nn9" event={"ID":"0cabf4b2-7080-4f16-be94-a036ef4c28be","Type":"ContainerDied","Data":"897989635a0484b75a4c5dcfb3cbe383aa40358d4eb1c7d0957a6b155ba1cd60"} Jul 21 18:24:40.674705 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.674584 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56db8f5f95-g9nn9" event={"ID":"0cabf4b2-7080-4f16-be94-a036ef4c28be","Type":"ContainerDied","Data":"7fd4bfd448e4fb7a5e64e05f05de2e87045f98b324faec1933c16d1073a05dfc"} Jul 21 18:24:40.674705 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.674619 2567 scope.go:117] "RemoveContainer" containerID="897989635a0484b75a4c5dcfb3cbe383aa40358d4eb1c7d0957a6b155ba1cd60" Jul 21 18:24:40.686424 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.686388 2567 scope.go:117] "RemoveContainer" containerID="897989635a0484b75a4c5dcfb3cbe383aa40358d4eb1c7d0957a6b155ba1cd60" Jul 21 18:24:40.686870 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:24:40.686840 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"897989635a0484b75a4c5dcfb3cbe383aa40358d4eb1c7d0957a6b155ba1cd60\": container with ID starting with 897989635a0484b75a4c5dcfb3cbe383aa40358d4eb1c7d0957a6b155ba1cd60 not found: ID does not exist" containerID="897989635a0484b75a4c5dcfb3cbe383aa40358d4eb1c7d0957a6b155ba1cd60" Jul 21 18:24:40.686983 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.686880 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"897989635a0484b75a4c5dcfb3cbe383aa40358d4eb1c7d0957a6b155ba1cd60"} err="failed to get container status \"897989635a0484b75a4c5dcfb3cbe383aa40358d4eb1c7d0957a6b155ba1cd60\": rpc error: code = NotFound desc = could not find container \"897989635a0484b75a4c5dcfb3cbe383aa40358d4eb1c7d0957a6b155ba1cd60\": container with ID starting with 897989635a0484b75a4c5dcfb3cbe383aa40358d4eb1c7d0957a6b155ba1cd60 not found: ID does not exist" Jul 21 18:24:40.699921 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.699895 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56db8f5f95-g9nn9"] Jul 21 18:24:40.705253 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:40.705232 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56db8f5f95-g9nn9"] Jul 21 18:24:42.009578 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:42.009541 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cabf4b2-7080-4f16-be94-a036ef4c28be" path="/var/lib/kubelet/pods/0cabf4b2-7080-4f16-be94-a036ef4c28be/volumes" Jul 21 18:24:49.243498 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:49.243463 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:24:49.263059 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:49.263037 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:24:49.726372 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:24:49.726302 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:03.054478 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:03.054445 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 18:25:03.054901 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:03.054746 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="alertmanager" containerID="cri-o://f25c4ba043f71f7c1ddfd9a52cbc70c852928bd3d767ce4a94d35b03af2c35d8" gracePeriod=120 Jul 21 18:25:03.054901 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:03.054842 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="kube-rbac-proxy-web" containerID="cri-o://d32e05b6dc7c4591015654eecfbaf03cc27afd92a85e40def49be9ee3af9420c" gracePeriod=120 Jul 21 18:25:03.054901 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:03.054843 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="kube-rbac-proxy-metric" containerID="cri-o://b67440b1eda10bb5995c7ad9f2fb52080db0e2cbf9a632244c68cc894dd3aa87" gracePeriod=120 Jul 21 18:25:03.054901 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:03.054878 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="kube-rbac-proxy" containerID="cri-o://a554b441cee6aa7509531a7d0d5f23d910d6ffac3622726dd293012c0f32fa9e" gracePeriod=120 Jul 21 18:25:03.055103 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:03.054855 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="config-reloader" containerID="cri-o://9d2383eece3dcae7b821b277097f226f2d56cee9c4b4b9258f81f30c33950ab4" gracePeriod=120 Jul 21 18:25:03.055103 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:03.054917 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="prom-label-proxy" containerID="cri-o://478630bcf9c8ed80cc0c2e6577008073ffe98e1320523c088e10eec69c4e3700" gracePeriod=120 Jul 21 18:25:03.764579 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:03.764546 2567 generic.go:356] "Generic (PLEG): container finished" podID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerID="478630bcf9c8ed80cc0c2e6577008073ffe98e1320523c088e10eec69c4e3700" exitCode=0 Jul 21 18:25:03.764579 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:03.764574 2567 generic.go:356] "Generic (PLEG): container finished" podID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerID="a554b441cee6aa7509531a7d0d5f23d910d6ffac3622726dd293012c0f32fa9e" exitCode=0 Jul 21 18:25:03.764579 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:03.764584 2567 generic.go:356] "Generic (PLEG): container finished" podID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerID="9d2383eece3dcae7b821b277097f226f2d56cee9c4b4b9258f81f30c33950ab4" exitCode=0 Jul 21 18:25:03.764828 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:03.764592 2567 generic.go:356] "Generic (PLEG): container finished" podID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerID="f25c4ba043f71f7c1ddfd9a52cbc70c852928bd3d767ce4a94d35b03af2c35d8" exitCode=0 Jul 21 18:25:03.764828 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:03.764630 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34c7708-ca55-4f7a-9c1c-0989e784cd3a","Type":"ContainerDied","Data":"478630bcf9c8ed80cc0c2e6577008073ffe98e1320523c088e10eec69c4e3700"} Jul 21 18:25:03.764828 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:03.764717 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34c7708-ca55-4f7a-9c1c-0989e784cd3a","Type":"ContainerDied","Data":"a554b441cee6aa7509531a7d0d5f23d910d6ffac3622726dd293012c0f32fa9e"} Jul 21 18:25:03.764828 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:03.764744 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34c7708-ca55-4f7a-9c1c-0989e784cd3a","Type":"ContainerDied","Data":"9d2383eece3dcae7b821b277097f226f2d56cee9c4b4b9258f81f30c33950ab4"} Jul 21 18:25:03.764828 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:03.764768 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34c7708-ca55-4f7a-9c1c-0989e784cd3a","Type":"ContainerDied","Data":"f25c4ba043f71f7c1ddfd9a52cbc70c852928bd3d767ce4a94d35b03af2c35d8"} Jul 21 18:25:04.301191 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.301170 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:25:04.431782 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.431689 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-metrics-client-ca\") pod \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " Jul 21 18:25:04.431782 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.431738 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-kube-rbac-proxy-web\") pod \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " Jul 21 18:25:04.431782 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.431771 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-kube-rbac-proxy\") pod \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " Jul 21 18:25:04.432064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.431798 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-main-tls\") pod \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " Jul 21 18:25:04.432064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.431834 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-cluster-tls-config\") pod \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " Jul 21 18:25:04.432064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.431868 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-alertmanager-main-db\") pod \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " Jul 21 18:25:04.432064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.431952 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-config-out\") pod \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " Jul 21 18:25:04.432064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.432004 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vlzd\" (UniqueName: \"kubernetes.io/projected/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-kube-api-access-4vlzd\") pod \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " Jul 21 18:25:04.432064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.432033 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-alertmanager-trusted-ca-bundle\") pod \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " Jul 21 18:25:04.432064 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.432064 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-config-volume\") pod \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " Jul 21 18:25:04.432394 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.432118 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-web-config\") pod \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " Jul 21 18:25:04.432394 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.432151 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " Jul 21 18:25:04.432394 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.432176 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-tls-assets\") pod \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\" (UID: \"e34c7708-ca55-4f7a-9c1c-0989e784cd3a\") " Jul 21 18:25:04.434323 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.432116 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e34c7708-ca55-4f7a-9c1c-0989e784cd3a" (UID: "e34c7708-ca55-4f7a-9c1c-0989e784cd3a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 18:25:04.434323 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.432143 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e34c7708-ca55-4f7a-9c1c-0989e784cd3a" (UID: "e34c7708-ca55-4f7a-9c1c-0989e784cd3a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:25:04.434468 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.434369 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e34c7708-ca55-4f7a-9c1c-0989e784cd3a" (UID: "e34c7708-ca55-4f7a-9c1c-0989e784cd3a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:25:04.435196 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.435112 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e34c7708-ca55-4f7a-9c1c-0989e784cd3a" (UID: "e34c7708-ca55-4f7a-9c1c-0989e784cd3a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:25:04.435324 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.435299 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-config-out" (OuterVolumeSpecName: "config-out") pod "e34c7708-ca55-4f7a-9c1c-0989e784cd3a" (UID: "e34c7708-ca55-4f7a-9c1c-0989e784cd3a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 18:25:04.435749 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.435658 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-kube-api-access-4vlzd" (OuterVolumeSpecName: "kube-api-access-4vlzd") pod "e34c7708-ca55-4f7a-9c1c-0989e784cd3a" (UID: "e34c7708-ca55-4f7a-9c1c-0989e784cd3a"). InnerVolumeSpecName "kube-api-access-4vlzd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:25:04.435749 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.435669 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e34c7708-ca55-4f7a-9c1c-0989e784cd3a" (UID: "e34c7708-ca55-4f7a-9c1c-0989e784cd3a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:25:04.435896 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.435747 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e34c7708-ca55-4f7a-9c1c-0989e784cd3a" (UID: "e34c7708-ca55-4f7a-9c1c-0989e784cd3a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:25:04.435896 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.435807 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e34c7708-ca55-4f7a-9c1c-0989e784cd3a" (UID: "e34c7708-ca55-4f7a-9c1c-0989e784cd3a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:25:04.436322 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.436296 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e34c7708-ca55-4f7a-9c1c-0989e784cd3a" (UID: "e34c7708-ca55-4f7a-9c1c-0989e784cd3a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:25:04.436434 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.436411 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-config-volume" (OuterVolumeSpecName: "config-volume") pod "e34c7708-ca55-4f7a-9c1c-0989e784cd3a" (UID: "e34c7708-ca55-4f7a-9c1c-0989e784cd3a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:25:04.439247 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.439151 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e34c7708-ca55-4f7a-9c1c-0989e784cd3a" (UID: "e34c7708-ca55-4f7a-9c1c-0989e784cd3a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:25:04.444881 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.444859 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-web-config" (OuterVolumeSpecName: "web-config") pod "e34c7708-ca55-4f7a-9c1c-0989e784cd3a" (UID: "e34c7708-ca55-4f7a-9c1c-0989e784cd3a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:25:04.533406 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.533360 2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-cluster-tls-config\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:04.533406 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.533402 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-alertmanager-main-db\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:04.533406 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.533413 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-config-out\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:04.533406 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.533422 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vlzd\" (UniqueName: \"kubernetes.io/projected/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-kube-api-access-4vlzd\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:04.533654 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.533432 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:04.533654 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.533442 2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-config-volume\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:04.533654 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.533451 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-web-config\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:04.533654 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.533459 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:04.533654 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.533468 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-tls-assets\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:04.533654 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.533475 2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-metrics-client-ca\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:04.533654 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.533483 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:04.533654 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.533493 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:04.533654 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.533501 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e34c7708-ca55-4f7a-9c1c-0989e784cd3a-secret-alertmanager-main-tls\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:04.771002 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.770972 2567 generic.go:356] "Generic (PLEG): container finished" podID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerID="b67440b1eda10bb5995c7ad9f2fb52080db0e2cbf9a632244c68cc894dd3aa87" exitCode=0 Jul 21 18:25:04.771002 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.770994 2567 generic.go:356] "Generic (PLEG): container finished" podID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerID="d32e05b6dc7c4591015654eecfbaf03cc27afd92a85e40def49be9ee3af9420c" exitCode=0 Jul 21 18:25:04.771193 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.771050 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 18:25:04.771193 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.771050 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34c7708-ca55-4f7a-9c1c-0989e784cd3a","Type":"ContainerDied","Data":"b67440b1eda10bb5995c7ad9f2fb52080db0e2cbf9a632244c68cc894dd3aa87"} Jul 21 18:25:04.771193 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.771120 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34c7708-ca55-4f7a-9c1c-0989e784cd3a","Type":"ContainerDied","Data":"d32e05b6dc7c4591015654eecfbaf03cc27afd92a85e40def49be9ee3af9420c"} Jul 21 18:25:04.771193 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.771149 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34c7708-ca55-4f7a-9c1c-0989e784cd3a","Type":"ContainerDied","Data":"eed99fc1109bf87b781b6430e6c42f9810c891b428fce5eb69ca8149e887d202"} Jul 21 18:25:04.771193 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.771184 2567 scope.go:117] "RemoveContainer" containerID="478630bcf9c8ed80cc0c2e6577008073ffe98e1320523c088e10eec69c4e3700" Jul 21 18:25:04.779019 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.779002 2567 scope.go:117] "RemoveContainer" containerID="b67440b1eda10bb5995c7ad9f2fb52080db0e2cbf9a632244c68cc894dd3aa87" Jul 21 18:25:04.786667 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.786654 2567 scope.go:117] "RemoveContainer" containerID="a554b441cee6aa7509531a7d0d5f23d910d6ffac3622726dd293012c0f32fa9e" Jul 21 18:25:04.792949 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.792932 2567 scope.go:117] "RemoveContainer" containerID="d32e05b6dc7c4591015654eecfbaf03cc27afd92a85e40def49be9ee3af9420c" Jul 21 18:25:04.795847 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.795825 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 18:25:04.800061 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.800045 2567 scope.go:117] "RemoveContainer" containerID="9d2383eece3dcae7b821b277097f226f2d56cee9c4b4b9258f81f30c33950ab4" Jul 21 18:25:04.804005 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.803987 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 18:25:04.807437 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.807421 2567 scope.go:117] "RemoveContainer" containerID="f25c4ba043f71f7c1ddfd9a52cbc70c852928bd3d767ce4a94d35b03af2c35d8" Jul 21 18:25:04.814093 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.814076 2567 scope.go:117] "RemoveContainer" containerID="d031f54e72c2ad40434652fd245c10c32748f0cb738a821231f073ee5b5b3f6a" Jul 21 18:25:04.820687 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.820671 2567 scope.go:117] "RemoveContainer" containerID="478630bcf9c8ed80cc0c2e6577008073ffe98e1320523c088e10eec69c4e3700" Jul 21 18:25:04.820945 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:25:04.820927 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"478630bcf9c8ed80cc0c2e6577008073ffe98e1320523c088e10eec69c4e3700\": container with ID starting with 478630bcf9c8ed80cc0c2e6577008073ffe98e1320523c088e10eec69c4e3700 not found: ID does not exist" containerID="478630bcf9c8ed80cc0c2e6577008073ffe98e1320523c088e10eec69c4e3700" Jul 21 18:25:04.821001 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.820954 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"478630bcf9c8ed80cc0c2e6577008073ffe98e1320523c088e10eec69c4e3700"} err="failed to get container status \"478630bcf9c8ed80cc0c2e6577008073ffe98e1320523c088e10eec69c4e3700\": rpc error: code = NotFound desc = could not find container \"478630bcf9c8ed80cc0c2e6577008073ffe98e1320523c088e10eec69c4e3700\": container with ID starting with 478630bcf9c8ed80cc0c2e6577008073ffe98e1320523c088e10eec69c4e3700 not found: ID does not exist" Jul 21 18:25:04.821001 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.820974 2567 scope.go:117] "RemoveContainer" containerID="b67440b1eda10bb5995c7ad9f2fb52080db0e2cbf9a632244c68cc894dd3aa87" Jul 21 18:25:04.821232 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:25:04.821214 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b67440b1eda10bb5995c7ad9f2fb52080db0e2cbf9a632244c68cc894dd3aa87\": container with ID starting with b67440b1eda10bb5995c7ad9f2fb52080db0e2cbf9a632244c68cc894dd3aa87 not found: ID does not exist" containerID="b67440b1eda10bb5995c7ad9f2fb52080db0e2cbf9a632244c68cc894dd3aa87" Jul 21 18:25:04.821288 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.821237 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b67440b1eda10bb5995c7ad9f2fb52080db0e2cbf9a632244c68cc894dd3aa87"} err="failed to get container status \"b67440b1eda10bb5995c7ad9f2fb52080db0e2cbf9a632244c68cc894dd3aa87\": rpc error: code = NotFound desc = could not find container \"b67440b1eda10bb5995c7ad9f2fb52080db0e2cbf9a632244c68cc894dd3aa87\": container with ID starting with b67440b1eda10bb5995c7ad9f2fb52080db0e2cbf9a632244c68cc894dd3aa87 not found: ID does not exist" Jul 21 18:25:04.821288 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.821255 2567 scope.go:117] "RemoveContainer" containerID="a554b441cee6aa7509531a7d0d5f23d910d6ffac3622726dd293012c0f32fa9e" Jul 21 18:25:04.821486 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:25:04.821470 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a554b441cee6aa7509531a7d0d5f23d910d6ffac3622726dd293012c0f32fa9e\": container with ID starting with a554b441cee6aa7509531a7d0d5f23d910d6ffac3622726dd293012c0f32fa9e not found: ID does not exist" containerID="a554b441cee6aa7509531a7d0d5f23d910d6ffac3622726dd293012c0f32fa9e" Jul 21 18:25:04.821528 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.821491 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a554b441cee6aa7509531a7d0d5f23d910d6ffac3622726dd293012c0f32fa9e"} err="failed to get container status \"a554b441cee6aa7509531a7d0d5f23d910d6ffac3622726dd293012c0f32fa9e\": rpc error: code = NotFound desc = could not find container \"a554b441cee6aa7509531a7d0d5f23d910d6ffac3622726dd293012c0f32fa9e\": container with ID starting with a554b441cee6aa7509531a7d0d5f23d910d6ffac3622726dd293012c0f32fa9e not found: ID does not exist" Jul 21 18:25:04.821528 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.821507 2567 scope.go:117] "RemoveContainer" containerID="d32e05b6dc7c4591015654eecfbaf03cc27afd92a85e40def49be9ee3af9420c" Jul 21 18:25:04.821728 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:25:04.821694 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d32e05b6dc7c4591015654eecfbaf03cc27afd92a85e40def49be9ee3af9420c\": container with ID starting with d32e05b6dc7c4591015654eecfbaf03cc27afd92a85e40def49be9ee3af9420c not found: ID does not exist" containerID="d32e05b6dc7c4591015654eecfbaf03cc27afd92a85e40def49be9ee3af9420c" Jul 21 18:25:04.821728 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.821715 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d32e05b6dc7c4591015654eecfbaf03cc27afd92a85e40def49be9ee3af9420c"} err="failed to get container status \"d32e05b6dc7c4591015654eecfbaf03cc27afd92a85e40def49be9ee3af9420c\": rpc error: code = NotFound desc = could not find container \"d32e05b6dc7c4591015654eecfbaf03cc27afd92a85e40def49be9ee3af9420c\": container with ID starting with d32e05b6dc7c4591015654eecfbaf03cc27afd92a85e40def49be9ee3af9420c not found: ID does not exist" Jul 21 18:25:04.821728 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.821728 2567 scope.go:117] "RemoveContainer" containerID="9d2383eece3dcae7b821b277097f226f2d56cee9c4b4b9258f81f30c33950ab4" Jul 21 18:25:04.821923 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:25:04.821908 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d2383eece3dcae7b821b277097f226f2d56cee9c4b4b9258f81f30c33950ab4\": container with ID starting with 9d2383eece3dcae7b821b277097f226f2d56cee9c4b4b9258f81f30c33950ab4 not found: ID does not exist" containerID="9d2383eece3dcae7b821b277097f226f2d56cee9c4b4b9258f81f30c33950ab4" Jul 21 18:25:04.821964 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.821926 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d2383eece3dcae7b821b277097f226f2d56cee9c4b4b9258f81f30c33950ab4"} err="failed to get container status \"9d2383eece3dcae7b821b277097f226f2d56cee9c4b4b9258f81f30c33950ab4\": rpc error: code = NotFound desc = could not find container \"9d2383eece3dcae7b821b277097f226f2d56cee9c4b4b9258f81f30c33950ab4\": container with ID starting with 9d2383eece3dcae7b821b277097f226f2d56cee9c4b4b9258f81f30c33950ab4 not found: ID does not exist" Jul 21 18:25:04.821964 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.821938 2567 scope.go:117] "RemoveContainer" containerID="f25c4ba043f71f7c1ddfd9a52cbc70c852928bd3d767ce4a94d35b03af2c35d8" Jul 21 18:25:04.822166 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:25:04.822151 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f25c4ba043f71f7c1ddfd9a52cbc70c852928bd3d767ce4a94d35b03af2c35d8\": container with ID starting with f25c4ba043f71f7c1ddfd9a52cbc70c852928bd3d767ce4a94d35b03af2c35d8 not found: ID does not exist" containerID="f25c4ba043f71f7c1ddfd9a52cbc70c852928bd3d767ce4a94d35b03af2c35d8" Jul 21 18:25:04.822212 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.822171 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f25c4ba043f71f7c1ddfd9a52cbc70c852928bd3d767ce4a94d35b03af2c35d8"} err="failed to get container status \"f25c4ba043f71f7c1ddfd9a52cbc70c852928bd3d767ce4a94d35b03af2c35d8\": rpc error: code = NotFound desc = could not find container \"f25c4ba043f71f7c1ddfd9a52cbc70c852928bd3d767ce4a94d35b03af2c35d8\": container with ID starting with f25c4ba043f71f7c1ddfd9a52cbc70c852928bd3d767ce4a94d35b03af2c35d8 not found: ID does not exist" Jul 21 18:25:04.822212 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.822184 2567 scope.go:117] "RemoveContainer" containerID="d031f54e72c2ad40434652fd245c10c32748f0cb738a821231f073ee5b5b3f6a" Jul 21 18:25:04.822409 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:25:04.822392 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d031f54e72c2ad40434652fd245c10c32748f0cb738a821231f073ee5b5b3f6a\": container with ID starting with d031f54e72c2ad40434652fd245c10c32748f0cb738a821231f073ee5b5b3f6a not found: ID does not exist" containerID="d031f54e72c2ad40434652fd245c10c32748f0cb738a821231f073ee5b5b3f6a" Jul 21 18:25:04.822452 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.822415 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d031f54e72c2ad40434652fd245c10c32748f0cb738a821231f073ee5b5b3f6a"} err="failed to get container status \"d031f54e72c2ad40434652fd245c10c32748f0cb738a821231f073ee5b5b3f6a\": rpc error: code = NotFound desc = could not find container \"d031f54e72c2ad40434652fd245c10c32748f0cb738a821231f073ee5b5b3f6a\": container with ID starting with d031f54e72c2ad40434652fd245c10c32748f0cb738a821231f073ee5b5b3f6a not found: ID does not exist" Jul 21 18:25:04.822452 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.822431 2567 scope.go:117] "RemoveContainer" containerID="478630bcf9c8ed80cc0c2e6577008073ffe98e1320523c088e10eec69c4e3700" Jul 21 18:25:04.822664 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.822645 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"478630bcf9c8ed80cc0c2e6577008073ffe98e1320523c088e10eec69c4e3700"} err="failed to get container status \"478630bcf9c8ed80cc0c2e6577008073ffe98e1320523c088e10eec69c4e3700\": rpc error: code = NotFound desc = could not find container \"478630bcf9c8ed80cc0c2e6577008073ffe98e1320523c088e10eec69c4e3700\": container with ID starting with 478630bcf9c8ed80cc0c2e6577008073ffe98e1320523c088e10eec69c4e3700 not found: ID does not exist" Jul 21 18:25:04.822740 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.822666 2567 scope.go:117] "RemoveContainer" containerID="b67440b1eda10bb5995c7ad9f2fb52080db0e2cbf9a632244c68cc894dd3aa87" Jul 21 18:25:04.822896 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.822882 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b67440b1eda10bb5995c7ad9f2fb52080db0e2cbf9a632244c68cc894dd3aa87"} err="failed to get container status \"b67440b1eda10bb5995c7ad9f2fb52080db0e2cbf9a632244c68cc894dd3aa87\": rpc error: code = NotFound desc = could not find container \"b67440b1eda10bb5995c7ad9f2fb52080db0e2cbf9a632244c68cc894dd3aa87\": container with ID starting with b67440b1eda10bb5995c7ad9f2fb52080db0e2cbf9a632244c68cc894dd3aa87 not found: ID does not exist" Jul 21 18:25:04.822946 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.822896 2567 scope.go:117] "RemoveContainer" containerID="a554b441cee6aa7509531a7d0d5f23d910d6ffac3622726dd293012c0f32fa9e" Jul 21 18:25:04.823054 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.823040 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a554b441cee6aa7509531a7d0d5f23d910d6ffac3622726dd293012c0f32fa9e"} err="failed to get container status \"a554b441cee6aa7509531a7d0d5f23d910d6ffac3622726dd293012c0f32fa9e\": rpc error: code = NotFound desc = could not find container \"a554b441cee6aa7509531a7d0d5f23d910d6ffac3622726dd293012c0f32fa9e\": container with ID starting with a554b441cee6aa7509531a7d0d5f23d910d6ffac3622726dd293012c0f32fa9e not found: ID does not exist" Jul 21 18:25:04.823099 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.823054 2567 scope.go:117] "RemoveContainer" containerID="d32e05b6dc7c4591015654eecfbaf03cc27afd92a85e40def49be9ee3af9420c" Jul 21 18:25:04.823218 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.823201 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d32e05b6dc7c4591015654eecfbaf03cc27afd92a85e40def49be9ee3af9420c"} err="failed to get container status \"d32e05b6dc7c4591015654eecfbaf03cc27afd92a85e40def49be9ee3af9420c\": rpc error: code = NotFound desc = could not find container \"d32e05b6dc7c4591015654eecfbaf03cc27afd92a85e40def49be9ee3af9420c\": container with ID starting with d32e05b6dc7c4591015654eecfbaf03cc27afd92a85e40def49be9ee3af9420c not found: ID does not exist" Jul 21 18:25:04.823260 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.823218 2567 scope.go:117] "RemoveContainer" containerID="9d2383eece3dcae7b821b277097f226f2d56cee9c4b4b9258f81f30c33950ab4" Jul 21 18:25:04.823411 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.823396 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d2383eece3dcae7b821b277097f226f2d56cee9c4b4b9258f81f30c33950ab4"} err="failed to get container status \"9d2383eece3dcae7b821b277097f226f2d56cee9c4b4b9258f81f30c33950ab4\": rpc error: code = NotFound desc = could not find container \"9d2383eece3dcae7b821b277097f226f2d56cee9c4b4b9258f81f30c33950ab4\": container with ID starting with 9d2383eece3dcae7b821b277097f226f2d56cee9c4b4b9258f81f30c33950ab4 not found: ID does not exist" Jul 21 18:25:04.823449 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.823411 2567 scope.go:117] "RemoveContainer" containerID="f25c4ba043f71f7c1ddfd9a52cbc70c852928bd3d767ce4a94d35b03af2c35d8" Jul 21 18:25:04.823592 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.823577 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f25c4ba043f71f7c1ddfd9a52cbc70c852928bd3d767ce4a94d35b03af2c35d8"} err="failed to get container status \"f25c4ba043f71f7c1ddfd9a52cbc70c852928bd3d767ce4a94d35b03af2c35d8\": rpc error: code = NotFound desc = could not find container \"f25c4ba043f71f7c1ddfd9a52cbc70c852928bd3d767ce4a94d35b03af2c35d8\": container with ID starting with f25c4ba043f71f7c1ddfd9a52cbc70c852928bd3d767ce4a94d35b03af2c35d8 not found: ID does not exist" Jul 21 18:25:04.823651 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.823592 2567 scope.go:117] "RemoveContainer" containerID="d031f54e72c2ad40434652fd245c10c32748f0cb738a821231f073ee5b5b3f6a" Jul 21 18:25:04.823840 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:04.823822 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d031f54e72c2ad40434652fd245c10c32748f0cb738a821231f073ee5b5b3f6a"} err="failed to get container status \"d031f54e72c2ad40434652fd245c10c32748f0cb738a821231f073ee5b5b3f6a\": rpc error: code = NotFound desc = could not find container \"d031f54e72c2ad40434652fd245c10c32748f0cb738a821231f073ee5b5b3f6a\": container with ID starting with d031f54e72c2ad40434652fd245c10c32748f0cb738a821231f073ee5b5b3f6a not found: ID does not exist" Jul 21 18:25:06.008826 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:06.008798 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" path="/var/lib/kubelet/pods/e34c7708-ca55-4f7a-9c1c-0989e784cd3a/volumes" Jul 21 18:25:07.325292 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.325256 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 18:25:07.325709 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.325580 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="prometheus" containerID="cri-o://a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7" gracePeriod=600 Jul 21 18:25:07.325709 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.325639 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="config-reloader" containerID="cri-o://a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350" gracePeriod=600 Jul 21 18:25:07.325709 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.325641 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="kube-rbac-proxy" containerID="cri-o://f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a" gracePeriod=600 Jul 21 18:25:07.325709 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.325641 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="thanos-sidecar" containerID="cri-o://10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91" gracePeriod=600 Jul 21 18:25:07.325874 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.325674 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="kube-rbac-proxy-web" containerID="cri-o://52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d" gracePeriod=600 Jul 21 18:25:07.325874 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.325824 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f" gracePeriod=600 Jul 21 18:25:07.595721 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.595692 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.759807 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.759777 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-web-config\") pod \"0199315d-1730-405c-bec6-6648509b7da1\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " Jul 21 18:25:07.759972 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.759818 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"0199315d-1730-405c-bec6-6648509b7da1\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " Jul 21 18:25:07.759972 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.759852 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-configmap-serving-certs-ca-bundle\") pod \"0199315d-1730-405c-bec6-6648509b7da1\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " Jul 21 18:25:07.759972 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.759884 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-rulefiles-1\") pod \"0199315d-1730-405c-bec6-6648509b7da1\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " Jul 21 18:25:07.760129 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760071 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0199315d-1730-405c-bec6-6648509b7da1-tls-assets\") pod \"0199315d-1730-405c-bec6-6648509b7da1\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " Jul 21 18:25:07.760184 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760158 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-rulefiles-0\") pod \"0199315d-1730-405c-bec6-6648509b7da1\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " Jul 21 18:25:07.760236 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760183 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "0199315d-1730-405c-bec6-6648509b7da1" (UID: "0199315d-1730-405c-bec6-6648509b7da1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:25:07.760236 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760189 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-grpc-tls\") pod \"0199315d-1730-405c-bec6-6648509b7da1\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " Jul 21 18:25:07.760343 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760233 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "0199315d-1730-405c-bec6-6648509b7da1" (UID: "0199315d-1730-405c-bec6-6648509b7da1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:25:07.760343 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760245 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-thanos-prometheus-http-client-file\") pod \"0199315d-1730-405c-bec6-6648509b7da1\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " Jul 21 18:25:07.760343 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760292 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-rulefiles-2\") pod \"0199315d-1730-405c-bec6-6648509b7da1\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " Jul 21 18:25:07.760343 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760330 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgrfl\" (UniqueName: \"kubernetes.io/projected/0199315d-1730-405c-bec6-6648509b7da1-kube-api-access-kgrfl\") pod \"0199315d-1730-405c-bec6-6648509b7da1\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " Jul 21 18:25:07.760552 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760355 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-configmap-metrics-client-ca\") pod \"0199315d-1730-405c-bec6-6648509b7da1\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " Jul 21 18:25:07.760552 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760384 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-configmap-kubelet-serving-ca-bundle\") pod \"0199315d-1730-405c-bec6-6648509b7da1\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " Jul 21 18:25:07.760552 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760410 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0199315d-1730-405c-bec6-6648509b7da1-config-out\") pod \"0199315d-1730-405c-bec6-6648509b7da1\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " Jul 21 18:25:07.760552 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760433 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-config\") pod \"0199315d-1730-405c-bec6-6648509b7da1\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " Jul 21 18:25:07.760552 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760459 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"0199315d-1730-405c-bec6-6648509b7da1\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " Jul 21 18:25:07.760552 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760490 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-db\") pod \"0199315d-1730-405c-bec6-6648509b7da1\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " Jul 21 18:25:07.760552 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760532 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-trusted-ca-bundle\") pod \"0199315d-1730-405c-bec6-6648509b7da1\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " Jul 21 18:25:07.760895 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760555 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-metrics-client-certs\") pod \"0199315d-1730-405c-bec6-6648509b7da1\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " Jul 21 18:25:07.760895 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760585 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-kube-rbac-proxy\") pod \"0199315d-1730-405c-bec6-6648509b7da1\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " Jul 21 18:25:07.760895 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760636 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-prometheus-k8s-tls\") pod \"0199315d-1730-405c-bec6-6648509b7da1\" (UID: \"0199315d-1730-405c-bec6-6648509b7da1\") " Jul 21 18:25:07.760895 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760791 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "0199315d-1730-405c-bec6-6648509b7da1" (UID: "0199315d-1730-405c-bec6-6648509b7da1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:25:07.760895 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760884 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:07.761149 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760904 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:07.761149 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.760920 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:07.761149 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.761006 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "0199315d-1730-405c-bec6-6648509b7da1" (UID: "0199315d-1730-405c-bec6-6648509b7da1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:25:07.761365 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.761333 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "0199315d-1730-405c-bec6-6648509b7da1" (UID: "0199315d-1730-405c-bec6-6648509b7da1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:25:07.761533 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.761496 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "0199315d-1730-405c-bec6-6648509b7da1" (UID: "0199315d-1730-405c-bec6-6648509b7da1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:25:07.761938 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.761685 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "0199315d-1730-405c-bec6-6648509b7da1" (UID: "0199315d-1730-405c-bec6-6648509b7da1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:25:07.763636 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.763575 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "0199315d-1730-405c-bec6-6648509b7da1" (UID: "0199315d-1730-405c-bec6-6648509b7da1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 18:25:07.764496 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.764461 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "0199315d-1730-405c-bec6-6648509b7da1" (UID: "0199315d-1730-405c-bec6-6648509b7da1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:25:07.764689 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.764661 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-config" (OuterVolumeSpecName: "config") pod "0199315d-1730-405c-bec6-6648509b7da1" (UID: "0199315d-1730-405c-bec6-6648509b7da1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:25:07.764802 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.764765 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "0199315d-1730-405c-bec6-6648509b7da1" (UID: "0199315d-1730-405c-bec6-6648509b7da1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:25:07.764920 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.764832 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "0199315d-1730-405c-bec6-6648509b7da1" (UID: "0199315d-1730-405c-bec6-6648509b7da1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:25:07.765179 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.765138 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "0199315d-1730-405c-bec6-6648509b7da1" (UID: "0199315d-1730-405c-bec6-6648509b7da1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:25:07.765292 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.765238 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0199315d-1730-405c-bec6-6648509b7da1-config-out" (OuterVolumeSpecName: "config-out") pod "0199315d-1730-405c-bec6-6648509b7da1" (UID: "0199315d-1730-405c-bec6-6648509b7da1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 18:25:07.766684 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.766658 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0199315d-1730-405c-bec6-6648509b7da1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0199315d-1730-405c-bec6-6648509b7da1" (UID: "0199315d-1730-405c-bec6-6648509b7da1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:25:07.766767 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.766689 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "0199315d-1730-405c-bec6-6648509b7da1" (UID: "0199315d-1730-405c-bec6-6648509b7da1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:25:07.766767 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.766728 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "0199315d-1730-405c-bec6-6648509b7da1" (UID: "0199315d-1730-405c-bec6-6648509b7da1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:25:07.766844 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.766782 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "0199315d-1730-405c-bec6-6648509b7da1" (UID: "0199315d-1730-405c-bec6-6648509b7da1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:25:07.767011 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.766990 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0199315d-1730-405c-bec6-6648509b7da1-kube-api-access-kgrfl" (OuterVolumeSpecName: "kube-api-access-kgrfl") pod "0199315d-1730-405c-bec6-6648509b7da1" (UID: "0199315d-1730-405c-bec6-6648509b7da1"). InnerVolumeSpecName "kube-api-access-kgrfl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:25:07.773378 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.773360 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-web-config" (OuterVolumeSpecName: "web-config") pod "0199315d-1730-405c-bec6-6648509b7da1" (UID: "0199315d-1730-405c-bec6-6648509b7da1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:25:07.784975 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.784951 2567 generic.go:356] "Generic (PLEG): container finished" podID="0199315d-1730-405c-bec6-6648509b7da1" containerID="2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f" exitCode=0 Jul 21 18:25:07.784975 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.784974 2567 generic.go:356] "Generic (PLEG): container finished" podID="0199315d-1730-405c-bec6-6648509b7da1" containerID="f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a" exitCode=0 Jul 21 18:25:07.785075 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.784982 2567 generic.go:356] "Generic (PLEG): container finished" podID="0199315d-1730-405c-bec6-6648509b7da1" containerID="52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d" exitCode=0 Jul 21 18:25:07.785075 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.784989 2567 generic.go:356] "Generic (PLEG): container finished" podID="0199315d-1730-405c-bec6-6648509b7da1" containerID="10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91" exitCode=0 Jul 21 18:25:07.785075 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.784994 2567 generic.go:356] "Generic (PLEG): container finished" podID="0199315d-1730-405c-bec6-6648509b7da1" containerID="a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350" exitCode=0 Jul 21 18:25:07.785075 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.784999 2567 generic.go:356] "Generic (PLEG): container finished" podID="0199315d-1730-405c-bec6-6648509b7da1" containerID="a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7" exitCode=0 Jul 21 18:25:07.785075 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.785032 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.785223 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.785029 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0199315d-1730-405c-bec6-6648509b7da1","Type":"ContainerDied","Data":"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f"} Jul 21 18:25:07.785223 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.785159 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0199315d-1730-405c-bec6-6648509b7da1","Type":"ContainerDied","Data":"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a"} Jul 21 18:25:07.785223 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.785188 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0199315d-1730-405c-bec6-6648509b7da1","Type":"ContainerDied","Data":"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d"} Jul 21 18:25:07.785223 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.785218 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0199315d-1730-405c-bec6-6648509b7da1","Type":"ContainerDied","Data":"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91"} Jul 21 18:25:07.785338 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.785225 2567 scope.go:117] "RemoveContainer" containerID="2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f" Jul 21 18:25:07.785338 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.785256 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0199315d-1730-405c-bec6-6648509b7da1","Type":"ContainerDied","Data":"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350"} Jul 21 18:25:07.785338 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.785296 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0199315d-1730-405c-bec6-6648509b7da1","Type":"ContainerDied","Data":"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7"} Jul 21 18:25:07.785338 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.785333 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0199315d-1730-405c-bec6-6648509b7da1","Type":"ContainerDied","Data":"0b48fa1a97ebc118949cc257152221b9e1d24e1609e2e0a09e74f3d615918909"} Jul 21 18:25:07.792388 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.792373 2567 scope.go:117] "RemoveContainer" containerID="f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a" Jul 21 18:25:07.799177 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.799162 2567 scope.go:117] "RemoveContainer" containerID="52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d" Jul 21 18:25:07.805246 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.805230 2567 scope.go:117] "RemoveContainer" containerID="10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91" Jul 21 18:25:07.809658 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.809637 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 18:25:07.811936 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.811919 2567 scope.go:117] "RemoveContainer" containerID="a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350" Jul 21 18:25:07.814053 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.814036 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 18:25:07.818194 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.818179 2567 scope.go:117] "RemoveContainer" containerID="a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7" Jul 21 18:25:07.824867 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.824852 2567 scope.go:117] "RemoveContainer" containerID="db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d" Jul 21 18:25:07.830817 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.830800 2567 scope.go:117] "RemoveContainer" containerID="2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f" Jul 21 18:25:07.831067 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:25:07.831050 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f\": container with ID starting with 2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f not found: ID does not exist" containerID="2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f" Jul 21 18:25:07.831114 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.831077 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f"} err="failed to get container status \"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f\": rpc error: code = NotFound desc = could not find container \"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f\": container with ID starting with 2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f not found: ID does not exist" Jul 21 18:25:07.831114 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.831096 2567 scope.go:117] "RemoveContainer" containerID="f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a" Jul 21 18:25:07.831326 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:25:07.831309 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a\": container with ID starting with f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a not found: ID does not exist" containerID="f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a" Jul 21 18:25:07.831382 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.831334 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a"} err="failed to get container status \"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a\": rpc error: code = NotFound desc = could not find container \"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a\": container with ID starting with f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a not found: ID does not exist" Jul 21 18:25:07.831382 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.831357 2567 scope.go:117] "RemoveContainer" containerID="52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d" Jul 21 18:25:07.831659 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:25:07.831633 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d\": container with ID starting with 52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d not found: ID does not exist" containerID="52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d" Jul 21 18:25:07.831718 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.831655 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d"} err="failed to get container status \"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d\": rpc error: code = NotFound desc = could not find container \"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d\": container with ID starting with 52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d not found: ID does not exist" Jul 21 18:25:07.831718 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.831670 2567 scope.go:117] "RemoveContainer" containerID="10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91" Jul 21 18:25:07.831903 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:25:07.831886 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91\": container with ID starting with 10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91 not found: ID does not exist" containerID="10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91" Jul 21 18:25:07.831944 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.831908 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91"} err="failed to get container status \"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91\": rpc error: code = NotFound desc = could not find container \"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91\": container with ID starting with 10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91 not found: ID does not exist" Jul 21 18:25:07.831944 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.831921 2567 scope.go:117] "RemoveContainer" containerID="a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350" Jul 21 18:25:07.832134 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:25:07.832119 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350\": container with ID starting with a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350 not found: ID does not exist" containerID="a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350" Jul 21 18:25:07.832176 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.832137 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350"} err="failed to get container status \"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350\": rpc error: code = NotFound desc = could not find container \"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350\": container with ID starting with a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350 not found: ID does not exist" Jul 21 18:25:07.832176 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.832150 2567 scope.go:117] "RemoveContainer" containerID="a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7" Jul 21 18:25:07.832361 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:25:07.832344 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7\": container with ID starting with a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7 not found: ID does not exist" containerID="a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7" Jul 21 18:25:07.832421 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.832369 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7"} err="failed to get container status \"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7\": rpc error: code = NotFound desc = could not find container \"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7\": container with ID starting with a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7 not found: ID does not exist" Jul 21 18:25:07.832421 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.832389 2567 scope.go:117] "RemoveContainer" containerID="db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d" Jul 21 18:25:07.832628 ip-10-0-140-156 kubenswrapper[2567]: E0721 18:25:07.832594 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d\": container with ID starting with db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d not found: ID does not exist" containerID="db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d" Jul 21 18:25:07.832671 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.832627 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d"} err="failed to get container status \"db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d\": rpc error: code = NotFound desc = could not find container \"db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d\": container with ID starting with db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d not found: ID does not exist" Jul 21 18:25:07.832671 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.832641 2567 scope.go:117] "RemoveContainer" containerID="2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f" Jul 21 18:25:07.832848 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.832831 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f"} err="failed to get container status \"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f\": rpc error: code = NotFound desc = could not find container \"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f\": container with ID starting with 2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f not found: ID does not exist" Jul 21 18:25:07.832906 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.832849 2567 scope.go:117] "RemoveContainer" containerID="f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a" Jul 21 18:25:07.833072 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.833056 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a"} err="failed to get container status \"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a\": rpc error: code = NotFound desc = could not find container \"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a\": container with ID starting with f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a not found: ID does not exist" Jul 21 18:25:07.833133 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.833073 2567 scope.go:117] "RemoveContainer" containerID="52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d" Jul 21 18:25:07.833312 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.833296 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d"} err="failed to get container status \"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d\": rpc error: code = NotFound desc = could not find container \"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d\": container with ID starting with 52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d not found: ID does not exist" Jul 21 18:25:07.833352 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.833312 2567 scope.go:117] "RemoveContainer" containerID="10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91" Jul 21 18:25:07.833517 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.833500 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91"} err="failed to get container status \"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91\": rpc error: code = NotFound desc = could not find container \"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91\": container with ID starting with 10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91 not found: ID does not exist" Jul 21 18:25:07.833564 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.833519 2567 scope.go:117] "RemoveContainer" containerID="a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350" Jul 21 18:25:07.833780 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.833762 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350"} err="failed to get container status \"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350\": rpc error: code = NotFound desc = could not find container \"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350\": container with ID starting with a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350 not found: ID does not exist" Jul 21 18:25:07.833859 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.833782 2567 scope.go:117] "RemoveContainer" containerID="a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7" Jul 21 18:25:07.834020 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.834003 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7"} err="failed to get container status \"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7\": rpc error: code = NotFound desc = could not find container \"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7\": container with ID starting with a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7 not found: ID does not exist" Jul 21 18:25:07.834068 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.834020 2567 scope.go:117] "RemoveContainer" containerID="db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d" Jul 21 18:25:07.834215 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.834198 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d"} err="failed to get container status \"db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d\": rpc error: code = NotFound desc = could not find container \"db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d\": container with ID starting with db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d not found: ID does not exist" Jul 21 18:25:07.834262 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.834215 2567 scope.go:117] "RemoveContainer" containerID="2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f" Jul 21 18:25:07.834398 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.834381 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f"} err="failed to get container status \"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f\": rpc error: code = NotFound desc = could not find container \"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f\": container with ID starting with 2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f not found: ID does not exist" Jul 21 18:25:07.834456 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.834400 2567 scope.go:117] "RemoveContainer" containerID="f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a" Jul 21 18:25:07.834596 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.834577 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a"} err="failed to get container status \"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a\": rpc error: code = NotFound desc = could not find container \"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a\": container with ID starting with f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a not found: ID does not exist" Jul 21 18:25:07.834664 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.834597 2567 scope.go:117] "RemoveContainer" containerID="52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d" Jul 21 18:25:07.834815 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.834798 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d"} err="failed to get container status \"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d\": rpc error: code = NotFound desc = could not find container \"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d\": container with ID starting with 52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d not found: ID does not exist" Jul 21 18:25:07.834883 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.834816 2567 scope.go:117] "RemoveContainer" containerID="10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91" Jul 21 18:25:07.835022 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.835006 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91"} err="failed to get container status \"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91\": rpc error: code = NotFound desc = could not find container \"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91\": container with ID starting with 10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91 not found: ID does not exist" Jul 21 18:25:07.835068 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.835022 2567 scope.go:117] "RemoveContainer" containerID="a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350" Jul 21 18:25:07.835212 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.835196 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350"} err="failed to get container status \"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350\": rpc error: code = NotFound desc = could not find container \"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350\": container with ID starting with a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350 not found: ID does not exist" Jul 21 18:25:07.835276 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.835216 2567 scope.go:117] "RemoveContainer" containerID="a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7" Jul 21 18:25:07.835431 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.835412 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7"} err="failed to get container status \"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7\": rpc error: code = NotFound desc = could not find container \"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7\": container with ID starting with a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7 not found: ID does not exist" Jul 21 18:25:07.835485 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.835432 2567 scope.go:117] "RemoveContainer" containerID="db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d" Jul 21 18:25:07.835696 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.835676 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d"} err="failed to get container status \"db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d\": rpc error: code = NotFound desc = could not find container \"db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d\": container with ID starting with db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d not found: ID does not exist" Jul 21 18:25:07.835755 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.835696 2567 scope.go:117] "RemoveContainer" containerID="2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f" Jul 21 18:25:07.835990 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.835900 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f"} err="failed to get container status \"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f\": rpc error: code = NotFound desc = could not find container \"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f\": container with ID starting with 2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f not found: ID does not exist" Jul 21 18:25:07.835990 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.835924 2567 scope.go:117] "RemoveContainer" containerID="f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a" Jul 21 18:25:07.836166 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.836129 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a"} err="failed to get container status \"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a\": rpc error: code = NotFound desc = could not find container \"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a\": container with ID starting with f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a not found: ID does not exist" Jul 21 18:25:07.836166 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.836144 2567 scope.go:117] "RemoveContainer" containerID="52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d" Jul 21 18:25:07.836351 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.836335 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d"} err="failed to get container status \"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d\": rpc error: code = NotFound desc = could not find container \"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d\": container with ID starting with 52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d not found: ID does not exist" Jul 21 18:25:07.836402 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.836351 2567 scope.go:117] "RemoveContainer" containerID="10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91" Jul 21 18:25:07.836529 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.836511 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91"} err="failed to get container status \"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91\": rpc error: code = NotFound desc = could not find container \"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91\": container with ID starting with 10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91 not found: ID does not exist" Jul 21 18:25:07.836596 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.836530 2567 scope.go:117] "RemoveContainer" containerID="a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350" Jul 21 18:25:07.836777 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.836759 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350"} err="failed to get container status \"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350\": rpc error: code = NotFound desc = could not find container \"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350\": container with ID starting with a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350 not found: ID does not exist" Jul 21 18:25:07.836836 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.836778 2567 scope.go:117] "RemoveContainer" containerID="a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7" Jul 21 18:25:07.836989 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.836972 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7"} err="failed to get container status \"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7\": rpc error: code = NotFound desc = could not find container \"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7\": container with ID starting with a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7 not found: ID does not exist" Jul 21 18:25:07.837033 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.836989 2567 scope.go:117] "RemoveContainer" containerID="db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d" Jul 21 18:25:07.837164 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.837148 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d"} err="failed to get container status \"db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d\": rpc error: code = NotFound desc = could not find container \"db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d\": container with ID starting with db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d not found: ID does not exist" Jul 21 18:25:07.837164 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.837163 2567 scope.go:117] "RemoveContainer" containerID="2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f" Jul 21 18:25:07.837374 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.837355 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f"} err="failed to get container status \"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f\": rpc error: code = NotFound desc = could not find container \"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f\": container with ID starting with 2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f not found: ID does not exist" Jul 21 18:25:07.837419 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.837376 2567 scope.go:117] "RemoveContainer" containerID="f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a" Jul 21 18:25:07.837626 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.837591 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a"} err="failed to get container status \"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a\": rpc error: code = NotFound desc = could not find container \"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a\": container with ID starting with f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a not found: ID does not exist" Jul 21 18:25:07.837626 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.837620 2567 scope.go:117] "RemoveContainer" containerID="52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d" Jul 21 18:25:07.837837 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.837810 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d"} err="failed to get container status \"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d\": rpc error: code = NotFound desc = could not find container \"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d\": container with ID starting with 52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d not found: ID does not exist" Jul 21 18:25:07.837837 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.837829 2567 scope.go:117] "RemoveContainer" containerID="10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91" Jul 21 18:25:07.838106 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.838079 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91"} err="failed to get container status \"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91\": rpc error: code = NotFound desc = could not find container \"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91\": container with ID starting with 10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91 not found: ID does not exist" Jul 21 18:25:07.838106 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.838105 2567 scope.go:117] "RemoveContainer" containerID="a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350" Jul 21 18:25:07.838313 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.838298 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350"} err="failed to get container status \"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350\": rpc error: code = NotFound desc = could not find container \"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350\": container with ID starting with a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350 not found: ID does not exist" Jul 21 18:25:07.838350 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.838312 2567 scope.go:117] "RemoveContainer" containerID="a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7" Jul 21 18:25:07.838560 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.838544 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7"} err="failed to get container status \"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7\": rpc error: code = NotFound desc = could not find container \"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7\": container with ID starting with a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7 not found: ID does not exist" Jul 21 18:25:07.838560 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.838559 2567 scope.go:117] "RemoveContainer" containerID="db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d" Jul 21 18:25:07.838765 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.838747 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d"} err="failed to get container status \"db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d\": rpc error: code = NotFound desc = could not find container \"db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d\": container with ID starting with db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d not found: ID does not exist" Jul 21 18:25:07.838803 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.838765 2567 scope.go:117] "RemoveContainer" containerID="2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f" Jul 21 18:25:07.839001 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.838978 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f"} err="failed to get container status \"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f\": rpc error: code = NotFound desc = could not find container \"2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f\": container with ID starting with 2dc0021dcd14d98611dfbc189a0dafbf207c9c4b31255eb6bc1a5a1a59e4155f not found: ID does not exist" Jul 21 18:25:07.839001 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.839001 2567 scope.go:117] "RemoveContainer" containerID="f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a" Jul 21 18:25:07.839232 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.839215 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a"} err="failed to get container status \"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a\": rpc error: code = NotFound desc = could not find container \"f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a\": container with ID starting with f03e90fc83677f882f37473593a5b7702d2245690b78cc9eecf2b787496b6a9a not found: ID does not exist" Jul 21 18:25:07.839281 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.839236 2567 scope.go:117] "RemoveContainer" containerID="52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d" Jul 21 18:25:07.839486 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.839463 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d"} err="failed to get container status \"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d\": rpc error: code = NotFound desc = could not find container \"52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d\": container with ID starting with 52a979d6a986d25329cb6689d0af48e8522829e83e48db3248198d8d2cc70f6d not found: ID does not exist" Jul 21 18:25:07.839563 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.839487 2567 scope.go:117] "RemoveContainer" containerID="10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91" Jul 21 18:25:07.839806 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.839776 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91"} err="failed to get container status \"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91\": rpc error: code = NotFound desc = could not find container \"10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91\": container with ID starting with 10e8ceb7ef568663eda2ed56c56f47d063db5ce099719b24c3a1c704c426dc91 not found: ID does not exist" Jul 21 18:25:07.839806 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.839797 2567 scope.go:117] "RemoveContainer" containerID="a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350" Jul 21 18:25:07.840015 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.839987 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350"} err="failed to get container status \"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350\": rpc error: code = NotFound desc = could not find container \"a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350\": container with ID starting with a96ac1d5c50d2b3d12a8685de173edacb5a272adbc3c8091a0e797d1cd122350 not found: ID does not exist" Jul 21 18:25:07.840015 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.840014 2567 scope.go:117] "RemoveContainer" containerID="a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7" Jul 21 18:25:07.840271 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.840242 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7"} err="failed to get container status \"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7\": rpc error: code = NotFound desc = could not find container \"a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7\": container with ID starting with a0c5a56e1e33e20fae9d7383afb4bb1abed866aa4d91e4ce54ab2bf2afec6ff7 not found: ID does not exist" Jul 21 18:25:07.840354 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.840272 2567 scope.go:117] "RemoveContainer" containerID="db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d" Jul 21 18:25:07.840494 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.840476 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d"} err="failed to get container status \"db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d\": rpc error: code = NotFound desc = could not find container \"db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d\": container with ID starting with db9aff9022747fc1a7e957bb563b21635b3f426c2d8f6bfd8453b4c34b957a8d not found: ID does not exist" Jul 21 18:25:07.846108 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846082 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 18:25:07.846321 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846310 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="kube-rbac-proxy" Jul 21 18:25:07.846373 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846323 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="kube-rbac-proxy" Jul 21 18:25:07.846373 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846334 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="init-config-reloader" Jul 21 18:25:07.846373 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846340 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="init-config-reloader" Jul 21 18:25:07.846373 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846348 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cabf4b2-7080-4f16-be94-a036ef4c28be" containerName="console" Jul 21 18:25:07.846373 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846354 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cabf4b2-7080-4f16-be94-a036ef4c28be" containerName="console" Jul 21 18:25:07.846373 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846360 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="config-reloader" Jul 21 18:25:07.846373 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846365 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="config-reloader" Jul 21 18:25:07.846373 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846371 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="prometheus" Jul 21 18:25:07.846373 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846376 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="prometheus" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846383 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="813af2b5-49cc-4d2f-b37d-fff34d8cd5a2" containerName="console" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846388 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="813af2b5-49cc-4d2f-b37d-fff34d8cd5a2" containerName="console" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846394 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="kube-rbac-proxy-thanos" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846399 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="kube-rbac-proxy-thanos" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846405 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="kube-rbac-proxy-web" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846410 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="kube-rbac-proxy-web" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846418 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="prom-label-proxy" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846423 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="prom-label-proxy" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846428 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="alertmanager" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846432 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="alertmanager" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846438 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="kube-rbac-proxy-web" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846444 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="kube-rbac-proxy-web" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846449 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="init-config-reloader" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846454 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="init-config-reloader" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846460 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="kube-rbac-proxy" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846465 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="kube-rbac-proxy" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846470 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="kube-rbac-proxy-metric" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846475 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="kube-rbac-proxy-metric" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846479 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="config-reloader" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846484 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="config-reloader" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846489 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="thanos-sidecar" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846494 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="thanos-sidecar" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846530 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="kube-rbac-proxy-web" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846537 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="kube-rbac-proxy-metric" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846543 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="thanos-sidecar" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846548 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="config-reloader" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846555 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="813af2b5-49cc-4d2f-b37d-fff34d8cd5a2" containerName="console" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846560 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="kube-rbac-proxy" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846565 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="prom-label-proxy" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846571 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cabf4b2-7080-4f16-be94-a036ef4c28be" containerName="console" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846575 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="kube-rbac-proxy" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846580 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="prometheus" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846585 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="kube-rbac-proxy-thanos" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846590 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0199315d-1730-405c-bec6-6648509b7da1" containerName="config-reloader" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846595 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="alertmanager" Jul 21 18:25:07.846662 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.846601 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e34c7708-ca55-4f7a-9c1c-0989e784cd3a" containerName="kube-rbac-proxy-web" Jul 21 18:25:07.850582 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.850568 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.853254 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.853235 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 21 18:25:07.853394 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.853378 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 21 18:25:07.853492 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.853394 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 21 18:25:07.853492 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.853478 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 21 18:25:07.853803 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.853791 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2cgmleh1t79em\"" Jul 21 18:25:07.854091 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.854070 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 21 18:25:07.854394 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.854377 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 21 18:25:07.854701 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.854415 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 21 18:25:07.854701 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.854378 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 21 18:25:07.854701 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.854433 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 21 18:25:07.854701 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.854382 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4qm5z\"" Jul 21 18:25:07.854701 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.854446 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 21 18:25:07.854891 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.854843 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 21 18:25:07.855182 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.855163 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 21 18:25:07.857078 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.856978 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 21 18:25:07.861771 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.861741 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-db\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:07.861874 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.861774 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:07.861874 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.861790 2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-metrics-client-certs\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:07.861874 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.861805 2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-kube-rbac-proxy\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:07.861874 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.861819 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:07.861874 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.861859 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-web-config\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:07.861874 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.861872 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:07.862156 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.861886 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0199315d-1730-405c-bec6-6648509b7da1-tls-assets\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:07.862156 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.861905 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:07.862156 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.861918 2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-grpc-tls\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:07.862156 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.861931 2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:07.862156 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.861947 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:07.862156 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.861964 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgrfl\" (UniqueName: \"kubernetes.io/projected/0199315d-1730-405c-bec6-6648509b7da1-kube-api-access-kgrfl\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:07.862156 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.861978 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0199315d-1730-405c-bec6-6648509b7da1-configmap-metrics-client-ca\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:07.862156 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.861991 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0199315d-1730-405c-bec6-6648509b7da1-config-out\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:07.862156 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.862004 2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-config\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:07.862156 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.862022 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0199315d-1730-405c-bec6-6648509b7da1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-156.ec2.internal\" DevicePath \"\"" Jul 21 18:25:07.862621 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.862532 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 21 18:25:07.870027 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.870007 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 18:25:07.962359 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.962325 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdkm5\" (UniqueName: \"kubernetes.io/projected/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-kube-api-access-qdkm5\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.962359 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.962359 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.962680 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.962379 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.962680 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.962399 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.962680 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.962414 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.962680 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.962460 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.962680 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.962510 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-config\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.962680 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.962542 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.962680 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.962564 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.962680 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.962584 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.962680 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.962670 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.963044 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.962720 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.963044 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.962749 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.963044 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.962765 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.963044 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.962781 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.963044 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.962797 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.963044 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.962843 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.963044 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.962873 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.963044 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.962897 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:07.963044 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:07.962927 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.008185 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.008159 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0199315d-1730-405c-bec6-6648509b7da1" path="/var/lib/kubelet/pods/0199315d-1730-405c-bec6-6648509b7da1/volumes" Jul 21 18:25:08.064054 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.064016 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-config\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.064054 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.064059 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.064215 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.064078 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.064215 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.064093 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.064215 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.064118 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.064215 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.064146 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.064215 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.064189 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.064530 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.064223 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.064804 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.064779 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.064895 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.064843 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.064895 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.064858 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.064895 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.064872 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.065042 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.064918 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.065042 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.064946 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.065042 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.064971 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.065042 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.065005 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.065042 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.065036 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdkm5\" (UniqueName: \"kubernetes.io/projected/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-kube-api-access-qdkm5\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.065287 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.065068 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.065287 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.065096 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.065287 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.065131 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.065287 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.065157 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.065287 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.065181 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.065533 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.065351 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.067167 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.067141 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-config\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.067347 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.067324 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.067413 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.067337 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.067997 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.067676 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.067997 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.067726 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.067997 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.067877 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.067997 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.068080 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.067997 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.068131 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.067997 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.068154 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.067997 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.068191 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.068582 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.068283 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.068582 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.068478 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.069825 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.069798 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.069963 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.069931 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.070020 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.069947 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.070946 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.070930 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.073179 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.073158 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdkm5\" (UniqueName: \"kubernetes.io/projected/fe1b9a9c-fac6-4b68-b26f-87b73ac4df50-kube-api-access-qdkm5\") pod \"prometheus-k8s-0\" (UID: \"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.166324 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.166268 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:25:08.298581 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.298559 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 18:25:08.300685 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:25:08.300664 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe1b9a9c_fac6_4b68_b26f_87b73ac4df50.slice/crio-f6000a04b8e5d20e438029c492024824d90a1b3d66879b89ed944879ca5443c4 WatchSource:0}: Error finding container f6000a04b8e5d20e438029c492024824d90a1b3d66879b89ed944879ca5443c4: Status 404 returned error can't find the container with id f6000a04b8e5d20e438029c492024824d90a1b3d66879b89ed944879ca5443c4 Jul 21 18:25:08.789657 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.789623 2567 generic.go:356] "Generic (PLEG): container finished" podID="fe1b9a9c-fac6-4b68-b26f-87b73ac4df50" containerID="d603aa36b98380cdec5910dcc5ab5984682306163731c59e52b5f238bd6c4ebe" exitCode=0 Jul 21 18:25:08.790088 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.789709 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50","Type":"ContainerDied","Data":"d603aa36b98380cdec5910dcc5ab5984682306163731c59e52b5f238bd6c4ebe"} Jul 21 18:25:08.790088 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:08.789800 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50","Type":"ContainerStarted","Data":"f6000a04b8e5d20e438029c492024824d90a1b3d66879b89ed944879ca5443c4"} Jul 21 18:25:09.797514 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:09.797481 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50","Type":"ContainerStarted","Data":"d8296ff128485631bc62599d44b3b52a9955e954455bfd888a573915934dc8bd"} Jul 21 18:25:09.797894 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:09.797540 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50","Type":"ContainerStarted","Data":"e68ba8c1598dade901aea0466e5723c502d58c545dd9cb9e151de0beade29dda"} Jul 21 18:25:09.797894 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:09.797570 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50","Type":"ContainerStarted","Data":"afd85e9b6f931f0f9204582d39d9571448dc036db7306e340bfe83ab15248eba"} Jul 21 18:25:09.797894 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:09.797593 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50","Type":"ContainerStarted","Data":"9ba7c18e16ddf020f3a4948c409b201884bba94d52ac8f8f06d6ce78988a6fd9"} Jul 21 18:25:09.797894 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:09.797638 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50","Type":"ContainerStarted","Data":"ac52826b5232e1796332eff81088279220f7ae7cda3a6487de61f3343a9e4db5"} Jul 21 18:25:09.797894 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:09.797662 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe1b9a9c-fac6-4b68-b26f-87b73ac4df50","Type":"ContainerStarted","Data":"b13ef05c7dad255b162ec0b9b00f0eb7854512b3cfe29fc8f8ea4e520af04067"} Jul 21 18:25:09.829744 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:09.829679 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.809145363 podStartE2EDuration="2.829659012s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.513649ms" isStatefulPod=false podCreationTimestamp="2026-07-21 18:25:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:25:09.827046605 +0000 UTC m=+156.450773835" watchObservedRunningTime="2026-07-21 18:25:09.829659012 +0000 UTC m=+156.453386242" Jul 21 18:25:13.167335 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:25:13.167295 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:26:08.167049 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:26:08.167012 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:26:08.181977 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:26:08.181954 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:26:09.027319 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:26:09.027295 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 18:27:07.693116 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:07.693015 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hcwt5_afb4b042-5e50-4298-af62-23c520feeb7c/global-pull-secret-syncer/0.log" Jul 21 18:27:07.764093 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:07.764054 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-97zj8_755ebec0-a61c-44f1-a421-d08da8909234/konnectivity-agent/0.log" Jul 21 18:27:07.837317 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:07.837286 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-156.ec2.internal_caddfd40ee2f3e5aec0a7ccd950ec47a/haproxy/0.log" Jul 21 18:27:11.977013 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:11.976980 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5746d7c95f-zm829_b3f89c19-022a-4d65-9b27-141073b90745/metrics-server/0.log" Jul 21 18:27:12.003598 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:12.003571 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-vb6pl_d0a3e577-e6b4-4a27-98a2-c3171ffda9d9/monitoring-plugin/0.log" Jul 21 18:27:12.031976 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:12.031945 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5l5t7_92f3b164-d490-40d1-b4a1-7ab9c8df860d/node-exporter/0.log" Jul 21 18:27:12.051106 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:12.051084 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5l5t7_92f3b164-d490-40d1-b4a1-7ab9c8df860d/kube-rbac-proxy/0.log" Jul 21 18:27:12.079044 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:12.079018 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5l5t7_92f3b164-d490-40d1-b4a1-7ab9c8df860d/init-textfile/0.log" Jul 21 18:27:12.359108 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:12.359067 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe1b9a9c-fac6-4b68-b26f-87b73ac4df50/prometheus/0.log" Jul 21 18:27:12.380086 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:12.380065 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe1b9a9c-fac6-4b68-b26f-87b73ac4df50/config-reloader/0.log" Jul 21 18:27:12.403093 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:12.403075 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe1b9a9c-fac6-4b68-b26f-87b73ac4df50/thanos-sidecar/0.log" Jul 21 18:27:12.423733 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:12.423711 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe1b9a9c-fac6-4b68-b26f-87b73ac4df50/kube-rbac-proxy-web/0.log" Jul 21 18:27:12.446789 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:12.446766 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe1b9a9c-fac6-4b68-b26f-87b73ac4df50/kube-rbac-proxy/0.log" Jul 21 18:27:12.473551 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:12.473527 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe1b9a9c-fac6-4b68-b26f-87b73ac4df50/kube-rbac-proxy-thanos/0.log" Jul 21 18:27:12.495452 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:12.495427 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe1b9a9c-fac6-4b68-b26f-87b73ac4df50/init-config-reloader/0.log" Jul 21 18:27:12.528730 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:12.528666 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-fkwcm_a68d1c4b-e317-43ad-858f-5785999f6912/prometheus-operator/0.log" Jul 21 18:27:12.552119 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:12.552098 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-fkwcm_a68d1c4b-e317-43ad-858f-5785999f6912/kube-rbac-proxy/0.log" Jul 21 18:27:12.727868 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:12.727839 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4c47448b-tpl6v_ee787b3e-9103-4bfb-969e-3a457499ff82/thanos-query/0.log" Jul 21 18:27:12.752934 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:12.752911 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4c47448b-tpl6v_ee787b3e-9103-4bfb-969e-3a457499ff82/kube-rbac-proxy-web/0.log" Jul 21 18:27:12.781120 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:12.781059 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4c47448b-tpl6v_ee787b3e-9103-4bfb-969e-3a457499ff82/kube-rbac-proxy/0.log" Jul 21 18:27:12.807224 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:12.807205 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4c47448b-tpl6v_ee787b3e-9103-4bfb-969e-3a457499ff82/prom-label-proxy/0.log" Jul 21 18:27:12.837482 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:12.837451 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4c47448b-tpl6v_ee787b3e-9103-4bfb-969e-3a457499ff82/kube-rbac-proxy-rules/0.log" Jul 21 18:27:12.866538 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:12.866514 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f4c47448b-tpl6v_ee787b3e-9103-4bfb-969e-3a457499ff82/kube-rbac-proxy-metrics/0.log" Jul 21 18:27:14.904276 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:14.904244 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8"] Jul 21 18:27:14.906419 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:14.906403 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" Jul 21 18:27:14.908832 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:14.908813 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hprr4\"/\"kube-root-ca.crt\"" Jul 21 18:27:14.909950 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:14.909930 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hprr4\"/\"openshift-service-ca.crt\"" Jul 21 18:27:14.909950 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:14.909943 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hprr4\"/\"default-dockercfg-5fwdz\"" Jul 21 18:27:14.917200 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:14.917178 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8"] Jul 21 18:27:15.020078 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:15.020043 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/184e931c-c02b-48c9-8952-40b0f202f962-sys\") pod \"perf-node-gather-daemonset-726v8\" (UID: \"184e931c-c02b-48c9-8952-40b0f202f962\") " pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" Jul 21 18:27:15.020078 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:15.020084 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvnf2\" (UniqueName: \"kubernetes.io/projected/184e931c-c02b-48c9-8952-40b0f202f962-kube-api-access-rvnf2\") pod \"perf-node-gather-daemonset-726v8\" (UID: \"184e931c-c02b-48c9-8952-40b0f202f962\") " pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" Jul 21 18:27:15.020354 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:15.020107 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/184e931c-c02b-48c9-8952-40b0f202f962-lib-modules\") pod \"perf-node-gather-daemonset-726v8\" (UID: \"184e931c-c02b-48c9-8952-40b0f202f962\") " pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" Jul 21 18:27:15.020354 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:15.020122 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/184e931c-c02b-48c9-8952-40b0f202f962-proc\") pod \"perf-node-gather-daemonset-726v8\" (UID: \"184e931c-c02b-48c9-8952-40b0f202f962\") " pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" Jul 21 18:27:15.020354 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:15.020230 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/184e931c-c02b-48c9-8952-40b0f202f962-podres\") pod \"perf-node-gather-daemonset-726v8\" (UID: \"184e931c-c02b-48c9-8952-40b0f202f962\") " pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" Jul 21 18:27:15.121128 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:15.121089 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/184e931c-c02b-48c9-8952-40b0f202f962-sys\") pod \"perf-node-gather-daemonset-726v8\" (UID: \"184e931c-c02b-48c9-8952-40b0f202f962\") " pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" Jul 21 18:27:15.121128 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:15.121130 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvnf2\" (UniqueName: \"kubernetes.io/projected/184e931c-c02b-48c9-8952-40b0f202f962-kube-api-access-rvnf2\") pod \"perf-node-gather-daemonset-726v8\" (UID: \"184e931c-c02b-48c9-8952-40b0f202f962\") " pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" Jul 21 18:27:15.121370 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:15.121154 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/184e931c-c02b-48c9-8952-40b0f202f962-lib-modules\") pod \"perf-node-gather-daemonset-726v8\" (UID: \"184e931c-c02b-48c9-8952-40b0f202f962\") " pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" Jul 21 18:27:15.121370 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:15.121171 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/184e931c-c02b-48c9-8952-40b0f202f962-proc\") pod \"perf-node-gather-daemonset-726v8\" (UID: \"184e931c-c02b-48c9-8952-40b0f202f962\") " pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" Jul 21 18:27:15.121370 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:15.121191 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/184e931c-c02b-48c9-8952-40b0f202f962-podres\") pod \"perf-node-gather-daemonset-726v8\" (UID: \"184e931c-c02b-48c9-8952-40b0f202f962\") " pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" Jul 21 18:27:15.121370 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:15.121238 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/184e931c-c02b-48c9-8952-40b0f202f962-sys\") pod \"perf-node-gather-daemonset-726v8\" (UID: \"184e931c-c02b-48c9-8952-40b0f202f962\") " pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" Jul 21 18:27:15.121370 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:15.121273 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/184e931c-c02b-48c9-8952-40b0f202f962-proc\") pod \"perf-node-gather-daemonset-726v8\" (UID: \"184e931c-c02b-48c9-8952-40b0f202f962\") " pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" Jul 21 18:27:15.121370 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:15.121311 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/184e931c-c02b-48c9-8952-40b0f202f962-podres\") pod \"perf-node-gather-daemonset-726v8\" (UID: \"184e931c-c02b-48c9-8952-40b0f202f962\") " pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" Jul 21 18:27:15.121370 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:15.121323 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/184e931c-c02b-48c9-8952-40b0f202f962-lib-modules\") pod \"perf-node-gather-daemonset-726v8\" (UID: \"184e931c-c02b-48c9-8952-40b0f202f962\") " pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" Jul 21 18:27:15.129421 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:15.129396 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvnf2\" (UniqueName: \"kubernetes.io/projected/184e931c-c02b-48c9-8952-40b0f202f962-kube-api-access-rvnf2\") pod \"perf-node-gather-daemonset-726v8\" (UID: \"184e931c-c02b-48c9-8952-40b0f202f962\") " pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" Jul 21 18:27:15.216771 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:15.216669 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" Jul 21 18:27:15.339810 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:15.339778 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8"] Jul 21 18:27:15.343032 ip-10-0-140-156 kubenswrapper[2567]: W0721 18:27:15.343001 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod184e931c_c02b_48c9_8952_40b0f202f962.slice/crio-2972a580b05910d02d51d1a204f58caeac71c29d735dbb133f2677ddb28d1545 WatchSource:0}: Error finding container 2972a580b05910d02d51d1a204f58caeac71c29d735dbb133f2677ddb28d1545: Status 404 returned error can't find the container with id 2972a580b05910d02d51d1a204f58caeac71c29d735dbb133f2677ddb28d1545 Jul 21 18:27:16.034895 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:16.034871 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q9p7m_87b4900f-e337-4ce2-9421-5e92113d7489/dns/0.log" Jul 21 18:27:16.055877 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:16.055835 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q9p7m_87b4900f-e337-4ce2-9421-5e92113d7489/kube-rbac-proxy/0.log" Jul 21 18:27:16.126226 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:16.126195 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gfxb8_a7487046-daae-4342-a332-ba55d432ab64/dns-node-resolver/0.log" Jul 21 18:27:16.255899 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:16.255864 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" event={"ID":"184e931c-c02b-48c9-8952-40b0f202f962","Type":"ContainerStarted","Data":"f2c86972bb82d233899f1a32cdf94868c38b55e6e0d3e6795a766a34bbb56c80"} Jul 21 18:27:16.256095 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:16.255910 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" event={"ID":"184e931c-c02b-48c9-8952-40b0f202f962","Type":"ContainerStarted","Data":"2972a580b05910d02d51d1a204f58caeac71c29d735dbb133f2677ddb28d1545"} Jul 21 18:27:16.256095 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:16.256003 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" Jul 21 18:27:16.271008 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:16.270949 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" podStartSLOduration=2.270928159 podStartE2EDuration="2.270928159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:27:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:27:16.270121657 +0000 UTC m=+282.893848885" watchObservedRunningTime="2026-07-21 18:27:16.270928159 +0000 UTC m=+282.894655387" Jul 21 18:27:16.527065 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:16.527037 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kr557_b33a6147-9b6b-4b35-b8d0-8ac9b92d26d6/node-ca/0.log" Jul 21 18:27:17.461054 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:17.461017 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5t8n8_134b26f8-0815-49bc-94ed-c418fbd78c95/serve-healthcheck-canary/0.log" Jul 21 18:27:17.845552 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:17.845523 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4jc74_2665ac35-c08f-4e0b-821a-8c6745208ffd/kube-rbac-proxy/0.log" Jul 21 18:27:17.865772 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:17.865744 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4jc74_2665ac35-c08f-4e0b-821a-8c6745208ffd/exporter/0.log" Jul 21 18:27:17.887279 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:17.887252 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4jc74_2665ac35-c08f-4e0b-821a-8c6745208ffd/extractor/0.log" Jul 21 18:27:22.269880 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:22.269855 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hprr4/perf-node-gather-daemonset-726v8" Jul 21 18:27:22.802285 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:22.802258 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-84wqq_b9b7e34a-13a2-4a49-87b0-0e0258fd80db/kube-multus-additional-cni-plugins/0.log" Jul 21 18:27:22.824051 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:22.824023 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-84wqq_b9b7e34a-13a2-4a49-87b0-0e0258fd80db/egress-router-binary-copy/0.log" Jul 21 18:27:22.845243 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:22.845215 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-84wqq_b9b7e34a-13a2-4a49-87b0-0e0258fd80db/cni-plugins/0.log" Jul 21 18:27:22.866266 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:22.866244 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-84wqq_b9b7e34a-13a2-4a49-87b0-0e0258fd80db/bond-cni-plugin/0.log" Jul 21 18:27:22.888036 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:22.888011 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-84wqq_b9b7e34a-13a2-4a49-87b0-0e0258fd80db/routeoverride-cni/0.log" Jul 21 18:27:22.909000 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:22.908970 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-84wqq_b9b7e34a-13a2-4a49-87b0-0e0258fd80db/whereabouts-cni-bincopy/0.log" Jul 21 18:27:22.930569 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:22.930541 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-84wqq_b9b7e34a-13a2-4a49-87b0-0e0258fd80db/whereabouts-cni/0.log" Jul 21 18:27:23.111819 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:23.111729 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cvvn6_a23526ee-19c4-46c0-94e4-172fe1edcb9d/kube-multus/0.log" Jul 21 18:27:23.175625 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:23.175578 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r2m2h_32340abc-8237-453b-96e1-2ab5d9aa5d67/network-metrics-daemon/0.log" Jul 21 18:27:23.195173 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:23.195146 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r2m2h_32340abc-8237-453b-96e1-2ab5d9aa5d67/kube-rbac-proxy/0.log" Jul 21 18:27:24.084328 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:24.084302 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9h24_2d61b564-c002-4dfa-95e2-3f2adbbde234/ovn-controller/0.log" Jul 21 18:27:24.104833 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:24.104805 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9h24_2d61b564-c002-4dfa-95e2-3f2adbbde234/ovn-acl-logging/1.log" Jul 21 18:27:24.105018 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:24.104880 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9h24_2d61b564-c002-4dfa-95e2-3f2adbbde234/ovn-acl-logging/0.log" Jul 21 18:27:24.123275 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:24.123248 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9h24_2d61b564-c002-4dfa-95e2-3f2adbbde234/kube-rbac-proxy-node/0.log" Jul 21 18:27:24.145777 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:24.145739 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9h24_2d61b564-c002-4dfa-95e2-3f2adbbde234/kube-rbac-proxy-ovn-metrics/0.log" Jul 21 18:27:24.167324 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:24.167291 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9h24_2d61b564-c002-4dfa-95e2-3f2adbbde234/northd/0.log" Jul 21 18:27:24.192273 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:24.192236 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9h24_2d61b564-c002-4dfa-95e2-3f2adbbde234/nbdb/0.log" Jul 21 18:27:24.215574 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:24.215550 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9h24_2d61b564-c002-4dfa-95e2-3f2adbbde234/sbdb/0.log" Jul 21 18:27:24.274119 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:24.273723 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9h24_2d61b564-c002-4dfa-95e2-3f2adbbde234/ovnkube-controller/0.log" Jul 21 18:27:25.607852 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:25.607776 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-cc6j9_277cbd93-cf42-46f9-91d7-83d45fae8ae1/network-check-target-container/0.log" Jul 21 18:27:26.507163 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:26.507134 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-rz4tw_ffea9ae8-d7cf-4f21-9622-6a1aca2b552f/iptables-alerter/0.log" Jul 21 18:27:27.107214 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:27.107184 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-k4rw4_73ed484d-3b20-483f-a95f-21bab48a050d/tuned/0.log" Jul 21 18:27:30.236851 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:30.236806 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-f95dj_b2a0a656-2f97-4a13-a9d7-bb14c2e02a90/csi-driver/0.log" Jul 21 18:27:30.257586 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:30.257540 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-f95dj_b2a0a656-2f97-4a13-a9d7-bb14c2e02a90/csi-node-driver-registrar/0.log" Jul 21 18:27:30.277842 ip-10-0-140-156 kubenswrapper[2567]: I0721 18:27:30.277799 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-f95dj_b2a0a656-2f97-4a13-a9d7-bb14c2e02a90/csi-liveness-probe/0.log"