Jul 28 15:11:56.493494 ip-10-0-138-160 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 28 15:11:56.493509 ip-10-0-138-160 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 28 15:11:56.493519 ip-10-0-138-160 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 28 15:11:56.493859 ip-10-0-138-160 systemd[1]: Failed to start Kubernetes Kubelet. Jul 28 15:12:06.009937 ip-10-0-138-160 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 28 15:12:06.009952 ip-10-0-138-160 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ba0bee4308784bf29e113b2957acbac2 -- Jul 28 15:13:47.245247 ip-10-0-138-160 systemd[1]: Starting Kubernetes Kubelet... Jul 28 15:13:47.552549 ip-10-0-138-160 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 15:13:47.552549 ip-10-0-138-160 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 15:13:47.552549 ip-10-0-138-160 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 15:13:47.552549 ip-10-0-138-160 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 15:13:47.552549 ip-10-0-138-160 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 15:13:47.553895 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.553812 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 15:13:47.560045 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560010 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 15:13:47.560045 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560042 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 15:13:47.560045 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560048 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 15:13:47.560259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560054 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 15:13:47.560259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560060 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 15:13:47.560259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560065 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 15:13:47.560259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560076 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 15:13:47.560259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560080 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 15:13:47.560259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560088 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 15:13:47.560259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560212 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 15:13:47.560259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560222 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 15:13:47.560259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560227 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 15:13:47.560259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560231 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 15:13:47.560259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560233 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 15:13:47.560259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560236 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 15:13:47.560259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560239 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 15:13:47.560259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560242 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 15:13:47.560259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560244 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 15:13:47.560259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560248 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 15:13:47.560259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560250 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 15:13:47.560259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560253 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 15:13:47.560259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560256 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 15:13:47.560259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560258 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 15:13:47.560784 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560261 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 15:13:47.560784 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560264 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 15:13:47.560784 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560267 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 15:13:47.560784 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560270 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 15:13:47.560784 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560273 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 15:13:47.560784 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560276 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 15:13:47.560784 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560278 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 15:13:47.560784 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560282 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 15:13:47.560784 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560285 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 15:13:47.560784 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560287 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 15:13:47.560784 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560290 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 15:13:47.560784 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560293 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 15:13:47.560784 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560298 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 15:13:47.560784 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560304 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 15:13:47.560784 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560307 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 15:13:47.560784 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560310 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 15:13:47.560784 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560313 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 15:13:47.560784 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560315 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 15:13:47.560784 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560323 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 15:13:47.561256 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560326 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 15:13:47.561256 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560328 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 15:13:47.561256 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560331 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 15:13:47.561256 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560334 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 15:13:47.561256 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560336 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 15:13:47.561256 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560339 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 15:13:47.561256 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560341 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 15:13:47.561256 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560343 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 15:13:47.561256 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560346 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 15:13:47.561256 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560348 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 28 15:13:47.561256 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560351 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 15:13:47.561256 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560353 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 15:13:47.561256 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560356 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 15:13:47.561256 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560359 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 15:13:47.561256 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560363 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 15:13:47.561256 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560367 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 15:13:47.561256 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560371 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 15:13:47.561256 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560375 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 15:13:47.561256 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560378 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 15:13:47.561256 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560381 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 15:13:47.561778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560383 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 15:13:47.561778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560386 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 15:13:47.561778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560388 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 15:13:47.561778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560391 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 15:13:47.561778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560394 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 15:13:47.561778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560396 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 15:13:47.561778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560399 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 15:13:47.561778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560401 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 15:13:47.561778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560405 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 15:13:47.561778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560408 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 15:13:47.561778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560411 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 15:13:47.561778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560414 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 15:13:47.561778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560417 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 15:13:47.561778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560420 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 15:13:47.561778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560423 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 15:13:47.561778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560425 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 15:13:47.561778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560428 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 15:13:47.561778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560432 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 15:13:47.561778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560435 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 15:13:47.561778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560437 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 15:13:47.562298 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560440 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 15:13:47.562298 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560443 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 15:13:47.562298 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560446 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 15:13:47.562298 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560448 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 15:13:47.562298 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560451 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 15:13:47.562298 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560454 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 15:13:47.562298 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560458 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 15:13:47.562298 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560461 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 15:13:47.562298 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560463 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 15:13:47.562298 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560466 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 15:13:47.562298 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560468 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 15:13:47.562298 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560471 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 15:13:47.562298 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560474 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 15:13:47.562298 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560476 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 15:13:47.562298 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560479 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 15:13:47.562298 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560481 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 15:13:47.562298 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.560484 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 15:13:47.562298 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561225 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 15:13:47.562298 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561233 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 15:13:47.562298 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561236 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 15:13:47.562811 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561240 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 15:13:47.562811 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561243 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 15:13:47.562811 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561246 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 15:13:47.562811 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561249 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 15:13:47.562811 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561252 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 15:13:47.562811 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561255 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 15:13:47.562811 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561258 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 15:13:47.562811 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561261 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 15:13:47.562811 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561266 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 15:13:47.562811 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561270 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 15:13:47.562811 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561273 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 28 15:13:47.562811 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561276 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 15:13:47.562811 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561278 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 15:13:47.562811 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561282 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 15:13:47.562811 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561285 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 15:13:47.562811 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561288 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 15:13:47.562811 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561290 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 15:13:47.562811 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561293 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 15:13:47.562811 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561296 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 15:13:47.562811 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561299 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 15:13:47.563313 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561301 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 15:13:47.563313 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561304 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 15:13:47.563313 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561306 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 15:13:47.563313 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561309 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 15:13:47.563313 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561312 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 15:13:47.563313 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561314 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 15:13:47.563313 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561316 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 15:13:47.563313 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561319 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 15:13:47.563313 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561321 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 15:13:47.563313 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561324 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 15:13:47.563313 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561326 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 15:13:47.563313 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561329 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 15:13:47.563313 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561331 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 15:13:47.563313 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561334 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 15:13:47.563313 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561336 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 15:13:47.563313 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561338 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 15:13:47.563313 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561341 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 15:13:47.563313 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561343 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 15:13:47.563313 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561346 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 15:13:47.563313 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561348 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 15:13:47.563818 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561350 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 15:13:47.563818 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561353 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 15:13:47.563818 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561357 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 15:13:47.563818 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561361 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 15:13:47.563818 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561364 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 15:13:47.563818 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561368 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 15:13:47.563818 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561372 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 15:13:47.563818 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561376 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 15:13:47.563818 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561379 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 15:13:47.563818 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561382 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 15:13:47.563818 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561386 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 15:13:47.563818 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561388 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 15:13:47.563818 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561391 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 15:13:47.563818 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561394 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 15:13:47.563818 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561397 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 15:13:47.563818 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561399 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 15:13:47.563818 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561401 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 15:13:47.563818 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561404 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 15:13:47.563818 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561407 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 15:13:47.564305 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561409 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 15:13:47.564305 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561412 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 15:13:47.564305 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561414 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 15:13:47.564305 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561416 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 15:13:47.564305 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561419 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 15:13:47.564305 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561422 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 15:13:47.564305 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561424 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 15:13:47.564305 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561428 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 15:13:47.564305 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561431 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 15:13:47.564305 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561434 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 15:13:47.564305 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561436 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 15:13:47.564305 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561439 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 15:13:47.564305 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561441 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 15:13:47.564305 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561443 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 15:13:47.564305 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561446 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 15:13:47.564305 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561449 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 15:13:47.564305 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561452 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 15:13:47.564305 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561454 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 15:13:47.564305 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561457 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 15:13:47.564305 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561459 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 15:13:47.564804 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561462 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 15:13:47.564804 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561465 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 15:13:47.564804 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561468 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 15:13:47.564804 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561470 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 15:13:47.564804 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561473 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 15:13:47.564804 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561475 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 15:13:47.564804 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561478 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 15:13:47.564804 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561480 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 15:13:47.564804 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561483 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 15:13:47.564804 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561485 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 15:13:47.564804 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561498 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 15:13:47.564804 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561501 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 15:13:47.564804 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561503 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 15:13:47.564804 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561506 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 15:13:47.564804 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561508 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 15:13:47.564804 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561511 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 15:13:47.564804 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561513 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 15:13:47.564804 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561901 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 15:13:47.564804 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561906 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 15:13:47.564804 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561909 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 15:13:47.565299 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561912 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 15:13:47.565299 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561914 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 15:13:47.565299 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561917 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 15:13:47.565299 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561922 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 15:13:47.565299 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561925 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 15:13:47.565299 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561928 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 15:13:47.565299 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561931 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 15:13:47.565299 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561937 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 15:13:47.565299 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561940 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 15:13:47.565299 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561943 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 15:13:47.565299 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561946 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 15:13:47.565299 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561948 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 15:13:47.565299 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561951 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 15:13:47.565299 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561954 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 15:13:47.565299 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561957 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 15:13:47.565299 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561960 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 15:13:47.565299 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561962 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 15:13:47.565299 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561965 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 15:13:47.565299 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561967 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 15:13:47.565760 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561970 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 15:13:47.565760 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561984 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 15:13:47.565760 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561987 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 28 15:13:47.565760 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561989 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 15:13:47.565760 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561992 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 15:13:47.565760 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561994 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 15:13:47.565760 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.561997 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 15:13:47.565760 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562000 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 15:13:47.565760 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562002 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 15:13:47.565760 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562005 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 15:13:47.565760 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562008 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 15:13:47.565760 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562010 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 15:13:47.565760 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562013 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 15:13:47.565760 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562016 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 15:13:47.565760 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562018 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 15:13:47.565760 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562021 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 15:13:47.565760 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562024 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 15:13:47.565760 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562026 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 15:13:47.565760 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562029 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 15:13:47.565760 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562032 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 15:13:47.566275 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562038 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 15:13:47.566275 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562041 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 15:13:47.566275 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562043 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 15:13:47.566275 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562046 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 15:13:47.566275 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562049 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 15:13:47.566275 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562051 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 15:13:47.566275 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562054 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 15:13:47.566275 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562057 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 15:13:47.566275 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562060 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 15:13:47.566275 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562062 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 15:13:47.566275 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562065 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 15:13:47.566275 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562067 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 15:13:47.566275 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562070 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 15:13:47.566275 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562072 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 15:13:47.566275 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562075 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 15:13:47.566275 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562077 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 15:13:47.566275 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562082 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 15:13:47.566275 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562084 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 15:13:47.566275 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562087 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 15:13:47.566735 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562090 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 15:13:47.566735 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562094 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 15:13:47.566735 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562096 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 15:13:47.566735 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562100 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 15:13:47.566735 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562102 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 15:13:47.566735 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562105 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 15:13:47.566735 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562108 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 15:13:47.566735 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562111 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 15:13:47.566735 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562113 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 15:13:47.566735 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562115 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 15:13:47.566735 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562118 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 15:13:47.566735 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562122 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 15:13:47.566735 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562124 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 15:13:47.566735 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562128 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 15:13:47.566735 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562131 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 15:13:47.566735 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562134 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 15:13:47.566735 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562136 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 15:13:47.566735 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562139 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 15:13:47.566735 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562141 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 15:13:47.567210 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562145 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 15:13:47.567210 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562147 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 15:13:47.567210 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562150 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 15:13:47.567210 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562153 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 15:13:47.567210 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562156 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 15:13:47.567210 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562158 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 15:13:47.567210 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562161 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 15:13:47.567210 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562163 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 15:13:47.567210 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562166 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 15:13:47.567210 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562169 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 15:13:47.567210 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562173 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 15:13:47.567210 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562175 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 15:13:47.567210 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562178 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 15:13:47.567210 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562181 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 15:13:47.567210 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562183 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 15:13:47.567210 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562186 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 15:13:47.567210 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562188 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 15:13:47.567210 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562191 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 15:13:47.567210 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562193 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 15:13:47.567210 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562262 2560 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562269 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562279 2560 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562285 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562291 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562296 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562302 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562309 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562313 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562316 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562319 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562323 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562326 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562329 2560 flags.go:64] FLAG: --cgroup-root="" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562332 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562334 2560 flags.go:64] FLAG: --client-ca-file="" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562338 2560 flags.go:64] FLAG: --cloud-provider="external" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562341 2560 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562345 2560 flags.go:64] FLAG: --cluster-domain="" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562349 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562351 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562354 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562358 2560 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562362 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 15:13:47.567691 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562365 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562368 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562371 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562374 2560 flags.go:64] FLAG: --contention-profiling="false" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562377 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562380 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562383 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562385 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562389 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562392 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562395 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562398 2560 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562401 2560 flags.go:64] FLAG: --enable-server="true" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562403 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562407 2560 flags.go:64] FLAG: --event-burst="100" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562410 2560 flags.go:64] FLAG: --event-qps="50" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562413 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562416 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562419 2560 flags.go:64] FLAG: --eviction-hard="" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562423 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562425 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562428 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562431 2560 flags.go:64] FLAG: --eviction-soft="" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562434 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562437 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 15:13:47.568281 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562440 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562444 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562447 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562450 2560 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562453 2560 flags.go:64] FLAG: --feature-gates="" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562456 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562459 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562462 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562466 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562469 2560 flags.go:64] FLAG: --healthz-port="10248" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562472 2560 flags.go:64] FLAG: --help="false" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562474 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-138-160.ec2.internal" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562477 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562480 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562483 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562486 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562490 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562493 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562495 2560 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562498 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562500 2560 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562503 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562507 2560 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562509 2560 flags.go:64] FLAG: --kube-reserved="" Jul 28 15:13:47.568908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562512 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562515 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562518 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562521 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562524 2560 flags.go:64] FLAG: --lock-file="" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562527 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562530 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562533 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562538 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562541 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562544 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562547 2560 flags.go:64] FLAG: --logging-format="text" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562550 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562554 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562556 2560 flags.go:64] FLAG: --manifest-url="" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562559 2560 flags.go:64] FLAG: --manifest-url-header="" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562579 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562583 2560 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562588 2560 flags.go:64] FLAG: --max-pods="110" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562591 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562594 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562597 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562600 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562603 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562606 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 15:13:47.569543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562609 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562616 2560 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562619 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562622 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562625 2560 flags.go:64] FLAG: --pod-cidr="" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562628 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562633 2560 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562636 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562639 2560 flags.go:64] FLAG: --pods-per-core="0" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562641 2560 flags.go:64] FLAG: --port="10250" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562644 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562647 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0823d43cd4c96d53d" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562650 2560 flags.go:64] FLAG: --qos-reserved="" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562653 2560 flags.go:64] FLAG: --read-only-port="10255" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562656 2560 flags.go:64] FLAG: --register-node="true" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562659 2560 flags.go:64] FLAG: --register-with-taints="" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562662 2560 flags.go:64] FLAG: --registry-burst="10" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562665 2560 flags.go:64] FLAG: --registry-qps="5" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562668 2560 flags.go:64] FLAG: --reserved-cpus="" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562671 2560 flags.go:64] FLAG: --reserved-memory="" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562674 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562677 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562680 2560 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562683 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562686 2560 flags.go:64] FLAG: --runonce="false" Jul 28 15:13:47.570156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562688 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562691 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562694 2560 flags.go:64] FLAG: --seccomp-default="false" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562697 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562699 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562702 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562705 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562708 2560 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562711 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562714 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562717 2560 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562720 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562723 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562727 2560 flags.go:64] FLAG: --system-cgroups="" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562730 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562737 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562740 2560 flags.go:64] FLAG: --tls-cert-file="" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562742 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562747 2560 flags.go:64] FLAG: --tls-min-version="" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562750 2560 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562753 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562755 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562758 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562762 2560 flags.go:64] FLAG: --v="2" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562765 2560 flags.go:64] FLAG: --version="false" Jul 28 15:13:47.570845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562770 2560 flags.go:64] FLAG: --vmodule="" Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562773 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.562776 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562890 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562894 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562897 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562899 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562902 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562904 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562907 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562910 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562913 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562916 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562918 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562920 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562923 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562925 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562928 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562931 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562933 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562938 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 15:13:47.571551 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562940 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 15:13:47.572088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562947 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 15:13:47.572088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562950 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 15:13:47.572088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562952 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 15:13:47.572088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562955 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 15:13:47.572088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562958 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 15:13:47.572088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562962 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 15:13:47.572088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562966 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 15:13:47.572088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562969 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 15:13:47.572088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562987 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 15:13:47.572088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562992 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 15:13:47.572088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.562996 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 15:13:47.572088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563001 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 15:13:47.572088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563005 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 15:13:47.572088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563009 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 15:13:47.572088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563012 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 15:13:47.572088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563015 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 15:13:47.572088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563017 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 15:13:47.572088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563020 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 15:13:47.572088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563022 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 15:13:47.572581 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563025 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 15:13:47.572581 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563028 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 15:13:47.572581 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563030 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 15:13:47.572581 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563033 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 15:13:47.572581 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563036 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 15:13:47.572581 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563039 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 15:13:47.572581 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563041 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 15:13:47.572581 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563044 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 15:13:47.572581 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563046 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 15:13:47.572581 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563049 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 15:13:47.572581 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563052 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 15:13:47.572581 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563056 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 15:13:47.572581 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563059 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 15:13:47.572581 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563062 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 15:13:47.572581 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563065 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 15:13:47.572581 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563067 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 15:13:47.572581 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563070 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 15:13:47.572581 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563072 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 15:13:47.572581 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563075 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 15:13:47.572581 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563078 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 15:13:47.573088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563080 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 15:13:47.573088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563083 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 15:13:47.573088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563087 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 15:13:47.573088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563090 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 15:13:47.573088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563093 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 15:13:47.573088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563097 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 15:13:47.573088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563099 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 15:13:47.573088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563102 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 15:13:47.573088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563105 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 15:13:47.573088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563107 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 15:13:47.573088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563110 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 15:13:47.573088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563112 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 15:13:47.573088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563115 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 15:13:47.573088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563119 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 15:13:47.573088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563122 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 15:13:47.573088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563125 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 15:13:47.573088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563128 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 15:13:47.573088 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563130 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 15:13:47.573521 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563133 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 15:13:47.573521 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563135 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 15:13:47.573521 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563139 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 15:13:47.573521 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563141 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 15:13:47.573521 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563144 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 15:13:47.573521 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563149 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 15:13:47.573521 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563152 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 15:13:47.573521 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563156 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 15:13:47.573521 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563158 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 15:13:47.573521 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563161 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 15:13:47.573521 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563164 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 15:13:47.573521 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563167 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 15:13:47.573521 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563170 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 15:13:47.573521 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563173 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 15:13:47.573521 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563176 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 15:13:47.573521 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563178 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 15:13:47.573521 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563181 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 15:13:47.573521 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563183 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 28 15:13:47.573521 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563186 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 15:13:47.573521 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563189 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 15:13:47.574017 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563192 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 15:13:47.574017 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563194 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 15:13:47.574017 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.563197 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 15:13:47.574017 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.563654 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 15:13:47.574017 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.569759 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 15:13:47.574017 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.569775 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 15:13:47.574017 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.570318 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 15:13:47.574017 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.570327 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 15:13:47.574017 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570385 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 15:13:47.574017 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570391 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 15:13:47.574017 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570395 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 15:13:47.574017 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570398 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 15:13:47.574017 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570400 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 15:13:47.574017 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570403 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 15:13:47.574017 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570406 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 15:13:47.574391 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570409 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 15:13:47.574391 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570411 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 15:13:47.574391 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570414 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 15:13:47.574391 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570416 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 15:13:47.574391 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570419 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 15:13:47.574391 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570422 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 15:13:47.574391 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570425 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 15:13:47.574391 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570428 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 15:13:47.574391 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570430 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 15:13:47.574391 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570433 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 15:13:47.574391 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570435 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 15:13:47.574391 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570438 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 15:13:47.574391 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570445 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 15:13:47.574391 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570449 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 15:13:47.574391 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570452 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 15:13:47.574391 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570456 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 15:13:47.574391 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570458 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 15:13:47.574391 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570461 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 15:13:47.574391 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570463 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 15:13:47.574391 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570466 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 15:13:47.574868 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570469 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 15:13:47.574868 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570471 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 15:13:47.574868 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570476 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 15:13:47.574868 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570479 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 15:13:47.574868 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570482 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 15:13:47.574868 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570484 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 15:13:47.574868 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570487 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 15:13:47.574868 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570489 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 15:13:47.574868 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570492 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 15:13:47.574868 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570496 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 15:13:47.574868 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570500 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 15:13:47.574868 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570503 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 15:13:47.574868 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570506 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 15:13:47.574868 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570508 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 15:13:47.574868 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570511 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 15:13:47.574868 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570514 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 28 15:13:47.574868 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570517 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 15:13:47.574868 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570519 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 15:13:47.574868 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570523 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 15:13:47.575339 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570526 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 15:13:47.575339 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570529 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 15:13:47.575339 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570531 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 15:13:47.575339 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570534 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 15:13:47.575339 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570536 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 15:13:47.575339 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570539 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 15:13:47.575339 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570541 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 15:13:47.575339 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570544 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 15:13:47.575339 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570546 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 15:13:47.575339 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570549 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 15:13:47.575339 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570551 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 15:13:47.575339 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570554 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 15:13:47.575339 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570556 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 15:13:47.575339 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570559 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 15:13:47.575339 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570562 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 15:13:47.575339 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570565 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 15:13:47.575339 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570569 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 15:13:47.575339 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570571 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 15:13:47.575339 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570574 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 15:13:47.575339 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570576 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 15:13:47.575810 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570579 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 15:13:47.575810 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570581 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 15:13:47.575810 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570584 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 15:13:47.575810 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570587 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 15:13:47.575810 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570589 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 15:13:47.575810 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570592 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 15:13:47.575810 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570594 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 15:13:47.575810 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570597 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 15:13:47.575810 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570600 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 15:13:47.575810 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570602 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 15:13:47.575810 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570605 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 15:13:47.575810 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570607 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 15:13:47.575810 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570610 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 15:13:47.575810 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570613 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 15:13:47.575810 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570615 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 15:13:47.575810 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570618 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 15:13:47.575810 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570621 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 15:13:47.575810 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570624 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 15:13:47.575810 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570626 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 15:13:47.575810 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570629 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 15:13:47.576303 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570631 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 15:13:47.576303 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570634 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 15:13:47.576303 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570636 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 15:13:47.576303 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570639 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 15:13:47.576303 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570641 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 15:13:47.576303 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570644 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 15:13:47.576303 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570648 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 15:13:47.576303 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570652 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 15:13:47.576303 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570655 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 15:13:47.576303 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570658 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 15:13:47.576303 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570662 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 15:13:47.576303 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570664 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 15:13:47.576303 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570667 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 15:13:47.576303 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.570672 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 15:13:47.576650 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570782 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 15:13:47.576650 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570787 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 15:13:47.576650 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570790 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 15:13:47.576650 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570793 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 15:13:47.576650 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570795 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 15:13:47.576650 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570798 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 15:13:47.576650 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570800 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 15:13:47.576650 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570803 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 15:13:47.576650 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570806 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 15:13:47.576650 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570808 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 15:13:47.576650 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570811 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 15:13:47.576650 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570814 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 28 15:13:47.576650 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570816 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 15:13:47.576650 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570819 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 15:13:47.576650 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570821 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 15:13:47.576650 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570824 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 15:13:47.576650 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570826 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 15:13:47.576650 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570829 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 15:13:47.576650 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570831 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 15:13:47.576650 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570834 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 15:13:47.577164 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570837 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 15:13:47.577164 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570839 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 15:13:47.577164 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570842 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 15:13:47.577164 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570844 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 15:13:47.577164 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570847 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 15:13:47.577164 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570849 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 15:13:47.577164 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570852 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 15:13:47.577164 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570855 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 15:13:47.577164 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570858 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 15:13:47.577164 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570861 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 15:13:47.577164 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570865 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 15:13:47.577164 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570867 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 15:13:47.577164 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570870 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 15:13:47.577164 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570872 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 15:13:47.577164 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570875 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 15:13:47.577164 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570877 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 15:13:47.577164 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570879 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 15:13:47.577164 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570882 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 15:13:47.577164 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570884 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 15:13:47.577164 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570887 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 15:13:47.577645 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570889 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 15:13:47.577645 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570891 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 15:13:47.577645 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570894 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 15:13:47.577645 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570897 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 15:13:47.577645 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570901 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 15:13:47.577645 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570904 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 15:13:47.577645 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570907 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 15:13:47.577645 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570909 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 15:13:47.577645 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570912 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 15:13:47.577645 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570914 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 15:13:47.577645 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570917 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 15:13:47.577645 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570920 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 15:13:47.577645 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570922 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 15:13:47.577645 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570925 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 15:13:47.577645 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570927 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 15:13:47.577645 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570930 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 15:13:47.577645 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570932 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 15:13:47.577645 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570934 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 15:13:47.577645 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570937 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 15:13:47.578122 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570940 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 15:13:47.578122 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570942 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 15:13:47.578122 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570945 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 15:13:47.578122 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570948 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 15:13:47.578122 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570950 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 15:13:47.578122 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570952 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 15:13:47.578122 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570955 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 15:13:47.578122 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570957 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 15:13:47.578122 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570960 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 15:13:47.578122 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570963 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 15:13:47.578122 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570965 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 15:13:47.578122 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570967 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 15:13:47.578122 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570970 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 15:13:47.578122 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570988 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 15:13:47.578122 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570992 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 15:13:47.578122 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570995 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 15:13:47.578122 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.570998 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 15:13:47.578122 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571001 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 15:13:47.578122 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571003 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 15:13:47.578122 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571006 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 15:13:47.578596 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571008 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 15:13:47.578596 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571011 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 15:13:47.578596 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571013 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 15:13:47.578596 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571016 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 15:13:47.578596 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571018 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 15:13:47.578596 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571021 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 15:13:47.578596 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571023 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 15:13:47.578596 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571026 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 15:13:47.578596 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571029 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 15:13:47.578596 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571031 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 15:13:47.578596 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571034 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 15:13:47.578596 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571036 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 15:13:47.578596 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571038 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 15:13:47.578596 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571041 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 15:13:47.578596 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571043 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 15:13:47.578596 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571047 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 15:13:47.578596 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571049 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 15:13:47.578596 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571052 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 15:13:47.578596 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571054 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 15:13:47.578596 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:47.571057 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 15:13:47.579081 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.571061 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 15:13:47.579081 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.571160 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 15:13:47.579081 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.572993 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 15:13:47.579081 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.574148 2560 server.go:1019] "Starting client certificate rotation" Jul 28 15:13:47.579081 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.574250 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 15:13:47.579081 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.574277 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 15:13:47.579081 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.576069 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 15:13:47.579781 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.579764 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 15:13:47.590079 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.590060 2560 log.go:25] "Validated CRI v1 runtime API" Jul 28 15:13:47.591986 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.591959 2560 log.go:25] "Validated CRI v1 image API" Jul 28 15:13:47.592771 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.592750 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 15:13:47.594597 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.594578 2560 fs.go:135] Filesystem UUIDs: map[058294e1-b7df-49ce-8fdb-f1ab0edd4a95:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 aa40d07a-3093-41e5-a581-ba8761f11f31:/dev/nvme0n1p3] Jul 28 15:13:47.594658 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.594595 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 15:13:47.599869 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.599738 2560 manager.go:216] Machine: {Timestamp:2026-07-28 15:13:47.598629663 +0000 UTC m=+0.253322825 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100049 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20d6ced518188f842c65ae5655b876 SystemUUID:ec20d6ce-d518-188f-842c-65ae5655b876 BootID:ba0bee43-0878-4bf2-9e11-3b2957acbac2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1a:8e:75:da:0d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1a:8e:75:da:0d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:45:91:29:c1:cd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 15:13:47.599869 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.599864 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 15:13:47.599991 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.599939 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 15:13:47.602149 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.602126 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 15:13:47.602284 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.602153 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-160.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 15:13:47.602727 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.602718 2560 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 15:13:47.602757 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.602729 2560 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 15:13:47.602757 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.602736 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 15:13:47.602757 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.602755 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 15:13:47.603474 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.603464 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 15:13:47.606169 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.606157 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 28 15:13:47.606298 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.606288 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 15:13:47.606330 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.606318 2560 kubelet.go:486] "Attempting to sync node with API server" Jul 28 15:13:47.606330 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.606327 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 15:13:47.606388 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.606338 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 15:13:47.606388 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.606346 2560 kubelet.go:398] "Adding apiserver pod source" Jul 28 15:13:47.606388 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.606354 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 15:13:47.606737 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.606723 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 15:13:47.606789 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.606747 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 15:13:47.608075 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.608058 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 15:13:47.608324 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.608304 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 15:13:47.610083 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.610070 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 15:13:47.610138 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.610100 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 15:13:47.611453 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.611437 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 15:13:47.611538 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.611459 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 15:13:47.611538 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.611468 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 15:13:47.611538 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.611473 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 15:13:47.611538 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.611481 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 15:13:47.611538 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.611486 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 15:13:47.611538 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.611493 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 15:13:47.611538 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.611499 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 15:13:47.611538 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.611506 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 15:13:47.611538 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.611511 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 15:13:47.611538 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.611520 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 15:13:47.611538 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.611525 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 15:13:47.612224 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.612209 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 15:13:47.612288 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.612226 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 15:13:47.616614 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.616597 2560 server.go:1268] "Started kubelet" Jul 28 15:13:47.616862 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.616827 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 15:13:47.616944 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.616878 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 15:13:47.617105 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.617081 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 15:13:47.617411 ip-10-0-138-160 systemd[1]: Started Kubernetes Kubelet. Jul 28 15:13:47.618354 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:47.618331 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 15:13:47.618354 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.618336 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-160.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 15:13:47.618474 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:47.618431 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 15:13:47.618692 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.618578 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 15:13:47.618901 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.618886 2560 server.go:310] "Adding debug handlers to kubelet server" Jul 28 15:13:47.621098 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:47.621079 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 15:13:47.625554 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:47.624831 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-160.ec2.internal.18c67ce58ac5ff52 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-160.ec2.internal,UID:ip-10-0-138-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-160.ec2.internal,},FirstTimestamp:2026-07-28 15:13:47.616567122 +0000 UTC m=+0.271260283,LastTimestamp:2026-07-28 15:13:47.616567122 +0000 UTC m=+0.271260283,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-160.ec2.internal,}" Jul 28 15:13:47.626530 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.626512 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 15:13:47.626530 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.626524 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 15:13:47.626702 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:47.626687 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found" Jul 28 15:13:47.627012 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.626996 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 15:13:47.627087 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.627048 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 15:13:47.627087 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.627064 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 15:13:47.627184 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.627169 2560 reconstruct.go:97] "Volume reconstruction finished" Jul 28 15:13:47.627184 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.627175 2560 reconciler.go:29] "Reconciler: start to sync state" Jul 28 15:13:47.627873 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.627798 2560 factory.go:55] Registering systemd factory Jul 28 15:13:47.627873 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.627837 2560 factory.go:223] Registration of the systemd container factory successfully Jul 28 15:13:47.628250 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.628094 2560 factory.go:153] Registering CRI-O factory Jul 28 15:13:47.628250 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.628108 2560 factory.go:223] Registration of the crio container factory successfully Jul 28 15:13:47.628250 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.628178 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 15:13:47.628250 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.628201 2560 factory.go:103] Registering Raw factory Jul 28 15:13:47.628250 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.628216 2560 manager.go:1196] Started watching for new ooms in manager Jul 28 15:13:47.628574 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.628559 2560 manager.go:349] Starting recovery of all containers Jul 28 15:13:47.629774 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:47.629749 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 15:13:47.629856 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:47.629826 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 15:13:47.639556 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.639424 2560 manager.go:354] Recovery completed Jul 28 15:13:47.646026 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.646005 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 15:13:47.647935 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.647912 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory" Jul 28 15:13:47.648031 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.647953 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 15:13:47.648031 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.647970 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID" Jul 28 15:13:47.648518 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.648503 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 15:13:47.648518 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.648518 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 15:13:47.648615 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.648522 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 15:13:47.648615 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.648537 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 28 15:13:47.649488 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.649474 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory" Jul 28 15:13:47.649550 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.649499 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 15:13:47.649550 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.649508 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID" Jul 28 15:13:47.650364 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:47.650301 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-160.ec2.internal.18c67ce58ca4a3d1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-160.ec2.internal,UID:ip-10-0-138-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-160.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-160.ec2.internal,},FirstTimestamp:2026-07-28 15:13:47.647935441 +0000 UTC m=+0.302628610,LastTimestamp:2026-07-28 15:13:47.647935441 +0000 UTC m=+0.302628610,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-160.ec2.internal,}" Jul 28 15:13:47.651147 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.651135 2560 policy_none.go:49] "None policy: Start" Jul 28 15:13:47.651183 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.651151 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 15:13:47.651183 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.651161 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 15:13:47.653163 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.653151 2560 policy_none.go:47] "Start" Jul 28 15:13:47.661554 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:47.661400 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-160.ec2.internal.18c67ce58ca5087f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-160.ec2.internal,UID:ip-10-0-138-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-160.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-160.ec2.internal,},FirstTimestamp:2026-07-28 15:13:47.647961215 +0000 UTC m=+0.302654379,LastTimestamp:2026-07-28 15:13:47.647961215 +0000 UTC m=+0.302654379,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-160.ec2.internal,}" Jul 28 15:13:47.668062 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.668044 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4wpzm" Jul 28 15:13:47.675015 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.674999 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4wpzm" Jul 28 15:13:47.675663 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:47.675594 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-160.ec2.internal.18c67ce58ca57828 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-160.ec2.internal,UID:ip-10-0-138-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-160.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-160.ec2.internal,},FirstTimestamp:2026-07-28 15:13:47.6479898 +0000 UTC m=+0.302682964,LastTimestamp:2026-07-28 15:13:47.6479898 +0000 UTC m=+0.302682964,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-160.ec2.internal,}" Jul 28 15:13:47.681524 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.681507 2560 manager.go:337] "Starting Device Plugin manager" Jul 28 15:13:47.681599 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:47.681553 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 15:13:47.681599 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.681566 2560 server.go:87] "Starting device plugin registration server" Jul 28 15:13:47.681811 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.681799 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 15:13:47.681849 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.681814 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 15:13:47.681909 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.681895 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 15:13:47.681999 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.681985 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 15:13:47.681999 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.681999 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 15:13:47.682485 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:47.682465 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 15:13:47.682561 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:47.682522 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-160.ec2.internal\" not found" Jul 28 15:13:47.721456 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.721433 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 15:13:47.730557 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.722610 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 15:13:47.730557 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.722642 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 15:13:47.730557 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.722684 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 15:13:47.730557 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:47.722714 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 15:13:47.730557 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.725439 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 15:13:47.782907 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.782882 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 15:13:47.783716 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.783700 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory" Jul 28 15:13:47.783804 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.783734 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 15:13:47.783804 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.783750 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID" Jul 28 15:13:47.783804 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.783778 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-160.ec2.internal" Jul 28 15:13:47.793743 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.793730 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-160.ec2.internal" Jul 28 15:13:47.793825 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:47.793750 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-160.ec2.internal\": node \"ip-10-0-138-160.ec2.internal\" not found" Jul 28 15:13:47.823587 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.823529 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal"] Jul 28 15:13:47.823587 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.823581 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 15:13:47.824823 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.824806 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory" Jul 28 15:13:47.824899 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.824840 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 15:13:47.824899 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.824852 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID" Jul 28 15:13:47.827100 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.827087 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 15:13:47.827215 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.827199 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" Jul 28 15:13:47.827271 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.827234 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 15:13:47.827722 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.827708 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory" Jul 28 15:13:47.827780 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.827727 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 15:13:47.827780 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.827736 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID" Jul 28 15:13:47.827896 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.827781 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b0c4fecc896bbcc6b46383f7742a473d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal\" (UID: \"b0c4fecc896bbcc6b46383f7742a473d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" Jul 28 15:13:47.827896 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.827802 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0c4fecc896bbcc6b46383f7742a473d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal\" (UID: \"b0c4fecc896bbcc6b46383f7742a473d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" Jul 28 15:13:47.827896 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.827835 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2d22f8252294a8bfd817cb3f869635a2-config\") pod \"kube-apiserver-proxy-ip-10-0-138-160.ec2.internal\" (UID: \"2d22f8252294a8bfd817cb3f869635a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" Jul 28 15:13:47.828175 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.828161 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory" Jul 28 15:13:47.828236 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.828189 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 15:13:47.828236 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.828199 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID" Jul 28 15:13:47.830378 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.830363 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" Jul 28 15:13:47.830452 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.830393 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 15:13:47.831045 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.831028 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory" Jul 28 15:13:47.831125 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.831089 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 15:13:47.831125 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.831107 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID" Jul 28 15:13:47.840121 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:47.840099 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found" Jul 28 15:13:47.858565 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:47.858546 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-160.ec2.internal\" not found" node="ip-10-0-138-160.ec2.internal" Jul 28 15:13:47.862786 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:47.862773 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-160.ec2.internal\" not found" node="ip-10-0-138-160.ec2.internal" Jul 28 15:13:47.928413 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.928393 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b0c4fecc896bbcc6b46383f7742a473d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal\" (UID: \"b0c4fecc896bbcc6b46383f7742a473d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" Jul 28 15:13:47.928481 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.928422 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0c4fecc896bbcc6b46383f7742a473d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal\" (UID: \"b0c4fecc896bbcc6b46383f7742a473d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" Jul 28 15:13:47.928481 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.928445 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2d22f8252294a8bfd817cb3f869635a2-config\") pod \"kube-apiserver-proxy-ip-10-0-138-160.ec2.internal\" (UID: \"2d22f8252294a8bfd817cb3f869635a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" Jul 28 15:13:47.928546 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.928491 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b0c4fecc896bbcc6b46383f7742a473d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal\" (UID: \"b0c4fecc896bbcc6b46383f7742a473d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" Jul 28 15:13:47.928546 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.928492 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2d22f8252294a8bfd817cb3f869635a2-config\") pod \"kube-apiserver-proxy-ip-10-0-138-160.ec2.internal\" (UID: \"2d22f8252294a8bfd817cb3f869635a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" Jul 28 15:13:47.928546 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:47.928500 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0c4fecc896bbcc6b46383f7742a473d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal\" (UID: \"b0c4fecc896bbcc6b46383f7742a473d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" Jul 28 15:13:47.940480 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:47.940462 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found" Jul 28 15:13:48.041382 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:48.041357 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found" Jul 28 15:13:48.142200 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:48.142139 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found" Jul 28 15:13:48.161322 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:48.161305 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" Jul 28 15:13:48.166075 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:48.165961 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" Jul 28 15:13:48.243227 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:48.243198 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found" Jul 28 15:13:48.343998 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:48.343951 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found" Jul 28 15:13:48.445041 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:48.445016 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found" Jul 28 15:13:48.445440 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:48.445423 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 15:13:48.545780 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:48.545750 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found" Jul 28 15:13:48.574359 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:48.574336 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 15:13:48.574759 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:48.574474 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 15:13:48.574759 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:48.574527 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 15:13:48.645951 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:48.645856 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found" Jul 28 15:13:48.680218 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:48.680181 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 15:08:48 +0000 UTC" deadline="2028-04-04 21:34:35.92996424 +0000 UTC" Jul 28 15:13:48.680218 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:48.680217 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14790h20m47.249752398s" Jul 28 15:13:48.708599 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:48.708543 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 15:13:48.727785 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:48.727764 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" Jul 28 15:13:48.745235 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:48.745217 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 15:13:48.746001 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:48.745988 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" Jul 28 15:13:48.758157 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:48.758136 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 15:13:48.769326 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:48.769308 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 15:13:48.775847 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:48.775823 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d22f8252294a8bfd817cb3f869635a2.slice/crio-f34e5f2d4b338a903c8efd1d45b8173824bf72dd294dbde02b014701c81afc1c WatchSource:0}: Error finding container f34e5f2d4b338a903c8efd1d45b8173824bf72dd294dbde02b014701c81afc1c: Status 404 returned error can't find the container with id f34e5f2d4b338a903c8efd1d45b8173824bf72dd294dbde02b014701c81afc1c Jul 28 15:13:48.780431 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:48.780416 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 15:13:49.277975 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:49.277949 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c4fecc896bbcc6b46383f7742a473d.slice/crio-bf3dc89da5f69dcc00058c98ebd7f39eaa2b6d2a39eb04a9db9081c739c1fd89 WatchSource:0}: Error finding container bf3dc89da5f69dcc00058c98ebd7f39eaa2b6d2a39eb04a9db9081c739c1fd89: Status 404 returned error can't find the container with id bf3dc89da5f69dcc00058c98ebd7f39eaa2b6d2a39eb04a9db9081c739c1fd89 Jul 28 15:13:49.518143 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.518116 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 15:13:49.608693 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.608609 2560 apiserver.go:52] "Watching apiserver" Jul 28 15:13:49.617408 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.617385 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 15:13:49.618415 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.618391 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5","openshift-cluster-node-tuning-operator/tuned-cpt4r","openshift-image-registry/node-ca-6l2z9","openshift-multus/multus-additional-cni-plugins-qxdtr","openshift-multus/multus-z5p5z","openshift-network-diagnostics/network-check-target-vdlwj","openshift-network-operator/iptables-alerter-bqw8j","kube-system/global-pull-secret-syncer-xvxzd","kube-system/konnectivity-agent-t65bv","openshift-dns/node-resolver-mwv8g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal","openshift-multus/network-metrics-daemon-hlzj8","openshift-ovn-kubernetes/ovnkube-node-5vlpq"] Jul 28 15:13:49.621212 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.621197 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:13:49.621302 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:49.621282 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdlwj" podUID="aeecf212-beb1-4ab4-acd6-5ae64fbb4416" Jul 28 15:13:49.623334 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.623320 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:13:49.623382 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:49.623369 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hlzj8" podUID="4341eeac-de67-4bab-81c8-d2f8c62c677c" Jul 28 15:13:49.625719 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.625697 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.627308 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.627287 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 15:13:49.628006 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.627974 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6l2z9" Jul 28 15:13:49.628581 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.628563 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 15:13:49.628669 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.628628 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 15:13:49.628717 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.628677 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d6zhh\"" Jul 28 15:13:49.630484 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.630466 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.630572 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.630470 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-542qq\"" Jul 28 15:13:49.631420 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.631401 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 15:13:49.631516 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.631401 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 15:13:49.631516 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.631446 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 15:13:49.633065 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.633031 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.633259 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.633239 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 15:13:49.633351 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.633239 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nl2fs\"" Jul 28 15:13:49.634143 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.634118 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 15:13:49.634259 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.634240 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 15:13:49.634325 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.634244 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 15:13:49.634597 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.634581 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 15:13:49.635499 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.635485 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:13:49.635586 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:49.635566 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvxzd" podUID="54dd096b-0a03-4d8c-b288-ec52295ad7fd" Jul 28 15:13:49.635781 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.635769 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lds27\"" Jul 28 15:13:49.636094 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.636078 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 15:13:49.637860 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.637839 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjvnt\" (UniqueName: \"kubernetes.io/projected/4341eeac-de67-4bab-81c8-d2f8c62c677c-kube-api-access-bjvnt\") pod \"network-metrics-daemon-hlzj8\" (UID: \"4341eeac-de67-4bab-81c8-d2f8c62c677c\") " pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:13:49.637975 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.637866 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-etc-sysconfig\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.637975 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.637883 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-sys\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.637975 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.637898 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-var-lib-kubelet\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.638207 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.638077 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.638577 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.638430 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/795606e4-370a-41cf-a5ad-6c181a984efa-etc-tuned\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.638577 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.638468 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/795606e4-370a-41cf-a5ad-6c181a984efa-tmp\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.638577 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.638499 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqxtw\" (UniqueName: \"kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw\") pod \"network-check-target-vdlwj\" (UID: \"aeecf212-beb1-4ab4-acd6-5ae64fbb4416\") " pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:13:49.638577 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.638516 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-etc-kubernetes\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.638577 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.638531 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-etc-systemd\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.638577 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.638552 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhrw5\" (UniqueName: \"kubernetes.io/projected/795606e4-370a-41cf-a5ad-6c181a984efa-kube-api-access-xhrw5\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.638577 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.638581 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eea28fce-a95a-42f4-acbb-99526480c2d0-serviceca\") pod \"node-ca-6l2z9\" (UID: \"eea28fce-a95a-42f4-acbb-99526480c2d0\") " pod="openshift-image-registry/node-ca-6l2z9" Jul 28 15:13:49.638952 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.638597 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-etc-sysctl-d\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.638952 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.638633 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-run\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.638952 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.638667 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-host\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.638952 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.638713 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eea28fce-a95a-42f4-acbb-99526480c2d0-host\") pod \"node-ca-6l2z9\" (UID: \"eea28fce-a95a-42f4-acbb-99526480c2d0\") " pod="openshift-image-registry/node-ca-6l2z9" Jul 28 15:13:49.638952 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.638759 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvwj5\" (UniqueName: \"kubernetes.io/projected/eea28fce-a95a-42f4-acbb-99526480c2d0-kube-api-access-cvwj5\") pod \"node-ca-6l2z9\" (UID: \"eea28fce-a95a-42f4-acbb-99526480c2d0\") " pod="openshift-image-registry/node-ca-6l2z9" Jul 28 15:13:49.638952 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.638800 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs\") pod \"network-metrics-daemon-hlzj8\" (UID: \"4341eeac-de67-4bab-81c8-d2f8c62c677c\") " pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:13:49.638952 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.638829 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-etc-modprobe-d\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.638952 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.638893 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-etc-sysctl-conf\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.638952 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.638947 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-lib-modules\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.640858 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.640842 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 15:13:49.640925 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.640876 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 15:13:49.641267 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.641247 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 15:13:49.642361 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.642338 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rjmkc\"" Jul 28 15:13:49.642461 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.642409 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.642461 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.642437 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 15:13:49.644101 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.642994 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 15:13:49.644101 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.643738 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 15:13:49.646068 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.646041 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t65bv" Jul 28 15:13:49.646272 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.646226 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 15:13:49.646466 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.646451 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pt8rh\"" Jul 28 15:13:49.647230 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.647210 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 15:13:49.647384 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.647359 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 15:13:49.648635 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.648620 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mwv8g" Jul 28 15:13:49.649312 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.649297 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 15:13:49.649486 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.649471 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lh87s\"" Jul 28 15:13:49.650104 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.650088 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 15:13:49.650941 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.650926 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bqw8j" Jul 28 15:13:49.651580 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.651558 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 15:13:49.651696 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.651649 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 15:13:49.651696 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.651685 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p6p5k\"" Jul 28 15:13:49.654337 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.654319 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 15:13:49.654439 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.654416 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 15:13:49.654658 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.654644 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 15:13:49.654993 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.654974 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 15:13:49.655546 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.655525 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-djp4z\"" Jul 28 15:13:49.680838 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.680823 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pj25k" Jul 28 15:13:49.690816 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.690800 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pj25k" Jul 28 15:13:49.727752 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.727701 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" event={"ID":"b0c4fecc896bbcc6b46383f7742a473d","Type":"ContainerStarted","Data":"bf3dc89da5f69dcc00058c98ebd7f39eaa2b6d2a39eb04a9db9081c739c1fd89"} Jul 28 15:13:49.727935 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.727919 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 15:13:49.729031 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.729007 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" event={"ID":"2d22f8252294a8bfd817cb3f869635a2","Type":"ContainerStarted","Data":"f34e5f2d4b338a903c8efd1d45b8173824bf72dd294dbde02b014701c81afc1c"} Jul 28 15:13:49.739330 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739307 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvwj5\" (UniqueName: \"kubernetes.io/projected/eea28fce-a95a-42f4-acbb-99526480c2d0-kube-api-access-cvwj5\") pod \"node-ca-6l2z9\" (UID: \"eea28fce-a95a-42f4-acbb-99526480c2d0\") " pod="openshift-image-registry/node-ca-6l2z9" Jul 28 15:13:49.739410 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739348 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-multus-socket-dir-parent\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.739410 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739376 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-multus-daemon-config\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.739410 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739402 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.739566 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739449 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-ovnkube-script-lib\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.739566 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739487 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2974bc55-eff2-4e8a-bfd5-2faf993075a7-socket-dir\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.739566 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739520 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-etc-modprobe-d\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.739566 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-etc-sysctl-conf\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.739753 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739572 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-host-run-netns\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.739753 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739599 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-run-ovn\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.739753 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739625 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-system-cni-dir\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.739753 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739670 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-slash\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.739753 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739706 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-etc-modprobe-d\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.739753 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739704 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-log-socket\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.740061 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739752 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/263c477a-d08f-4956-9c46-10365000b10a-cni-binary-copy\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.740061 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739792 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckqfv\" (UniqueName: \"kubernetes.io/projected/263c477a-d08f-4956-9c46-10365000b10a-kube-api-access-ckqfv\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.740061 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739818 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-etc-sysctl-conf\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.740061 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739826 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ede988c-a5e0-4257-98a3-decea1014639-konnectivity-ca\") pod \"konnectivity-agent-t65bv\" (UID: \"5ede988c-a5e0-4257-98a3-decea1014639\") " pod="kube-system/konnectivity-agent-t65bv" Jul 28 15:13:49.740061 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739855 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6qnm\" (UniqueName: \"kubernetes.io/projected/2228d284-b2b5-4711-955e-e2763f4a817c-kube-api-access-l6qnm\") pod \"iptables-alerter-bqw8j\" (UID: \"2228d284-b2b5-4711-955e-e2763f4a817c\") " pod="openshift-network-operator/iptables-alerter-bqw8j" Jul 28 15:13:49.740061 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739884 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-etc-kubernetes\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.740061 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739915 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-host-var-lib-cni-multus\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.740061 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739933 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-run-systemd\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.740061 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739968 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-ovnkube-config\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.740061 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.739997 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-etc-kubernetes\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.740061 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740015 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-ovn-node-metrics-cert\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.740061 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740043 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-host-run-k8s-cni-cncf-io\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.740655 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740082 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54dd096b-0a03-4d8c-b288-ec52295ad7fd-dbus\") pod \"global-pull-secret-syncer-xvxzd\" (UID: \"54dd096b-0a03-4d8c-b288-ec52295ad7fd\") " pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:13:49.740655 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740124 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/263c477a-d08f-4956-9c46-10365000b10a-cnibin\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.740655 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740160 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2974bc55-eff2-4e8a-bfd5-2faf993075a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.740655 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740200 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-kubelet\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.740655 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740240 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-systemd-units\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.740655 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740267 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-node-log\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.740655 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740292 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01dca34b-58ab-41e7-8b93-9fc4558afda8-tmp-dir\") pod \"node-resolver-mwv8g\" (UID: \"01dca34b-58ab-41e7-8b93-9fc4558afda8\") " pod="openshift-dns/node-resolver-mwv8g" Jul 28 15:13:49.740655 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740321 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/263c477a-d08f-4956-9c46-10365000b10a-os-release\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.740655 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740354 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-var-lib-kubelet\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.740655 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740383 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-hostroot\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.740655 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740411 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-host-run-multus-certs\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.740655 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740443 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2974bc55-eff2-4e8a-bfd5-2faf993075a7-registration-dir\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.740655 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740461 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-var-lib-kubelet\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.740655 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740481 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2228d284-b2b5-4711-955e-e2763f4a817c-iptables-alerter-script\") pod \"iptables-alerter-bqw8j\" (UID: \"2228d284-b2b5-4711-955e-e2763f4a817c\") " pod="openshift-network-operator/iptables-alerter-bqw8j" Jul 28 15:13:49.740655 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740520 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqxtw\" (UniqueName: \"kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw\") pod \"network-check-target-vdlwj\" (UID: \"aeecf212-beb1-4ab4-acd6-5ae64fbb4416\") " pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:13:49.740655 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740565 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-run-netns\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.741489 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740595 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/263c477a-d08f-4956-9c46-10365000b10a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.741489 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740623 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/263c477a-d08f-4956-9c46-10365000b10a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.741489 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740653 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-etc-sysctl-d\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.741489 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740691 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-host\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.741489 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740738 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-os-release\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.741489 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740765 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-cni-binary-copy\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.741489 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740782 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-etc-kubernetes\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.741489 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740795 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-etc-sysctl-d\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.741489 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740803 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-host\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.741489 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740797 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgxrc\" (UniqueName: \"kubernetes.io/projected/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-kube-api-access-zgxrc\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.741489 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740843 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-lib-modules\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.741489 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740873 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-cni-bin\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.741489 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740900 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/263c477a-d08f-4956-9c46-10365000b10a-system-cni-dir\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.741489 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740948 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-sys\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.741489 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740976 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/795606e4-370a-41cf-a5ad-6c181a984efa-etc-tuned\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.741489 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.740978 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-lib-modules\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.741489 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741001 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/795606e4-370a-41cf-a5ad-6c181a984efa-tmp\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.742220 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741041 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-sys\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.742220 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741043 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-cnibin\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.742220 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741089 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-cni-netd\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.742220 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741116 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ede988c-a5e0-4257-98a3-decea1014639-agent-certs\") pod \"konnectivity-agent-t65bv\" (UID: \"5ede988c-a5e0-4257-98a3-decea1014639\") " pod="kube-system/konnectivity-agent-t65bv" Jul 28 15:13:49.742220 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741142 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-etc-systemd\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.742220 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741167 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhrw5\" (UniqueName: \"kubernetes.io/projected/795606e4-370a-41cf-a5ad-6c181a984efa-kube-api-access-xhrw5\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.742220 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741199 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-multus-cni-dir\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.742220 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741225 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-multus-conf-dir\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.742220 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741258 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-etc-systemd\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.742220 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741269 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54dd096b-0a03-4d8c-b288-ec52295ad7fd-kubelet-config\") pod \"global-pull-secret-syncer-xvxzd\" (UID: \"54dd096b-0a03-4d8c-b288-ec52295ad7fd\") " pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:13:49.742220 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741301 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-run-openvswitch\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.742220 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741334 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-run-ovn-kubernetes\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.742220 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741341 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 15:13:49.742220 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741361 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eea28fce-a95a-42f4-acbb-99526480c2d0-host\") pod \"node-ca-6l2z9\" (UID: \"eea28fce-a95a-42f4-acbb-99526480c2d0\") " pod="openshift-image-registry/node-ca-6l2z9" Jul 28 15:13:49.742220 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741384 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-host-var-lib-cni-bin\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.742220 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741401 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-env-overrides\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.742220 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741418 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/263c477a-d08f-4956-9c46-10365000b10a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.742938 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741441 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2974bc55-eff2-4e8a-bfd5-2faf993075a7-device-dir\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.742938 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741461 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plh6r\" (UniqueName: \"kubernetes.io/projected/2974bc55-eff2-4e8a-bfd5-2faf993075a7-kube-api-access-plh6r\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.742938 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741466 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eea28fce-a95a-42f4-acbb-99526480c2d0-host\") pod \"node-ca-6l2z9\" (UID: \"eea28fce-a95a-42f4-acbb-99526480c2d0\") " pod="openshift-image-registry/node-ca-6l2z9" Jul 28 15:13:49.742938 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741479 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs\") pod \"network-metrics-daemon-hlzj8\" (UID: \"4341eeac-de67-4bab-81c8-d2f8c62c677c\") " pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:13:49.742938 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741496 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret\") pod \"global-pull-secret-syncer-xvxzd\" (UID: \"54dd096b-0a03-4d8c-b288-ec52295ad7fd\") " pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:13:49.742938 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741522 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r526k\" (UniqueName: \"kubernetes.io/projected/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-kube-api-access-r526k\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.742938 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741549 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2974bc55-eff2-4e8a-bfd5-2faf993075a7-sys-fs\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.742938 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741575 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjvnt\" (UniqueName: \"kubernetes.io/projected/4341eeac-de67-4bab-81c8-d2f8c62c677c-kube-api-access-bjvnt\") pod \"network-metrics-daemon-hlzj8\" (UID: \"4341eeac-de67-4bab-81c8-d2f8c62c677c\") " pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:13:49.742938 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:49.741598 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:13:49.742938 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741600 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-etc-sysconfig\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.742938 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741651 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-etc-sysconfig\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.742938 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:49.741685 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs podName:4341eeac-de67-4bab-81c8-d2f8c62c677c nodeName:}" failed. No retries permitted until 2026-07-28 15:13:50.241643747 +0000 UTC m=+2.896336912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs") pod "network-metrics-daemon-hlzj8" (UID: "4341eeac-de67-4bab-81c8-d2f8c62c677c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:13:49.742938 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741721 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-host-var-lib-kubelet\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.742938 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741747 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/01dca34b-58ab-41e7-8b93-9fc4558afda8-hosts-file\") pod \"node-resolver-mwv8g\" (UID: \"01dca34b-58ab-41e7-8b93-9fc4558afda8\") " pod="openshift-dns/node-resolver-mwv8g" Jul 28 15:13:49.742938 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741773 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2974bc55-eff2-4e8a-bfd5-2faf993075a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.742938 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741801 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eea28fce-a95a-42f4-acbb-99526480c2d0-serviceca\") pod \"node-ca-6l2z9\" (UID: \"eea28fce-a95a-42f4-acbb-99526480c2d0\") " pod="openshift-image-registry/node-ca-6l2z9" Jul 28 15:13:49.743546 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741827 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-var-lib-openvswitch\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.743546 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741856 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-etc-openvswitch\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.743546 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741917 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txpdm\" (UniqueName: \"kubernetes.io/projected/01dca34b-58ab-41e7-8b93-9fc4558afda8-kube-api-access-txpdm\") pod \"node-resolver-mwv8g\" (UID: \"01dca34b-58ab-41e7-8b93-9fc4558afda8\") " pod="openshift-dns/node-resolver-mwv8g" Jul 28 15:13:49.743546 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.741964 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2228d284-b2b5-4711-955e-e2763f4a817c-host-slash\") pod \"iptables-alerter-bqw8j\" (UID: \"2228d284-b2b5-4711-955e-e2763f4a817c\") " pod="openshift-network-operator/iptables-alerter-bqw8j" Jul 28 15:13:49.743546 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.742011 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-run\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.743546 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.742278 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eea28fce-a95a-42f4-acbb-99526480c2d0-serviceca\") pod \"node-ca-6l2z9\" (UID: \"eea28fce-a95a-42f4-acbb-99526480c2d0\") " pod="openshift-image-registry/node-ca-6l2z9" Jul 28 15:13:49.743546 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.742313 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/795606e4-370a-41cf-a5ad-6c181a984efa-run\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.745165 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.745097 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/795606e4-370a-41cf-a5ad-6c181a984efa-etc-tuned\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.745264 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.745165 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/795606e4-370a-41cf-a5ad-6c181a984efa-tmp\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.757367 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:49.757342 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 15:13:49.757474 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:49.757373 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 15:13:49.757474 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:49.757389 2560 projected.go:196] Error preparing data for projected volume kube-api-access-rqxtw for pod openshift-network-diagnostics/network-check-target-vdlwj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:13:49.757474 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:49.757458 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw podName:aeecf212-beb1-4ab4-acd6-5ae64fbb4416 nodeName:}" failed. No retries permitted until 2026-07-28 15:13:50.25743711 +0000 UTC m=+2.912130284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rqxtw" (UniqueName: "kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw") pod "network-check-target-vdlwj" (UID: "aeecf212-beb1-4ab4-acd6-5ae64fbb4416") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:13:49.758794 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.758756 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvwj5\" (UniqueName: \"kubernetes.io/projected/eea28fce-a95a-42f4-acbb-99526480c2d0-kube-api-access-cvwj5\") pod \"node-ca-6l2z9\" (UID: \"eea28fce-a95a-42f4-acbb-99526480c2d0\") " pod="openshift-image-registry/node-ca-6l2z9" Jul 28 15:13:49.759896 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.759873 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjvnt\" (UniqueName: \"kubernetes.io/projected/4341eeac-de67-4bab-81c8-d2f8c62c677c-kube-api-access-bjvnt\") pod \"network-metrics-daemon-hlzj8\" (UID: \"4341eeac-de67-4bab-81c8-d2f8c62c677c\") " pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:13:49.760020 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.759974 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhrw5\" (UniqueName: \"kubernetes.io/projected/795606e4-370a-41cf-a5ad-6c181a984efa-kube-api-access-xhrw5\") pod \"tuned-cpt4r\" (UID: \"795606e4-370a-41cf-a5ad-6c181a984efa\") " pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.842671 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.842634 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-hostroot\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.842845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.842684 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-host-run-multus-certs\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.842845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.842715 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2974bc55-eff2-4e8a-bfd5-2faf993075a7-registration-dir\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.842845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.842744 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2228d284-b2b5-4711-955e-e2763f4a817c-iptables-alerter-script\") pod \"iptables-alerter-bqw8j\" (UID: \"2228d284-b2b5-4711-955e-e2763f4a817c\") " pod="openshift-network-operator/iptables-alerter-bqw8j" Jul 28 15:13:49.842845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.842764 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-hostroot\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.842845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.842787 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-run-netns\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.842845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.842819 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/263c477a-d08f-4956-9c46-10365000b10a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.843254 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.842849 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/263c477a-d08f-4956-9c46-10365000b10a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.843254 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.842785 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-host-run-multus-certs\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.843254 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.842881 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-os-release\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.843254 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.842888 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-run-netns\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.843254 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.842907 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-cni-binary-copy\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.843254 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.842935 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-etc-kubernetes\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.843254 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.842962 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgxrc\" (UniqueName: \"kubernetes.io/projected/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-kube-api-access-zgxrc\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.843254 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.842991 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-cni-bin\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.843254 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843035 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/263c477a-d08f-4956-9c46-10365000b10a-system-cni-dir\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.843254 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843066 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-cnibin\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.843254 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843127 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/263c477a-d08f-4956-9c46-10365000b10a-system-cni-dir\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.843254 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843125 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-etc-kubernetes\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.843714 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843407 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-cni-netd\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.843714 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843441 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ede988c-a5e0-4257-98a3-decea1014639-agent-certs\") pod \"konnectivity-agent-t65bv\" (UID: \"5ede988c-a5e0-4257-98a3-decea1014639\") " pod="kube-system/konnectivity-agent-t65bv" Jul 28 15:13:49.843714 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843471 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-multus-cni-dir\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.843714 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843495 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-multus-conf-dir\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.843714 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843521 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54dd096b-0a03-4d8c-b288-ec52295ad7fd-kubelet-config\") pod \"global-pull-secret-syncer-xvxzd\" (UID: \"54dd096b-0a03-4d8c-b288-ec52295ad7fd\") " pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:13:49.843714 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843546 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-run-openvswitch\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.843714 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843559 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2228d284-b2b5-4711-955e-e2763f4a817c-iptables-alerter-script\") pod \"iptables-alerter-bqw8j\" (UID: \"2228d284-b2b5-4711-955e-e2763f4a817c\") " pod="openshift-network-operator/iptables-alerter-bqw8j" Jul 28 15:13:49.843714 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843577 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-run-ovn-kubernetes\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.843714 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843559 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/263c477a-d08f-4956-9c46-10365000b10a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.843714 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843579 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/263c477a-d08f-4956-9c46-10365000b10a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.843714 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843604 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-host-var-lib-cni-bin\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.843714 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843628 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-env-overrides\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.843714 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843643 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-cni-bin\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.843714 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843651 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/263c477a-d08f-4956-9c46-10365000b10a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.843714 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.842850 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2974bc55-eff2-4e8a-bfd5-2faf993075a7-registration-dir\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.843714 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843675 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2974bc55-eff2-4e8a-bfd5-2faf993075a7-device-dir\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.843714 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843701 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plh6r\" (UniqueName: \"kubernetes.io/projected/2974bc55-eff2-4e8a-bfd5-2faf993075a7-kube-api-access-plh6r\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.844225 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843725 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-os-release\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.844225 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843745 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-cnibin\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.844225 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843744 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret\") pod \"global-pull-secret-syncer-xvxzd\" (UID: \"54dd096b-0a03-4d8c-b288-ec52295ad7fd\") " pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:13:49.844225 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843776 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-host-var-lib-cni-bin\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.844225 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843784 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-multus-conf-dir\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.844225 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843793 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r526k\" (UniqueName: \"kubernetes.io/projected/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-kube-api-access-r526k\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.844225 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843815 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-cni-binary-copy\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.844225 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843830 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-run-openvswitch\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.844225 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:49.843824 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 15:13:49.844225 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843864 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2974bc55-eff2-4e8a-bfd5-2faf993075a7-sys-fs\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.844225 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843822 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2974bc55-eff2-4e8a-bfd5-2faf993075a7-sys-fs\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.844225 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843880 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2974bc55-eff2-4e8a-bfd5-2faf993075a7-device-dir\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.844225 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:49.843898 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret podName:54dd096b-0a03-4d8c-b288-ec52295ad7fd nodeName:}" failed. No retries permitted until 2026-07-28 15:13:50.343882013 +0000 UTC m=+2.998575172 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret") pod "global-pull-secret-syncer-xvxzd" (UID: "54dd096b-0a03-4d8c-b288-ec52295ad7fd") : object "kube-system"/"original-pull-secret" not registered Jul 28 15:13:49.844225 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843830 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54dd096b-0a03-4d8c-b288-ec52295ad7fd-kubelet-config\") pod \"global-pull-secret-syncer-xvxzd\" (UID: \"54dd096b-0a03-4d8c-b288-ec52295ad7fd\") " pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:13:49.844225 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843700 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-multus-cni-dir\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.844225 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843913 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-cni-netd\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.844225 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843952 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-host-var-lib-kubelet\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.845066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.843978 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/01dca34b-58ab-41e7-8b93-9fc4558afda8-hosts-file\") pod \"node-resolver-mwv8g\" (UID: \"01dca34b-58ab-41e7-8b93-9fc4558afda8\") " pod="openshift-dns/node-resolver-mwv8g" Jul 28 15:13:49.845066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844003 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2974bc55-eff2-4e8a-bfd5-2faf993075a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.845066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844007 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-host-var-lib-kubelet\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.845066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844041 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-var-lib-openvswitch\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.845066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844089 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-etc-openvswitch\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.845066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844083 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/01dca34b-58ab-41e7-8b93-9fc4558afda8-hosts-file\") pod \"node-resolver-mwv8g\" (UID: \"01dca34b-58ab-41e7-8b93-9fc4558afda8\") " pod="openshift-dns/node-resolver-mwv8g" Jul 28 15:13:49.845066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844115 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txpdm\" (UniqueName: \"kubernetes.io/projected/01dca34b-58ab-41e7-8b93-9fc4558afda8-kube-api-access-txpdm\") pod \"node-resolver-mwv8g\" (UID: \"01dca34b-58ab-41e7-8b93-9fc4558afda8\") " pod="openshift-dns/node-resolver-mwv8g" Jul 28 15:13:49.845066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844122 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2974bc55-eff2-4e8a-bfd5-2faf993075a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.845066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844148 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2228d284-b2b5-4711-955e-e2763f4a817c-host-slash\") pod \"iptables-alerter-bqw8j\" (UID: \"2228d284-b2b5-4711-955e-e2763f4a817c\") " pod="openshift-network-operator/iptables-alerter-bqw8j" Jul 28 15:13:49.845066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844166 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-var-lib-openvswitch\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.845066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844170 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-etc-openvswitch\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.845066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844186 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-multus-socket-dir-parent\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.845066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844215 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2228d284-b2b5-4711-955e-e2763f4a817c-host-slash\") pod \"iptables-alerter-bqw8j\" (UID: \"2228d284-b2b5-4711-955e-e2763f4a817c\") " pod="openshift-network-operator/iptables-alerter-bqw8j" Jul 28 15:13:49.845066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844213 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-multus-daemon-config\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.845066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844261 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.845066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844266 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-multus-socket-dir-parent\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.845066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844289 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-ovnkube-script-lib\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.845903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844300 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/263c477a-d08f-4956-9c46-10365000b10a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.845903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844335 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.845903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844371 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2974bc55-eff2-4e8a-bfd5-2faf993075a7-socket-dir\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.845903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844379 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-run-ovn-kubernetes\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.845903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844381 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-env-overrides\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.845903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844400 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-host-run-netns\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.845903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844436 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-host-run-netns\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.845903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844442 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-run-ovn\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.845903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844472 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-system-cni-dir\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.845903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844501 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-slash\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.845903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844506 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2974bc55-eff2-4e8a-bfd5-2faf993075a7-socket-dir\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.845903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844528 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-log-socket\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.845903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844565 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-run-ovn\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.845903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844556 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-slash\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.845903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844592 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/263c477a-d08f-4956-9c46-10365000b10a-cni-binary-copy\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.845903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844605 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-system-cni-dir\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.845903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844627 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-log-socket\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.846813 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844625 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckqfv\" (UniqueName: \"kubernetes.io/projected/263c477a-d08f-4956-9c46-10365000b10a-kube-api-access-ckqfv\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.846813 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844668 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ede988c-a5e0-4257-98a3-decea1014639-konnectivity-ca\") pod \"konnectivity-agent-t65bv\" (UID: \"5ede988c-a5e0-4257-98a3-decea1014639\") " pod="kube-system/konnectivity-agent-t65bv" Jul 28 15:13:49.846813 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844699 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6qnm\" (UniqueName: \"kubernetes.io/projected/2228d284-b2b5-4711-955e-e2763f4a817c-kube-api-access-l6qnm\") pod \"iptables-alerter-bqw8j\" (UID: \"2228d284-b2b5-4711-955e-e2763f4a817c\") " pod="openshift-network-operator/iptables-alerter-bqw8j" Jul 28 15:13:49.846813 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844726 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-host-var-lib-cni-multus\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.846813 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844750 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-run-systemd\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.846813 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844762 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-multus-daemon-config\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.846813 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844776 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-ovnkube-config\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.846813 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844804 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-ovn-node-metrics-cert\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.846813 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844826 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-ovnkube-script-lib\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.846813 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844838 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-host-run-k8s-cni-cncf-io\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.846813 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844886 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-run-systemd\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.846813 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844913 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54dd096b-0a03-4d8c-b288-ec52295ad7fd-dbus\") pod \"global-pull-secret-syncer-xvxzd\" (UID: \"54dd096b-0a03-4d8c-b288-ec52295ad7fd\") " pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:13:49.846813 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844939 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/263c477a-d08f-4956-9c46-10365000b10a-cnibin\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.846813 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844966 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2974bc55-eff2-4e8a-bfd5-2faf993075a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.846813 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.844989 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-kubelet\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.846813 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.845014 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-systemd-units\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.846813 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.845038 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-node-log\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.847666 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.845079 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01dca34b-58ab-41e7-8b93-9fc4558afda8-tmp-dir\") pod \"node-resolver-mwv8g\" (UID: \"01dca34b-58ab-41e7-8b93-9fc4558afda8\") " pod="openshift-dns/node-resolver-mwv8g" Jul 28 15:13:49.847666 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.845106 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/263c477a-d08f-4956-9c46-10365000b10a-os-release\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.847666 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.845147 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/263c477a-d08f-4956-9c46-10365000b10a-cni-binary-copy\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.847666 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.845199 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/263c477a-d08f-4956-9c46-10365000b10a-os-release\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.847666 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.845217 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2974bc55-eff2-4e8a-bfd5-2faf993075a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.847666 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.845246 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-host-kubelet\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.847666 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.845289 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-host-var-lib-cni-multus\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.847666 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.845318 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ede988c-a5e0-4257-98a3-decea1014639-konnectivity-ca\") pod \"konnectivity-agent-t65bv\" (UID: \"5ede988c-a5e0-4257-98a3-decea1014639\") " pod="kube-system/konnectivity-agent-t65bv" Jul 28 15:13:49.847666 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.845330 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-host-run-k8s-cni-cncf-io\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.847666 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.845345 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-ovnkube-config\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.847666 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.845412 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-node-log\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.847666 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.845460 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-systemd-units\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.847666 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.845615 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/263c477a-d08f-4956-9c46-10365000b10a-cnibin\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.847666 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.845646 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54dd096b-0a03-4d8c-b288-ec52295ad7fd-dbus\") pod \"global-pull-secret-syncer-xvxzd\" (UID: \"54dd096b-0a03-4d8c-b288-ec52295ad7fd\") " pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:13:49.847666 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.846265 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01dca34b-58ab-41e7-8b93-9fc4558afda8-tmp-dir\") pod \"node-resolver-mwv8g\" (UID: \"01dca34b-58ab-41e7-8b93-9fc4558afda8\") " pod="openshift-dns/node-resolver-mwv8g" Jul 28 15:13:49.847666 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.847156 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ede988c-a5e0-4257-98a3-decea1014639-agent-certs\") pod \"konnectivity-agent-t65bv\" (UID: \"5ede988c-a5e0-4257-98a3-decea1014639\") " pod="kube-system/konnectivity-agent-t65bv" Jul 28 15:13:49.848363 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.847828 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-ovn-node-metrics-cert\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.857152 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.855995 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgxrc\" (UniqueName: \"kubernetes.io/projected/f31fdcf8-d74f-4307-a8b9-e4021d9c6e20-kube-api-access-zgxrc\") pod \"multus-z5p5z\" (UID: \"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20\") " pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.857152 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.856757 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txpdm\" (UniqueName: \"kubernetes.io/projected/01dca34b-58ab-41e7-8b93-9fc4558afda8-kube-api-access-txpdm\") pod \"node-resolver-mwv8g\" (UID: \"01dca34b-58ab-41e7-8b93-9fc4558afda8\") " pod="openshift-dns/node-resolver-mwv8g" Jul 28 15:13:49.857762 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.857738 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r526k\" (UniqueName: \"kubernetes.io/projected/5809cf4f-2b29-4e6f-9f70-26f7a99709fe-kube-api-access-r526k\") pod \"ovnkube-node-5vlpq\" (UID: \"5809cf4f-2b29-4e6f-9f70-26f7a99709fe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.857849 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.857780 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plh6r\" (UniqueName: \"kubernetes.io/projected/2974bc55-eff2-4e8a-bfd5-2faf993075a7-kube-api-access-plh6r\") pod \"aws-ebs-csi-driver-node-fflf5\" (UID: \"2974bc55-eff2-4e8a-bfd5-2faf993075a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.857894 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.857865 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6qnm\" (UniqueName: \"kubernetes.io/projected/2228d284-b2b5-4711-955e-e2763f4a817c-kube-api-access-l6qnm\") pod \"iptables-alerter-bqw8j\" (UID: \"2228d284-b2b5-4711-955e-e2763f4a817c\") " pod="openshift-network-operator/iptables-alerter-bqw8j" Jul 28 15:13:49.857966 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.857944 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckqfv\" (UniqueName: \"kubernetes.io/projected/263c477a-d08f-4956-9c46-10365000b10a-kube-api-access-ckqfv\") pod \"multus-additional-cni-plugins-qxdtr\" (UID: \"263c477a-d08f-4956-9c46-10365000b10a\") " pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.937134 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.937103 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" Jul 28 15:13:49.944860 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.944830 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6l2z9" Jul 28 15:13:49.949635 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:49.949606 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod795606e4_370a_41cf_a5ad_6c181a984efa.slice/crio-495d941d34daa2dbeb3d8ab589742971b75b5fb3a51a662d98d5c68a66d6ec8e WatchSource:0}: Error finding container 495d941d34daa2dbeb3d8ab589742971b75b5fb3a51a662d98d5c68a66d6ec8e: Status 404 returned error can't find the container with id 495d941d34daa2dbeb3d8ab589742971b75b5fb3a51a662d98d5c68a66d6ec8e Jul 28 15:13:49.951707 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.951685 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qxdtr" Jul 28 15:13:49.958244 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.958216 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z5p5z" Jul 28 15:13:49.960318 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:49.960278 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeea28fce_a95a_42f4_acbb_99526480c2d0.slice/crio-b5801ece16f20c7abd7eb3263e331270cce51eace428c8cb5bf9e75164336e07 WatchSource:0}: Error finding container b5801ece16f20c7abd7eb3263e331270cce51eace428c8cb5bf9e75164336e07: Status 404 returned error can't find the container with id b5801ece16f20c7abd7eb3263e331270cce51eace428c8cb5bf9e75164336e07 Jul 28 15:13:49.963039 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.963018 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:13:49.964556 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:49.964528 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod263c477a_d08f_4956_9c46_10365000b10a.slice/crio-fbeb9307eca8d8c04d39c0d1ed7714147dd14d0c86f1ba83f31d104cf0dc7ccb WatchSource:0}: Error finding container fbeb9307eca8d8c04d39c0d1ed7714147dd14d0c86f1ba83f31d104cf0dc7ccb: Status 404 returned error can't find the container with id fbeb9307eca8d8c04d39c0d1ed7714147dd14d0c86f1ba83f31d104cf0dc7ccb Jul 28 15:13:49.968900 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.968882 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" Jul 28 15:13:49.969259 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:49.969236 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf31fdcf8_d74f_4307_a8b9_e4021d9c6e20.slice/crio-a69c846d9bd753210ecd1215b58991d5d93047cd18b29a9d79353769737ad93f WatchSource:0}: Error finding container a69c846d9bd753210ecd1215b58991d5d93047cd18b29a9d79353769737ad93f: Status 404 returned error can't find the container with id a69c846d9bd753210ecd1215b58991d5d93047cd18b29a9d79353769737ad93f Jul 28 15:13:49.974328 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.974304 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t65bv" Jul 28 15:13:49.974663 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:49.974639 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5809cf4f_2b29_4e6f_9f70_26f7a99709fe.slice/crio-9effb9957f3dccd272c2059e749b978e6a1ebae59fe34cd99ff34f89fd2bba65 WatchSource:0}: Error finding container 9effb9957f3dccd272c2059e749b978e6a1ebae59fe34cd99ff34f89fd2bba65: Status 404 returned error can't find the container with id 9effb9957f3dccd272c2059e749b978e6a1ebae59fe34cd99ff34f89fd2bba65 Jul 28 15:13:49.980413 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.980392 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mwv8g" Jul 28 15:13:49.983997 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:49.983955 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2974bc55_eff2_4e8a_bfd5_2faf993075a7.slice/crio-c96fb06d6d642bb3bd55ad05715a0baf930759e020bb2a5a2ba3d9317d4a1130 WatchSource:0}: Error finding container c96fb06d6d642bb3bd55ad05715a0baf930759e020bb2a5a2ba3d9317d4a1130: Status 404 returned error can't find the container with id c96fb06d6d642bb3bd55ad05715a0baf930759e020bb2a5a2ba3d9317d4a1130 Jul 28 15:13:49.985469 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:49.985328 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bqw8j" Jul 28 15:13:49.989078 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:49.989034 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ede988c_a5e0_4257_98a3_decea1014639.slice/crio-81dd70ea90139ff806421e4e42a2b16e3c085c7bfe15dbcca0d56b5018a1cc28 WatchSource:0}: Error finding container 81dd70ea90139ff806421e4e42a2b16e3c085c7bfe15dbcca0d56b5018a1cc28: Status 404 returned error can't find the container with id 81dd70ea90139ff806421e4e42a2b16e3c085c7bfe15dbcca0d56b5018a1cc28 Jul 28 15:13:49.992292 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:49.992267 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01dca34b_58ab_41e7_8b93_9fc4558afda8.slice/crio-f1ae03b9f8d8c341638f9aee299a116d41941a4dc094c87955ce47ac8bb08a76 WatchSource:0}: Error finding container f1ae03b9f8d8c341638f9aee299a116d41941a4dc094c87955ce47ac8bb08a76: Status 404 returned error can't find the container with id f1ae03b9f8d8c341638f9aee299a116d41941a4dc094c87955ce47ac8bb08a76 Jul 28 15:13:49.997913 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:13:49.997883 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2228d284_b2b5_4711_955e_e2763f4a817c.slice/crio-6aee6d91aed6c31c41a4ccabe94ade357ef97d20575d7ddf255f635ca31e4312 WatchSource:0}: Error finding container 6aee6d91aed6c31c41a4ccabe94ade357ef97d20575d7ddf255f635ca31e4312: Status 404 returned error can't find the container with id 6aee6d91aed6c31c41a4ccabe94ade357ef97d20575d7ddf255f635ca31e4312 Jul 28 15:13:50.248313 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:50.248208 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs\") pod \"network-metrics-daemon-hlzj8\" (UID: \"4341eeac-de67-4bab-81c8-d2f8c62c677c\") " pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:13:50.248477 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:50.248378 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:13:50.248477 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:50.248451 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs podName:4341eeac-de67-4bab-81c8-d2f8c62c677c nodeName:}" failed. No retries permitted until 2026-07-28 15:13:51.248435006 +0000 UTC m=+3.903128157 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs") pod "network-metrics-daemon-hlzj8" (UID: "4341eeac-de67-4bab-81c8-d2f8c62c677c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:13:50.349571 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:50.349535 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqxtw\" (UniqueName: \"kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw\") pod \"network-check-target-vdlwj\" (UID: \"aeecf212-beb1-4ab4-acd6-5ae64fbb4416\") " pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:13:50.349768 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:50.349625 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret\") pod \"global-pull-secret-syncer-xvxzd\" (UID: \"54dd096b-0a03-4d8c-b288-ec52295ad7fd\") " pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:13:50.349768 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:50.349719 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 15:13:50.349768 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:50.349734 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 15:13:50.349768 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:50.349742 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 15:13:50.349768 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:50.349755 2560 projected.go:196] Error preparing data for projected volume kube-api-access-rqxtw for pod openshift-network-diagnostics/network-check-target-vdlwj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:13:50.350114 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:50.349799 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw podName:aeecf212-beb1-4ab4-acd6-5ae64fbb4416 nodeName:}" failed. No retries permitted until 2026-07-28 15:13:51.349781308 +0000 UTC m=+4.004474474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqxtw" (UniqueName: "kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw") pod "network-check-target-vdlwj" (UID: "aeecf212-beb1-4ab4-acd6-5ae64fbb4416") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:13:50.350114 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:50.349819 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret podName:54dd096b-0a03-4d8c-b288-ec52295ad7fd nodeName:}" failed. No retries permitted until 2026-07-28 15:13:51.349808163 +0000 UTC m=+4.004501316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret") pod "global-pull-secret-syncer-xvxzd" (UID: "54dd096b-0a03-4d8c-b288-ec52295ad7fd") : object "kube-system"/"original-pull-secret" not registered Jul 28 15:13:50.647208 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:50.646794 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 15:13:50.694866 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:50.694762 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 15:08:50 +0000 UTC" deadline="2028-02-12 22:36:55.118088489 +0000 UTC" Jul 28 15:13:50.694866 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:50.694864 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13543h23m4.423229694s" Jul 28 15:13:50.742651 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:50.742597 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z5p5z" event={"ID":"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20","Type":"ContainerStarted","Data":"a69c846d9bd753210ecd1215b58991d5d93047cd18b29a9d79353769737ad93f"} Jul 28 15:13:50.744863 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:50.744830 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6l2z9" event={"ID":"eea28fce-a95a-42f4-acbb-99526480c2d0","Type":"ContainerStarted","Data":"b5801ece16f20c7abd7eb3263e331270cce51eace428c8cb5bf9e75164336e07"} Jul 28 15:13:50.747620 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:50.747591 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" event={"ID":"795606e4-370a-41cf-a5ad-6c181a984efa","Type":"ContainerStarted","Data":"495d941d34daa2dbeb3d8ab589742971b75b5fb3a51a662d98d5c68a66d6ec8e"} Jul 28 15:13:50.750337 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:50.750304 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bqw8j" event={"ID":"2228d284-b2b5-4711-955e-e2763f4a817c","Type":"ContainerStarted","Data":"6aee6d91aed6c31c41a4ccabe94ade357ef97d20575d7ddf255f635ca31e4312"} Jul 28 15:13:50.753890 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:50.753863 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mwv8g" event={"ID":"01dca34b-58ab-41e7-8b93-9fc4558afda8","Type":"ContainerStarted","Data":"f1ae03b9f8d8c341638f9aee299a116d41941a4dc094c87955ce47ac8bb08a76"} Jul 28 15:13:50.756567 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:50.756536 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t65bv" event={"ID":"5ede988c-a5e0-4257-98a3-decea1014639","Type":"ContainerStarted","Data":"81dd70ea90139ff806421e4e42a2b16e3c085c7bfe15dbcca0d56b5018a1cc28"} Jul 28 15:13:50.759689 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:50.759634 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" event={"ID":"2974bc55-eff2-4e8a-bfd5-2faf993075a7","Type":"ContainerStarted","Data":"c96fb06d6d642bb3bd55ad05715a0baf930759e020bb2a5a2ba3d9317d4a1130"} Jul 28 15:13:50.762223 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:50.762197 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" event={"ID":"5809cf4f-2b29-4e6f-9f70-26f7a99709fe","Type":"ContainerStarted","Data":"9effb9957f3dccd272c2059e749b978e6a1ebae59fe34cd99ff34f89fd2bba65"} Jul 28 15:13:50.764227 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:50.764179 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qxdtr" event={"ID":"263c477a-d08f-4956-9c46-10365000b10a","Type":"ContainerStarted","Data":"fbeb9307eca8d8c04d39c0d1ed7714147dd14d0c86f1ba83f31d104cf0dc7ccb"} Jul 28 15:13:51.256223 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:51.256183 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs\") pod \"network-metrics-daemon-hlzj8\" (UID: \"4341eeac-de67-4bab-81c8-d2f8c62c677c\") " pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:13:51.256395 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:51.256371 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:13:51.256471 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:51.256451 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs podName:4341eeac-de67-4bab-81c8-d2f8c62c677c nodeName:}" failed. No retries permitted until 2026-07-28 15:13:53.256428671 +0000 UTC m=+5.911121824 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs") pod "network-metrics-daemon-hlzj8" (UID: "4341eeac-de67-4bab-81c8-d2f8c62c677c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:13:51.356945 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:51.356914 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqxtw\" (UniqueName: \"kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw\") pod \"network-check-target-vdlwj\" (UID: \"aeecf212-beb1-4ab4-acd6-5ae64fbb4416\") " pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:13:51.357062 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:51.356989 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret\") pod \"global-pull-secret-syncer-xvxzd\" (UID: \"54dd096b-0a03-4d8c-b288-ec52295ad7fd\") " pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:13:51.357171 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:51.357132 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 15:13:51.357230 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:51.357201 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret podName:54dd096b-0a03-4d8c-b288-ec52295ad7fd nodeName:}" failed. No retries permitted until 2026-07-28 15:13:53.357180628 +0000 UTC m=+6.011873781 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret") pod "global-pull-secret-syncer-xvxzd" (UID: "54dd096b-0a03-4d8c-b288-ec52295ad7fd") : object "kube-system"/"original-pull-secret" not registered Jul 28 15:13:51.357637 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:51.357621 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 15:13:51.357678 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:51.357649 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 15:13:51.357678 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:51.357662 2560 projected.go:196] Error preparing data for projected volume kube-api-access-rqxtw for pod openshift-network-diagnostics/network-check-target-vdlwj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:13:51.357770 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:51.357710 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw podName:aeecf212-beb1-4ab4-acd6-5ae64fbb4416 nodeName:}" failed. No retries permitted until 2026-07-28 15:13:53.357694251 +0000 UTC m=+6.012387406 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqxtw" (UniqueName: "kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw") pod "network-check-target-vdlwj" (UID: "aeecf212-beb1-4ab4-acd6-5ae64fbb4416") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:13:51.695903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:51.695604 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 15:08:50 +0000 UTC" deadline="2027-12-22 07:13:33.418643281 +0000 UTC" Jul 28 15:13:51.695903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:51.695905 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12279h59m41.722746069s" Jul 28 15:13:51.726002 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:51.725970 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:13:51.726180 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:51.726111 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdlwj" podUID="aeecf212-beb1-4ab4-acd6-5ae64fbb4416" Jul 28 15:13:51.726554 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:51.726534 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:13:51.726670 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:51.726649 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hlzj8" podUID="4341eeac-de67-4bab-81c8-d2f8c62c677c" Jul 28 15:13:51.726731 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:51.726716 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:13:51.726811 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:51.726790 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvxzd" podUID="54dd096b-0a03-4d8c-b288-ec52295ad7fd" Jul 28 15:13:51.784099 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:51.784046 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" event={"ID":"2d22f8252294a8bfd817cb3f869635a2","Type":"ContainerStarted","Data":"4b459d6f613e9fe278312380bb45e48331dc42fc760957c3be4947c649140c58"} Jul 28 15:13:53.274066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:53.274019 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs\") pod \"network-metrics-daemon-hlzj8\" (UID: \"4341eeac-de67-4bab-81c8-d2f8c62c677c\") " pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:13:53.274536 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:53.274197 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:13:53.274536 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:53.274275 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs podName:4341eeac-de67-4bab-81c8-d2f8c62c677c nodeName:}" failed. No retries permitted until 2026-07-28 15:13:57.274244701 +0000 UTC m=+9.928937861 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs") pod "network-metrics-daemon-hlzj8" (UID: "4341eeac-de67-4bab-81c8-d2f8c62c677c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:13:53.375193 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:53.375134 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqxtw\" (UniqueName: \"kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw\") pod \"network-check-target-vdlwj\" (UID: \"aeecf212-beb1-4ab4-acd6-5ae64fbb4416\") " pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:13:53.375374 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:53.375243 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret\") pod \"global-pull-secret-syncer-xvxzd\" (UID: \"54dd096b-0a03-4d8c-b288-ec52295ad7fd\") " pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:13:53.375445 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:53.375393 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 15:13:53.375564 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:53.375551 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret podName:54dd096b-0a03-4d8c-b288-ec52295ad7fd nodeName:}" failed. No retries permitted until 2026-07-28 15:13:57.375466836 +0000 UTC m=+10.030159991 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret") pod "global-pull-secret-syncer-xvxzd" (UID: "54dd096b-0a03-4d8c-b288-ec52295ad7fd") : object "kube-system"/"original-pull-secret" not registered Jul 28 15:13:53.376260 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:53.376231 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 15:13:53.376363 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:53.376270 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 15:13:53.376363 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:53.376285 2560 projected.go:196] Error preparing data for projected volume kube-api-access-rqxtw for pod openshift-network-diagnostics/network-check-target-vdlwj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:13:53.376363 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:53.376342 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw podName:aeecf212-beb1-4ab4-acd6-5ae64fbb4416 nodeName:}" failed. No retries permitted until 2026-07-28 15:13:57.376324985 +0000 UTC m=+10.031018142 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqxtw" (UniqueName: "kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw") pod "network-check-target-vdlwj" (UID: "aeecf212-beb1-4ab4-acd6-5ae64fbb4416") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:13:53.724165 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:53.723298 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:13:53.724165 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:53.723439 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdlwj" podUID="aeecf212-beb1-4ab4-acd6-5ae64fbb4416" Jul 28 15:13:53.724165 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:53.723858 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:13:53.724165 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:53.723965 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hlzj8" podUID="4341eeac-de67-4bab-81c8-d2f8c62c677c" Jul 28 15:13:53.724165 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:53.724023 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:13:53.724165 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:53.724127 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvxzd" podUID="54dd096b-0a03-4d8c-b288-ec52295ad7fd" Jul 28 15:13:55.723189 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:55.723155 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:13:55.723703 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:55.723290 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdlwj" podUID="aeecf212-beb1-4ab4-acd6-5ae64fbb4416" Jul 28 15:13:55.723791 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:55.723762 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:13:55.723912 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:55.723888 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hlzj8" podUID="4341eeac-de67-4bab-81c8-d2f8c62c677c" Jul 28 15:13:55.723984 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:55.723961 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:13:55.724077 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:55.724035 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvxzd" podUID="54dd096b-0a03-4d8c-b288-ec52295ad7fd" Jul 28 15:13:57.309693 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:57.309657 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs\") pod \"network-metrics-daemon-hlzj8\" (UID: \"4341eeac-de67-4bab-81c8-d2f8c62c677c\") " pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:13:57.310148 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:57.309805 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:13:57.310148 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:57.309883 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs podName:4341eeac-de67-4bab-81c8-d2f8c62c677c nodeName:}" failed. No retries permitted until 2026-07-28 15:14:05.30986155 +0000 UTC m=+17.964554703 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs") pod "network-metrics-daemon-hlzj8" (UID: "4341eeac-de67-4bab-81c8-d2f8c62c677c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:13:57.410889 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:57.410856 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret\") pod \"global-pull-secret-syncer-xvxzd\" (UID: \"54dd096b-0a03-4d8c-b288-ec52295ad7fd\") " pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:13:57.411089 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:57.410995 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqxtw\" (UniqueName: \"kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw\") pod \"network-check-target-vdlwj\" (UID: \"aeecf212-beb1-4ab4-acd6-5ae64fbb4416\") " pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:13:57.411089 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:57.411037 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 15:13:57.411209 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:57.411109 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret podName:54dd096b-0a03-4d8c-b288-ec52295ad7fd nodeName:}" failed. No retries permitted until 2026-07-28 15:14:05.411088189 +0000 UTC m=+18.065781341 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret") pod "global-pull-secret-syncer-xvxzd" (UID: "54dd096b-0a03-4d8c-b288-ec52295ad7fd") : object "kube-system"/"original-pull-secret" not registered Jul 28 15:13:57.411209 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:57.411137 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 15:13:57.411209 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:57.411158 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 15:13:57.411209 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:57.411174 2560 projected.go:196] Error preparing data for projected volume kube-api-access-rqxtw for pod openshift-network-diagnostics/network-check-target-vdlwj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:13:57.411415 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:57.411274 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw podName:aeecf212-beb1-4ab4-acd6-5ae64fbb4416 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:05.411256088 +0000 UTC m=+18.065949241 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqxtw" (UniqueName: "kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw") pod "network-check-target-vdlwj" (UID: "aeecf212-beb1-4ab4-acd6-5ae64fbb4416") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:13:57.724404 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:57.724368 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:13:57.724567 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:57.724488 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:13:57.724567 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:57.724505 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:13:57.724567 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:57.724529 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hlzj8" podUID="4341eeac-de67-4bab-81c8-d2f8c62c677c" Jul 28 15:13:57.724746 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:57.724574 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdlwj" podUID="aeecf212-beb1-4ab4-acd6-5ae64fbb4416" Jul 28 15:13:57.724746 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:57.724652 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvxzd" podUID="54dd096b-0a03-4d8c-b288-ec52295ad7fd" Jul 28 15:13:59.724391 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:59.723859 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:13:59.724391 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:59.724012 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvxzd" podUID="54dd096b-0a03-4d8c-b288-ec52295ad7fd" Jul 28 15:13:59.724391 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:59.724397 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:13:59.724925 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:59.724490 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdlwj" podUID="aeecf212-beb1-4ab4-acd6-5ae64fbb4416" Jul 28 15:13:59.724925 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:13:59.724623 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:13:59.724925 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:13:59.724722 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hlzj8" podUID="4341eeac-de67-4bab-81c8-d2f8c62c677c" Jul 28 15:14:01.723352 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:01.723316 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:14:01.723732 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:01.723330 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:14:01.723732 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:01.723433 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdlwj" podUID="aeecf212-beb1-4ab4-acd6-5ae64fbb4416" Jul 28 15:14:01.723732 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:01.723496 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hlzj8" podUID="4341eeac-de67-4bab-81c8-d2f8c62c677c" Jul 28 15:14:01.723732 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:01.723547 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:14:01.723732 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:01.723600 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvxzd" podUID="54dd096b-0a03-4d8c-b288-ec52295ad7fd" Jul 28 15:14:03.723646 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:03.723612 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:14:03.724152 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:03.723614 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:14:03.724152 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:03.723719 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdlwj" podUID="aeecf212-beb1-4ab4-acd6-5ae64fbb4416" Jul 28 15:14:03.724152 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:03.723808 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hlzj8" podUID="4341eeac-de67-4bab-81c8-d2f8c62c677c" Jul 28 15:14:03.724152 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:03.723838 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:14:03.724152 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:03.723946 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvxzd" podUID="54dd096b-0a03-4d8c-b288-ec52295ad7fd" Jul 28 15:14:05.376201 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:05.376164 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs\") pod \"network-metrics-daemon-hlzj8\" (UID: \"4341eeac-de67-4bab-81c8-d2f8c62c677c\") " pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:14:05.376653 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:05.376332 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:14:05.376653 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:05.376391 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs podName:4341eeac-de67-4bab-81c8-d2f8c62c677c nodeName:}" failed. No retries permitted until 2026-07-28 15:14:21.376372981 +0000 UTC m=+34.031066334 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs") pod "network-metrics-daemon-hlzj8" (UID: "4341eeac-de67-4bab-81c8-d2f8c62c677c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:14:05.477079 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:05.477044 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret\") pod \"global-pull-secret-syncer-xvxzd\" (UID: \"54dd096b-0a03-4d8c-b288-ec52295ad7fd\") " pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:14:05.477257 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:05.477121 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqxtw\" (UniqueName: \"kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw\") pod \"network-check-target-vdlwj\" (UID: \"aeecf212-beb1-4ab4-acd6-5ae64fbb4416\") " pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:14:05.477257 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:05.477208 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 15:14:05.477391 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:05.477258 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 15:14:05.477391 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:05.477271 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret podName:54dd096b-0a03-4d8c-b288-ec52295ad7fd nodeName:}" failed. No retries permitted until 2026-07-28 15:14:21.477256172 +0000 UTC m=+34.131949320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret") pod "global-pull-secret-syncer-xvxzd" (UID: "54dd096b-0a03-4d8c-b288-ec52295ad7fd") : object "kube-system"/"original-pull-secret" not registered Jul 28 15:14:05.477391 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:05.477281 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 15:14:05.477391 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:05.477294 2560 projected.go:196] Error preparing data for projected volume kube-api-access-rqxtw for pod openshift-network-diagnostics/network-check-target-vdlwj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:14:05.477391 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:05.477345 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw podName:aeecf212-beb1-4ab4-acd6-5ae64fbb4416 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:21.477329512 +0000 UTC m=+34.132022674 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqxtw" (UniqueName: "kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw") pod "network-check-target-vdlwj" (UID: "aeecf212-beb1-4ab4-acd6-5ae64fbb4416") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:14:05.723968 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:05.723937 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:14:05.723968 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:05.723959 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:14:05.724213 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:05.724053 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:14:05.724213 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:05.724055 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdlwj" podUID="aeecf212-beb1-4ab4-acd6-5ae64fbb4416" Jul 28 15:14:05.724213 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:05.724166 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hlzj8" podUID="4341eeac-de67-4bab-81c8-d2f8c62c677c" Jul 28 15:14:05.724373 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:05.724254 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvxzd" podUID="54dd096b-0a03-4d8c-b288-ec52295ad7fd" Jul 28 15:14:07.723599 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:07.723566 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:14:07.724056 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:07.723669 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:14:07.724056 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:07.723713 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:14:07.724056 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:07.723671 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdlwj" podUID="aeecf212-beb1-4ab4-acd6-5ae64fbb4416" Jul 28 15:14:07.724056 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:07.723794 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvxzd" podUID="54dd096b-0a03-4d8c-b288-ec52295ad7fd" Jul 28 15:14:07.724056 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:07.723879 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hlzj8" podUID="4341eeac-de67-4bab-81c8-d2f8c62c677c" Jul 28 15:14:09.724546 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:09.724107 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:14:09.724546 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:09.724239 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hlzj8" podUID="4341eeac-de67-4bab-81c8-d2f8c62c677c" Jul 28 15:14:09.724546 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:09.724107 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:14:09.724546 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:09.724359 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdlwj" podUID="aeecf212-beb1-4ab4-acd6-5ae64fbb4416" Jul 28 15:14:09.724546 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:09.724419 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:14:09.724546 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:09.724490 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvxzd" podUID="54dd096b-0a03-4d8c-b288-ec52295ad7fd" Jul 28 15:14:09.829747 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:09.829536 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" event={"ID":"5809cf4f-2b29-4e6f-9f70-26f7a99709fe","Type":"ContainerStarted","Data":"a555446598e8bcbecbe64d9dc630de15c41579c95999c95baa725c9a1c7f1303"} Jul 28 15:14:09.834761 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:09.834734 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z5p5z" event={"ID":"f31fdcf8-d74f-4307-a8b9-e4021d9c6e20","Type":"ContainerStarted","Data":"7c5dc3c7bbd6e998ed2307515367e8f68005653300252ec15fccbcef1fda37e7"} Jul 28 15:14:09.847755 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:09.847693 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" event={"ID":"795606e4-370a-41cf-a5ad-6c181a984efa","Type":"ContainerStarted","Data":"c8008d48c892bda7cc0d2fba581d4bf3a8da99b5a3b1b128475f275759081cd5"} Jul 28 15:14:09.858923 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:09.857753 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" podStartSLOduration=20.857734305 podStartE2EDuration="20.857734305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:13:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:13:51.803226213 +0000 UTC m=+4.457919388" watchObservedRunningTime="2026-07-28 15:14:09.857734305 +0000 UTC m=+22.512427477" Jul 28 15:14:09.858923 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:09.858201 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z5p5z" podStartSLOduration=2.123037032 podStartE2EDuration="21.858189727s" totalImagesPullingTime="19.735152695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:09.856995825 +0000 UTC m=+22.511688996" watchObservedRunningTime="2026-07-28 15:14:09.858189727 +0000 UTC m=+22.512882899" Jul 28 15:14:10.851261 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:10.851227 2560 generic.go:356] "Generic (PLEG): container finished" podID="b0c4fecc896bbcc6b46383f7742a473d" containerID="67b22f0b3c67eae772eaa791cff47059e413225df1a7bde27c64a6bbfdcdf498" exitCode=0 Jul 28 15:14:10.851991 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:10.851312 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" event={"ID":"b0c4fecc896bbcc6b46383f7742a473d","Type":"ContainerDied","Data":"67b22f0b3c67eae772eaa791cff47059e413225df1a7bde27c64a6bbfdcdf498"} Jul 28 15:14:10.852888 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:10.852864 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6l2z9" event={"ID":"eea28fce-a95a-42f4-acbb-99526480c2d0","Type":"ContainerStarted","Data":"9e7cf2854730764219ec3631e09e200b793d87ef7bf1fbda0d005bae0bd72983"} Jul 28 15:14:10.854214 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:10.854193 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mwv8g" event={"ID":"01dca34b-58ab-41e7-8b93-9fc4558afda8","Type":"ContainerStarted","Data":"1a1685e1cf72b8a667cc3e3e0eaa8c3f8e93abb8caeac6d454915a64bf5557bf"} Jul 28 15:14:10.855486 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:10.855466 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t65bv" event={"ID":"5ede988c-a5e0-4257-98a3-decea1014639","Type":"ContainerStarted","Data":"80f890a40d415a35515ae984855f914a7daf2255e425efa6505710c2e65d150d"} Jul 28 15:14:10.856833 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:10.856811 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" event={"ID":"2974bc55-eff2-4e8a-bfd5-2faf993075a7","Type":"ContainerStarted","Data":"bcbc9e9a99f2fcf4a5aa78ee716516fede3b68442a831d32956a60732fa84c41"} Jul 28 15:14:10.859189 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:10.859171 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" event={"ID":"5809cf4f-2b29-4e6f-9f70-26f7a99709fe","Type":"ContainerStarted","Data":"e0ba065b6017589cdb607003a74cbe262f02836894e5464acce9a7ee32ba21c8"} Jul 28 15:14:10.859282 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:10.859223 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" event={"ID":"5809cf4f-2b29-4e6f-9f70-26f7a99709fe","Type":"ContainerStarted","Data":"5f595fa28e4fbca0a6db849ca687503311d491b917fb5dc43d0aaae8309ed25b"} Jul 28 15:14:10.859282 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:10.859253 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" event={"ID":"5809cf4f-2b29-4e6f-9f70-26f7a99709fe","Type":"ContainerStarted","Data":"49d7005f9fe4d4960eab530a4fe789d3c0257689198989c0a73473ca63258e9f"} Jul 28 15:14:10.859282 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:10.859281 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" event={"ID":"5809cf4f-2b29-4e6f-9f70-26f7a99709fe","Type":"ContainerStarted","Data":"efec4364ef2a8907c9a8d84e757b3b228693035dc5f1be7e54c27e2375818145"} Jul 28 15:14:10.859411 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:10.859309 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" event={"ID":"5809cf4f-2b29-4e6f-9f70-26f7a99709fe","Type":"ContainerStarted","Data":"19a8303182e7d06969e29064f44d418e7d0be9c03c4c8ada1c42a1a1ac524ca7"} Jul 28 15:14:10.860373 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:10.860348 2560 generic.go:356] "Generic (PLEG): container finished" podID="263c477a-d08f-4956-9c46-10365000b10a" containerID="0035090c8c77b50a1ec33ab77860cc2caeb72863682c849fd025d11592c90691" exitCode=0 Jul 28 15:14:10.860475 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:10.860420 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qxdtr" event={"ID":"263c477a-d08f-4956-9c46-10365000b10a","Type":"ContainerDied","Data":"0035090c8c77b50a1ec33ab77860cc2caeb72863682c849fd025d11592c90691"} Jul 28 15:14:10.871792 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:10.871756 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cpt4r" podStartSLOduration=3.179079062 podStartE2EDuration="22.871745497s" totalImagesPullingTime="19.692666435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:09.878462287 +0000 UTC m=+22.533155459" watchObservedRunningTime="2026-07-28 15:14:10.871745497 +0000 UTC m=+23.526438668" Jul 28 15:14:10.926772 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:10.926731 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6l2z9" podStartSLOduration=3.242767501 podStartE2EDuration="22.92671962s" totalImagesPullingTime="19.683952119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:10.889569722 +0000 UTC m=+23.544262892" watchObservedRunningTime="2026-07-28 15:14:10.92671962 +0000 UTC m=+23.581412790" Jul 28 15:14:10.944120 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:10.944100 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t65bv" Jul 28 15:14:10.944571 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:10.944552 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t65bv" Jul 28 15:14:10.968894 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:10.968855 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t65bv" podStartSLOduration=3.318482405 podStartE2EDuration="22.968842773s" totalImagesPullingTime="19.650360368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:10.949322554 +0000 UTC m=+23.604015724" watchObservedRunningTime="2026-07-28 15:14:10.968842773 +0000 UTC m=+23.623535952" Jul 28 15:14:10.995712 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:10.995677 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mwv8g" podStartSLOduration=3.34417636 podStartE2EDuration="22.995662853s" totalImagesPullingTime="19.651486493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:10.975100389 +0000 UTC m=+23.629793559" watchObservedRunningTime="2026-07-28 15:14:10.995662853 +0000 UTC m=+23.650356024" Jul 28 15:14:11.218781 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:11.218754 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 15:14:11.696654 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:11.696548 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T15:14:11.218778943Z","UUID":"fcc290ed-abb8-4ec8-a0e4-1653401ac5cd","Handler":null,"Name":"","Endpoint":""} Jul 28 15:14:11.698409 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:11.698384 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 15:14:11.698521 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:11.698430 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 15:14:11.723635 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:11.723609 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:14:11.723635 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:11.723624 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:14:11.723835 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:11.723730 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdlwj" podUID="aeecf212-beb1-4ab4-acd6-5ae64fbb4416" Jul 28 15:14:11.723835 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:11.723812 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hlzj8" podUID="4341eeac-de67-4bab-81c8-d2f8c62c677c" Jul 28 15:14:11.723908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:11.723864 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:14:11.723955 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:11.723925 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvxzd" podUID="54dd096b-0a03-4d8c-b288-ec52295ad7fd" Jul 28 15:14:11.863143 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:11.863108 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bqw8j" event={"ID":"2228d284-b2b5-4711-955e-e2763f4a817c","Type":"ContainerStarted","Data":"0af66fb72089f7cc643b37469b4b0b379748ef75d5728b41f7e65f71249f1e0d"} Jul 28 15:14:11.864816 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:11.864794 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" event={"ID":"2974bc55-eff2-4e8a-bfd5-2faf993075a7","Type":"ContainerStarted","Data":"30640116b07f7e8f1a1db70d9e2f3b9793dd3e317bb36c995f0e01dac60e579e"} Jul 28 15:14:11.866538 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:11.866513 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" event={"ID":"b0c4fecc896bbcc6b46383f7742a473d","Type":"ContainerStarted","Data":"697ca194623d74ad6698fc152e9279d4cf18e167df86c97fb1183d88ac0c5ec5"} Jul 28 15:14:11.866761 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:11.866734 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t65bv" Jul 28 15:14:11.867179 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:11.867164 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t65bv" Jul 28 15:14:11.880499 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:11.880464 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bqw8j" podStartSLOduration=4.237621669 podStartE2EDuration="23.880452526s" totalImagesPullingTime="19.642830857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:11.880057641 +0000 UTC m=+24.534750812" watchObservedRunningTime="2026-07-28 15:14:11.880452526 +0000 UTC m=+24.535145696" Jul 28 15:14:11.913724 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:11.913675 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" podStartSLOduration=22.913657099 podStartE2EDuration="22.913657099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:13:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:11.912940898 +0000 UTC m=+24.567634069" watchObservedRunningTime="2026-07-28 15:14:11.913657099 +0000 UTC m=+24.568350270" Jul 28 15:14:12.871668 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:12.871625 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" event={"ID":"2974bc55-eff2-4e8a-bfd5-2faf993075a7","Type":"ContainerStarted","Data":"e1a416db9ead7329a2e47a66bfad20a68f876ce25ad397d6433e967423948546"} Jul 28 15:14:12.875211 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:12.875178 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" event={"ID":"5809cf4f-2b29-4e6f-9f70-26f7a99709fe","Type":"ContainerStarted","Data":"6590e1a6d81dd6976f777a9cdf2a7f35f1f62c948c824b2fa48e714a6903eb9a"} Jul 28 15:14:12.897470 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:12.897424 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fflf5" podStartSLOduration=2.914065796 podStartE2EDuration="24.897408518s" totalImagesPullingTime="21.983342722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:13:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:12.897083876 +0000 UTC m=+25.551777048" watchObservedRunningTime="2026-07-28 15:14:12.897408518 +0000 UTC m=+25.552101689" Jul 28 15:14:13.723066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:13.723027 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:14:13.723066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:13.723043 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:14:13.723277 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:13.723140 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdlwj" podUID="aeecf212-beb1-4ab4-acd6-5ae64fbb4416" Jul 28 15:14:13.723277 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:13.723185 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hlzj8" podUID="4341eeac-de67-4bab-81c8-d2f8c62c677c" Jul 28 15:14:13.723277 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:13.723232 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:14:13.723423 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:13.723298 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvxzd" podUID="54dd096b-0a03-4d8c-b288-ec52295ad7fd" Jul 28 15:14:15.723237 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:15.723067 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:14:15.723807 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:15.723067 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:14:15.723807 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:15.723348 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvxzd" podUID="54dd096b-0a03-4d8c-b288-ec52295ad7fd" Jul 28 15:14:15.723807 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:15.723439 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdlwj" podUID="aeecf212-beb1-4ab4-acd6-5ae64fbb4416" Jul 28 15:14:15.723807 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:15.723072 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:14:15.723807 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:15.723579 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hlzj8" podUID="4341eeac-de67-4bab-81c8-d2f8c62c677c" Jul 28 15:14:15.885872 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:15.885477 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" event={"ID":"5809cf4f-2b29-4e6f-9f70-26f7a99709fe","Type":"ContainerStarted","Data":"8df416d74d287a6e9084f044158cbe474fd8ba902fc09667f65780b3eccd8e89"} Jul 28 15:14:15.885872 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:15.885746 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:14:15.885872 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:15.885800 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:14:15.885872 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:15.885831 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:14:15.887396 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:15.887370 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qxdtr" event={"ID":"263c477a-d08f-4956-9c46-10365000b10a","Type":"ContainerStarted","Data":"b816c15ae82e463ee69a7693260f3d1f890f9d53542da3d7eb9ff107a6eb78e2"} Jul 28 15:14:15.900142 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:15.900122 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:14:15.900258 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:15.900242 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:14:15.917008 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:15.916952 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" podStartSLOduration=8.193075373 podStartE2EDuration="27.916939778s" totalImagesPullingTime="19.723864405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:15.916689978 +0000 UTC m=+28.571383148" watchObservedRunningTime="2026-07-28 15:14:15.916939778 +0000 UTC m=+28.571632947" Jul 28 15:14:16.891196 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:16.891164 2560 generic.go:356] "Generic (PLEG): container finished" podID="263c477a-d08f-4956-9c46-10365000b10a" containerID="b816c15ae82e463ee69a7693260f3d1f890f9d53542da3d7eb9ff107a6eb78e2" exitCode=0 Jul 28 15:14:16.891656 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:16.891257 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qxdtr" event={"ID":"263c477a-d08f-4956-9c46-10365000b10a","Type":"ContainerDied","Data":"b816c15ae82e463ee69a7693260f3d1f890f9d53542da3d7eb9ff107a6eb78e2"} Jul 28 15:14:17.543968 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:17.543903 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hlzj8"] Jul 28 15:14:17.544169 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:17.544064 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:14:17.544233 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:17.544187 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hlzj8" podUID="4341eeac-de67-4bab-81c8-d2f8c62c677c" Jul 28 15:14:17.548895 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:17.548867 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xvxzd"] Jul 28 15:14:17.549070 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:17.548970 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:14:17.549141 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:17.549079 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvxzd" podUID="54dd096b-0a03-4d8c-b288-ec52295ad7fd" Jul 28 15:14:17.549512 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:17.549489 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vdlwj"] Jul 28 15:14:17.549623 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:17.549583 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:14:17.549677 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:17.549660 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdlwj" podUID="aeecf212-beb1-4ab4-acd6-5ae64fbb4416" Jul 28 15:14:18.723862 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:18.723836 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:14:18.724157 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:18.723935 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvxzd" podUID="54dd096b-0a03-4d8c-b288-ec52295ad7fd" Jul 28 15:14:18.897997 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:18.897953 2560 generic.go:356] "Generic (PLEG): container finished" podID="263c477a-d08f-4956-9c46-10365000b10a" containerID="cbd7d7255f57eed1c2932ff4d912cb38b8f718df02244336052568173f7ee9ac" exitCode=0 Jul 28 15:14:18.898156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:18.898017 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qxdtr" event={"ID":"263c477a-d08f-4956-9c46-10365000b10a","Type":"ContainerDied","Data":"cbd7d7255f57eed1c2932ff4d912cb38b8f718df02244336052568173f7ee9ac"} Jul 28 15:14:19.723241 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:19.723075 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:14:19.723373 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:19.723136 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:14:19.723430 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:19.723412 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hlzj8" podUID="4341eeac-de67-4bab-81c8-d2f8c62c677c" Jul 28 15:14:19.723475 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:19.723307 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdlwj" podUID="aeecf212-beb1-4ab4-acd6-5ae64fbb4416" Jul 28 15:14:20.723648 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:20.723619 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:14:20.724017 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:20.723709 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xvxzd" podUID="54dd096b-0a03-4d8c-b288-ec52295ad7fd" Jul 28 15:14:20.904009 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:20.903966 2560 generic.go:356] "Generic (PLEG): container finished" podID="263c477a-d08f-4956-9c46-10365000b10a" containerID="c2d1ec33250d666cf6d2c751f2e3201c2736056baead8ee36be6a9a598c8a8fd" exitCode=0 Jul 28 15:14:20.904146 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:20.904026 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qxdtr" event={"ID":"263c477a-d08f-4956-9c46-10365000b10a","Type":"ContainerDied","Data":"c2d1ec33250d666cf6d2c751f2e3201c2736056baead8ee36be6a9a598c8a8fd"} Jul 28 15:14:21.397496 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:21.397415 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs\") pod \"network-metrics-daemon-hlzj8\" (UID: \"4341eeac-de67-4bab-81c8-d2f8c62c677c\") " pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:14:21.397644 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:21.397547 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:14:21.397644 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:21.397596 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs podName:4341eeac-de67-4bab-81c8-d2f8c62c677c nodeName:}" failed. No retries permitted until 2026-07-28 15:14:53.397584162 +0000 UTC m=+66.052277313 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs") pod "network-metrics-daemon-hlzj8" (UID: "4341eeac-de67-4bab-81c8-d2f8c62c677c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 15:14:21.498468 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:21.498439 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret\") pod \"global-pull-secret-syncer-xvxzd\" (UID: \"54dd096b-0a03-4d8c-b288-ec52295ad7fd\") " pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:14:21.498663 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:21.498488 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqxtw\" (UniqueName: \"kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw\") pod \"network-check-target-vdlwj\" (UID: \"aeecf212-beb1-4ab4-acd6-5ae64fbb4416\") " pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:14:21.498663 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:21.498584 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 15:14:21.498663 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:21.498596 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 15:14:21.498663 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:21.498608 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 15:14:21.498663 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:21.498618 2560 projected.go:196] Error preparing data for projected volume kube-api-access-rqxtw for pod openshift-network-diagnostics/network-check-target-vdlwj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:14:21.498663 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:21.498653 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret podName:54dd096b-0a03-4d8c-b288-ec52295ad7fd nodeName:}" failed. No retries permitted until 2026-07-28 15:14:53.498633748 +0000 UTC m=+66.153326911 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret") pod "global-pull-secret-syncer-xvxzd" (UID: "54dd096b-0a03-4d8c-b288-ec52295ad7fd") : object "kube-system"/"original-pull-secret" not registered Jul 28 15:14:21.498957 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:21.498673 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw podName:aeecf212-beb1-4ab4-acd6-5ae64fbb4416 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:53.49866304 +0000 UTC m=+66.153356206 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqxtw" (UniqueName: "kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw") pod "network-check-target-vdlwj" (UID: "aeecf212-beb1-4ab4-acd6-5ae64fbb4416") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 15:14:21.723898 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:21.723867 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:14:21.724351 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:21.724016 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdlwj" podUID="aeecf212-beb1-4ab4-acd6-5ae64fbb4416" Jul 28 15:14:21.724351 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:21.724073 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:14:21.724351 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:21.724188 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hlzj8" podUID="4341eeac-de67-4bab-81c8-d2f8c62c677c" Jul 28 15:14:22.693823 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.693761 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeReady" Jul 28 15:14:22.693993 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.693897 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 15:14:22.723480 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.723452 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:14:22.726604 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.726571 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 15:14:22.736689 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.736669 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c8cbbfdb-c4cz5"] Jul 28 15:14:22.740345 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.740325 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:22.743420 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.743268 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p229n\"" Jul 28 15:14:22.743420 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.743285 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 15:14:22.743420 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.743286 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 15:14:22.743420 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.743286 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 15:14:22.749858 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.749838 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 15:14:22.762427 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.762402 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c8cbbfdb-c4cz5"] Jul 28 15:14:22.765743 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.765716 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d574s"] Jul 28 15:14:22.769463 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.769446 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jh24b"] Jul 28 15:14:22.769594 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.769575 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d574s" Jul 28 15:14:22.773335 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.773025 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 15:14:22.773335 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.773054 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 15:14:22.773335 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.773082 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 15:14:22.773335 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.773103 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jh24b" Jul 28 15:14:22.773580 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.773549 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lbhsv\"" Jul 28 15:14:22.777470 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.777454 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 15:14:22.777911 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.777861 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 15:14:22.778035 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.777921 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wplwl\"" Jul 28 15:14:22.779940 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.779921 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d574s"] Jul 28 15:14:22.783064 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.782990 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jh24b"] Jul 28 15:14:22.909764 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.909719 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:22.909764 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.909753 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-bound-sa-token\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:22.909764 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.909772 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-tmp-dir\") pod \"dns-default-jh24b\" (UID: \"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d\") " pod="openshift-dns/dns-default-jh24b" Jul 28 15:14:22.910182 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.909792 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-certificates\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:22.910182 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.909816 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d778963-6cf3-4bdb-9c24-7873936333a2-cert\") pod \"ingress-canary-d574s\" (UID: \"3d778963-6cf3-4bdb-9c24-7873936333a2\") " pod="openshift-ingress-canary/ingress-canary-d574s" Jul 28 15:14:22.910182 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.909844 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31df32ae-34aa-4340-bba3-ae4a626eb718-image-registry-private-configuration\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:22.910182 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.909881 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgvv6\" (UniqueName: \"kubernetes.io/projected/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-kube-api-access-mgvv6\") pod \"dns-default-jh24b\" (UID: \"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d\") " pod="openshift-dns/dns-default-jh24b" Jul 28 15:14:22.910182 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.909952 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31df32ae-34aa-4340-bba3-ae4a626eb718-installation-pull-secrets\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:22.910182 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.910004 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls\") pod \"dns-default-jh24b\" (UID: \"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d\") " pod="openshift-dns/dns-default-jh24b" Jul 28 15:14:22.910182 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.910043 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-config-volume\") pod \"dns-default-jh24b\" (UID: \"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d\") " pod="openshift-dns/dns-default-jh24b" Jul 28 15:14:22.910182 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.910080 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31df32ae-34aa-4340-bba3-ae4a626eb718-ca-trust-extracted\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:22.910182 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.910106 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31df32ae-34aa-4340-bba3-ae4a626eb718-trusted-ca\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:22.910182 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.910128 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhlgg\" (UniqueName: \"kubernetes.io/projected/3d778963-6cf3-4bdb-9c24-7873936333a2-kube-api-access-hhlgg\") pod \"ingress-canary-d574s\" (UID: \"3d778963-6cf3-4bdb-9c24-7873936333a2\") " pod="openshift-ingress-canary/ingress-canary-d574s" Jul 28 15:14:22.910182 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:22.910152 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp8rk\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-kube-api-access-lp8rk\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:23.010629 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.010557 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31df32ae-34aa-4340-bba3-ae4a626eb718-installation-pull-secrets\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:23.010782 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.010667 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls\") pod \"dns-default-jh24b\" (UID: \"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d\") " pod="openshift-dns/dns-default-jh24b" Jul 28 15:14:23.010782 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.010717 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-config-volume\") pod \"dns-default-jh24b\" (UID: \"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d\") " pod="openshift-dns/dns-default-jh24b" Jul 28 15:14:23.010782 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.010749 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31df32ae-34aa-4340-bba3-ae4a626eb718-ca-trust-extracted\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:23.010782 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.010770 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31df32ae-34aa-4340-bba3-ae4a626eb718-trusted-ca\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:23.010970 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.010796 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhlgg\" (UniqueName: \"kubernetes.io/projected/3d778963-6cf3-4bdb-9c24-7873936333a2-kube-api-access-hhlgg\") pod \"ingress-canary-d574s\" (UID: \"3d778963-6cf3-4bdb-9c24-7873936333a2\") " pod="openshift-ingress-canary/ingress-canary-d574s" Jul 28 15:14:23.010970 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:23.010867 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 15:14:23.010970 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:23.010948 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls podName:f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d nodeName:}" failed. No retries permitted until 2026-07-28 15:14:23.510925102 +0000 UTC m=+36.165618263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls") pod "dns-default-jh24b" (UID: "f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d") : secret "dns-default-metrics-tls" not found Jul 28 15:14:23.011200 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.011179 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp8rk\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-kube-api-access-lp8rk\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:23.011267 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.011198 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31df32ae-34aa-4340-bba3-ae4a626eb718-ca-trust-extracted\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:23.011267 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.011233 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:23.011267 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.011261 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-bound-sa-token\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:23.011415 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.011284 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-tmp-dir\") pod \"dns-default-jh24b\" (UID: \"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d\") " pod="openshift-dns/dns-default-jh24b" Jul 28 15:14:23.011415 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.011315 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-certificates\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:23.011415 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.011331 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-config-volume\") pod \"dns-default-jh24b\" (UID: \"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d\") " pod="openshift-dns/dns-default-jh24b" Jul 28 15:14:23.011415 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.011344 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d778963-6cf3-4bdb-9c24-7873936333a2-cert\") pod \"ingress-canary-d574s\" (UID: \"3d778963-6cf3-4bdb-9c24-7873936333a2\") " pod="openshift-ingress-canary/ingress-canary-d574s" Jul 28 15:14:23.011415 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:23.011347 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 15:14:23.011415 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:23.011368 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8cbbfdb-c4cz5: secret "image-registry-tls" not found Jul 28 15:14:23.011415 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:23.011413 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls podName:31df32ae-34aa-4340-bba3-ae4a626eb718 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:23.511397616 +0000 UTC m=+36.166090793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls") pod "image-registry-7c8cbbfdb-c4cz5" (UID: "31df32ae-34aa-4340-bba3-ae4a626eb718") : secret "image-registry-tls" not found Jul 28 15:14:23.011769 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.011573 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-tmp-dir\") pod \"dns-default-jh24b\" (UID: \"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d\") " pod="openshift-dns/dns-default-jh24b" Jul 28 15:14:23.011769 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.011603 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31df32ae-34aa-4340-bba3-ae4a626eb718-image-registry-private-configuration\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:23.011769 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.011634 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgvv6\" (UniqueName: \"kubernetes.io/projected/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-kube-api-access-mgvv6\") pod \"dns-default-jh24b\" (UID: \"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d\") " pod="openshift-dns/dns-default-jh24b" Jul 28 15:14:23.011930 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.011850 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-certificates\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:23.012126 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.012091 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31df32ae-34aa-4340-bba3-ae4a626eb718-trusted-ca\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:23.015339 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.015318 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31df32ae-34aa-4340-bba3-ae4a626eb718-image-registry-private-configuration\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:23.015339 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.015330 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31df32ae-34aa-4340-bba3-ae4a626eb718-installation-pull-secrets\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:23.015476 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.015323 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d778963-6cf3-4bdb-9c24-7873936333a2-cert\") pod \"ingress-canary-d574s\" (UID: \"3d778963-6cf3-4bdb-9c24-7873936333a2\") " pod="openshift-ingress-canary/ingress-canary-d574s" Jul 28 15:14:23.020721 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.020699 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp8rk\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-kube-api-access-lp8rk\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:23.021177 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.021159 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgvv6\" (UniqueName: \"kubernetes.io/projected/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-kube-api-access-mgvv6\") pod \"dns-default-jh24b\" (UID: \"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d\") " pod="openshift-dns/dns-default-jh24b" Jul 28 15:14:23.021326 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.021305 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhlgg\" (UniqueName: \"kubernetes.io/projected/3d778963-6cf3-4bdb-9c24-7873936333a2-kube-api-access-hhlgg\") pod \"ingress-canary-d574s\" (UID: \"3d778963-6cf3-4bdb-9c24-7873936333a2\") " pod="openshift-ingress-canary/ingress-canary-d574s" Jul 28 15:14:23.021506 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.021457 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-bound-sa-token\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:23.080156 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.080130 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d574s" Jul 28 15:14:23.233781 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.233744 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d574s"] Jul 28 15:14:23.240654 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:14:23.240617 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d778963_6cf3_4bdb_9c24_7873936333a2.slice/crio-142181d59434605afac7de1365468f1f74e84deb805f803f88fac4fddd40b18a WatchSource:0}: Error finding container 142181d59434605afac7de1365468f1f74e84deb805f803f88fac4fddd40b18a: Status 404 returned error can't find the container with id 142181d59434605afac7de1365468f1f74e84deb805f803f88fac4fddd40b18a Jul 28 15:14:23.515553 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.515515 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls\") pod \"dns-default-jh24b\" (UID: \"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d\") " pod="openshift-dns/dns-default-jh24b" Jul 28 15:14:23.515720 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.515620 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:23.515720 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:23.515694 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 15:14:23.515786 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:23.515734 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 15:14:23.515786 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:23.515748 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8cbbfdb-c4cz5: secret "image-registry-tls" not found Jul 28 15:14:23.515786 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:23.515761 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls podName:f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d nodeName:}" failed. No retries permitted until 2026-07-28 15:14:24.515745201 +0000 UTC m=+37.170438352 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls") pod "dns-default-jh24b" (UID: "f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d") : secret "dns-default-metrics-tls" not found Jul 28 15:14:23.515910 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:23.515809 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls podName:31df32ae-34aa-4340-bba3-ae4a626eb718 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:24.51579387 +0000 UTC m=+37.170487058 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls") pod "image-registry-7c8cbbfdb-c4cz5" (UID: "31df32ae-34aa-4340-bba3-ae4a626eb718") : secret "image-registry-tls" not found Jul 28 15:14:23.727335 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.727306 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:14:23.728056 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.727476 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:14:23.730687 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.730661 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 15:14:23.730908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.730888 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zdqjt\"" Jul 28 15:14:23.731843 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.731824 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 15:14:23.732203 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.732092 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 15:14:23.732334 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.732319 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vfzkj\"" Jul 28 15:14:23.916647 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:23.916609 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d574s" event={"ID":"3d778963-6cf3-4bdb-9c24-7873936333a2","Type":"ContainerStarted","Data":"142181d59434605afac7de1365468f1f74e84deb805f803f88fac4fddd40b18a"} Jul 28 15:14:24.524485 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:24.524448 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls\") pod \"dns-default-jh24b\" (UID: \"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d\") " pod="openshift-dns/dns-default-jh24b" Jul 28 15:14:24.524633 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:24.524539 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:24.524633 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:24.524613 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 15:14:24.524757 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:24.524684 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls podName:f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d nodeName:}" failed. No retries permitted until 2026-07-28 15:14:26.52466261 +0000 UTC m=+39.179355760 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls") pod "dns-default-jh24b" (UID: "f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d") : secret "dns-default-metrics-tls" not found Jul 28 15:14:24.524757 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:24.524690 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 15:14:24.524757 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:24.524709 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8cbbfdb-c4cz5: secret "image-registry-tls" not found Jul 28 15:14:24.524870 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:24.524760 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls podName:31df32ae-34aa-4340-bba3-ae4a626eb718 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:26.524741717 +0000 UTC m=+39.179434868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls") pod "image-registry-7c8cbbfdb-c4cz5" (UID: "31df32ae-34aa-4340-bba3-ae4a626eb718") : secret "image-registry-tls" not found Jul 28 15:14:25.924423 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:25.924387 2560 generic.go:356] "Generic (PLEG): container finished" podID="263c477a-d08f-4956-9c46-10365000b10a" containerID="c9ef4cd411acfa2c3a947715e156a35cf1df4e4ae571e539e23d38c0ecb6d32b" exitCode=0 Jul 28 15:14:25.924876 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:25.924432 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qxdtr" event={"ID":"263c477a-d08f-4956-9c46-10365000b10a","Type":"ContainerDied","Data":"c9ef4cd411acfa2c3a947715e156a35cf1df4e4ae571e539e23d38c0ecb6d32b"} Jul 28 15:14:26.538534 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:26.538501 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:26.538715 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:26.538571 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls\") pod \"dns-default-jh24b\" (UID: \"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d\") " pod="openshift-dns/dns-default-jh24b" Jul 28 15:14:26.538715 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:26.538683 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 15:14:26.538715 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:26.538688 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 15:14:26.538715 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:26.538711 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8cbbfdb-c4cz5: secret "image-registry-tls" not found Jul 28 15:14:26.538883 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:26.538733 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls podName:f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d nodeName:}" failed. No retries permitted until 2026-07-28 15:14:30.538720024 +0000 UTC m=+43.193413172 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls") pod "dns-default-jh24b" (UID: "f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d") : secret "dns-default-metrics-tls" not found Jul 28 15:14:26.538883 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:26.538764 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls podName:31df32ae-34aa-4340-bba3-ae4a626eb718 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:30.53874628 +0000 UTC m=+43.193439452 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls") pod "image-registry-7c8cbbfdb-c4cz5" (UID: "31df32ae-34aa-4340-bba3-ae4a626eb718") : secret "image-registry-tls" not found Jul 28 15:14:26.931005 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:26.930947 2560 generic.go:356] "Generic (PLEG): container finished" podID="263c477a-d08f-4956-9c46-10365000b10a" containerID="42b554057b49fb7421c5d9c832f3eae4c64cf5d150ee75457e3a5e5105ec39b7" exitCode=0 Jul 28 15:14:26.931431 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:26.931014 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qxdtr" event={"ID":"263c477a-d08f-4956-9c46-10365000b10a","Type":"ContainerDied","Data":"42b554057b49fb7421c5d9c832f3eae4c64cf5d150ee75457e3a5e5105ec39b7"} Jul 28 15:14:27.934932 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:27.934694 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d574s" event={"ID":"3d778963-6cf3-4bdb-9c24-7873936333a2","Type":"ContainerStarted","Data":"8e464304bf0a793002fb8fdbabe23e706bba3cc8f26deeb8d380a5bc79801b7c"} Jul 28 15:14:27.937859 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:27.937837 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qxdtr" event={"ID":"263c477a-d08f-4956-9c46-10365000b10a","Type":"ContainerStarted","Data":"a42a4d306a2542ca0b1030f68f7e826a56ec2ca1a8f22acf54ac42d800728537"} Jul 28 15:14:27.956325 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:27.956232 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d574s" podStartSLOduration=1.71137652 podStartE2EDuration="5.956219509s" totalImagesPullingTime="4.244842989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:27.955880589 +0000 UTC m=+40.610573757" watchObservedRunningTime="2026-07-28 15:14:27.956219509 +0000 UTC m=+40.610912657" Jul 28 15:14:27.985858 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:27.985816 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qxdtr" podStartSLOduration=9.102296278 podStartE2EDuration="39.985802824s" totalImagesPullingTime="30.883506546s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:13:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:27.985370473 +0000 UTC m=+40.640063644" watchObservedRunningTime="2026-07-28 15:14:27.985802824 +0000 UTC m=+40.640495994" Jul 28 15:14:30.562602 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:30.562564 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls\") pod \"dns-default-jh24b\" (UID: \"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d\") " pod="openshift-dns/dns-default-jh24b" Jul 28 15:14:30.562955 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:30.562635 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:30.562955 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:30.562735 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 15:14:30.562955 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:30.562798 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls podName:f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d nodeName:}" failed. No retries permitted until 2026-07-28 15:14:38.562784886 +0000 UTC m=+51.217478038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls") pod "dns-default-jh24b" (UID: "f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d") : secret "dns-default-metrics-tls" not found Jul 28 15:14:30.562955 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:30.562741 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 15:14:30.562955 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:30.562830 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8cbbfdb-c4cz5: secret "image-registry-tls" not found Jul 28 15:14:30.562955 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:30.562868 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls podName:31df32ae-34aa-4340-bba3-ae4a626eb718 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:38.562857791 +0000 UTC m=+51.217550941 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls") pod "image-registry-7c8cbbfdb-c4cz5" (UID: "31df32ae-34aa-4340-bba3-ae4a626eb718") : secret "image-registry-tls" not found Jul 28 15:14:38.620299 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:38.620259 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls\") pod \"dns-default-jh24b\" (UID: \"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d\") " pod="openshift-dns/dns-default-jh24b" Jul 28 15:14:38.620891 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:38.620326 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:38.620891 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:38.620431 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 15:14:38.620891 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:38.620431 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 15:14:38.620891 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:38.620513 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls podName:f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d nodeName:}" failed. No retries permitted until 2026-07-28 15:14:54.620496586 +0000 UTC m=+67.275189734 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls") pod "dns-default-jh24b" (UID: "f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d") : secret "dns-default-metrics-tls" not found Jul 28 15:14:38.620891 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:38.620442 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8cbbfdb-c4cz5: secret "image-registry-tls" not found Jul 28 15:14:38.620891 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:38.620583 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls podName:31df32ae-34aa-4340-bba3-ae4a626eb718 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:54.620566524 +0000 UTC m=+67.275259696 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls") pod "image-registry-7c8cbbfdb-c4cz5" (UID: "31df32ae-34aa-4340-bba3-ae4a626eb718") : secret "image-registry-tls" not found Jul 28 15:14:39.369027 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.368998 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl"] Jul 28 15:14:39.386630 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.386604 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-4xs9h"] Jul 28 15:14:39.386765 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.386746 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl" Jul 28 15:14:39.389756 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.389736 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 28 15:14:39.389904 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.389882 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-hqtmw\"" Jul 28 15:14:39.391113 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.391095 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 28 15:14:39.391113 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.391107 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 28 15:14:39.391270 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.391107 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 28 15:14:39.399738 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.399717 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl"] Jul 28 15:14:39.399825 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.399790 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" Jul 28 15:14:39.405351 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.405331 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 28 15:14:39.405518 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.405486 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mrllp\"" Jul 28 15:14:39.405614 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.405563 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 28 15:14:39.406131 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.406101 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 28 15:14:39.406131 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.406104 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 28 15:14:39.410027 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.410010 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-4xs9h"] Jul 28 15:14:39.413805 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.413787 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 28 15:14:39.426632 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.426611 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f19fccd4-56c7-40d9-8bbf-bf6bccbf7281-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl\" (UID: \"f19fccd4-56c7-40d9-8bbf-bf6bccbf7281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl" Jul 28 15:14:39.426728 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.426646 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/20a5b722-f707-4df1-af7e-c0d0b690bc29-config\") pod \"console-operator-584dcb6b54-4xs9h\" (UID: \"20a5b722-f707-4df1-af7e-c0d0b690bc29\") " pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" Jul 28 15:14:39.426728 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.426664 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f19fccd4-56c7-40d9-8bbf-bf6bccbf7281-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl\" (UID: \"f19fccd4-56c7-40d9-8bbf-bf6bccbf7281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl" Jul 28 15:14:39.426728 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.426688 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20a5b722-f707-4df1-af7e-c0d0b690bc29-serving-cert\") pod \"console-operator-584dcb6b54-4xs9h\" (UID: \"20a5b722-f707-4df1-af7e-c0d0b690bc29\") " pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" Jul 28 15:14:39.426728 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.426707 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20a5b722-f707-4df1-af7e-c0d0b690bc29-trusted-ca\") pod \"console-operator-584dcb6b54-4xs9h\" (UID: \"20a5b722-f707-4df1-af7e-c0d0b690bc29\") " pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" Jul 28 15:14:39.426728 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.426725 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v8jk\" (UniqueName: \"kubernetes.io/projected/f19fccd4-56c7-40d9-8bbf-bf6bccbf7281-kube-api-access-2v8jk\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl\" (UID: \"f19fccd4-56c7-40d9-8bbf-bf6bccbf7281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl" Jul 28 15:14:39.426948 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.426772 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zphww\" (UniqueName: \"kubernetes.io/projected/20a5b722-f707-4df1-af7e-c0d0b690bc29-kube-api-access-zphww\") pod \"console-operator-584dcb6b54-4xs9h\" (UID: \"20a5b722-f707-4df1-af7e-c0d0b690bc29\") " pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" Jul 28 15:14:39.467034 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.467010 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w"] Jul 28 15:14:39.487830 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.487811 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w"] Jul 28 15:14:39.487939 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.487898 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w" Jul 28 15:14:39.490987 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.490957 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 28 15:14:39.491066 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.491033 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 28 15:14:39.491210 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.491197 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-248v2\"" Jul 28 15:14:39.491809 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.491794 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 28 15:14:39.527637 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.527617 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v8jk\" (UniqueName: \"kubernetes.io/projected/f19fccd4-56c7-40d9-8bbf-bf6bccbf7281-kube-api-access-2v8jk\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl\" (UID: \"f19fccd4-56c7-40d9-8bbf-bf6bccbf7281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl" Jul 28 15:14:39.527729 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.527658 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kb59w\" (UID: \"bb3e2f63-5d00-485f-b4bb-56ae63e9f028\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w" Jul 28 15:14:39.527729 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.527677 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr775\" (UniqueName: \"kubernetes.io/projected/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-kube-api-access-qr775\") pod \"cluster-samples-operator-6748489656-kb59w\" (UID: \"bb3e2f63-5d00-485f-b4bb-56ae63e9f028\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w" Jul 28 15:14:39.527796 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.527729 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zphww\" (UniqueName: \"kubernetes.io/projected/20a5b722-f707-4df1-af7e-c0d0b690bc29-kube-api-access-zphww\") pod \"console-operator-584dcb6b54-4xs9h\" (UID: \"20a5b722-f707-4df1-af7e-c0d0b690bc29\") " pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" Jul 28 15:14:39.527830 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.527795 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f19fccd4-56c7-40d9-8bbf-bf6bccbf7281-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl\" (UID: \"f19fccd4-56c7-40d9-8bbf-bf6bccbf7281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl" Jul 28 15:14:39.527830 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.527820 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/20a5b722-f707-4df1-af7e-c0d0b690bc29-config\") pod \"console-operator-584dcb6b54-4xs9h\" (UID: \"20a5b722-f707-4df1-af7e-c0d0b690bc29\") " pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" Jul 28 15:14:39.527919 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.527836 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f19fccd4-56c7-40d9-8bbf-bf6bccbf7281-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl\" (UID: \"f19fccd4-56c7-40d9-8bbf-bf6bccbf7281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl" Jul 28 15:14:39.527919 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.527856 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20a5b722-f707-4df1-af7e-c0d0b690bc29-serving-cert\") pod \"console-operator-584dcb6b54-4xs9h\" (UID: \"20a5b722-f707-4df1-af7e-c0d0b690bc29\") " pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" Jul 28 15:14:39.527919 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.527874 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20a5b722-f707-4df1-af7e-c0d0b690bc29-trusted-ca\") pod \"console-operator-584dcb6b54-4xs9h\" (UID: \"20a5b722-f707-4df1-af7e-c0d0b690bc29\") " pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" Jul 28 15:14:39.528543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.528516 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f19fccd4-56c7-40d9-8bbf-bf6bccbf7281-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl\" (UID: \"f19fccd4-56c7-40d9-8bbf-bf6bccbf7281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl" Jul 28 15:14:39.528543 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.528537 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/20a5b722-f707-4df1-af7e-c0d0b690bc29-config\") pod \"console-operator-584dcb6b54-4xs9h\" (UID: \"20a5b722-f707-4df1-af7e-c0d0b690bc29\") " pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" Jul 28 15:14:39.528653 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.528599 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20a5b722-f707-4df1-af7e-c0d0b690bc29-trusted-ca\") pod \"console-operator-584dcb6b54-4xs9h\" (UID: \"20a5b722-f707-4df1-af7e-c0d0b690bc29\") " pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" Jul 28 15:14:39.531395 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.531378 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20a5b722-f707-4df1-af7e-c0d0b690bc29-serving-cert\") pod \"console-operator-584dcb6b54-4xs9h\" (UID: \"20a5b722-f707-4df1-af7e-c0d0b690bc29\") " pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" Jul 28 15:14:39.531455 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.531395 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f19fccd4-56c7-40d9-8bbf-bf6bccbf7281-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl\" (UID: \"f19fccd4-56c7-40d9-8bbf-bf6bccbf7281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl" Jul 28 15:14:39.537697 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.537678 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v8jk\" (UniqueName: \"kubernetes.io/projected/f19fccd4-56c7-40d9-8bbf-bf6bccbf7281-kube-api-access-2v8jk\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl\" (UID: \"f19fccd4-56c7-40d9-8bbf-bf6bccbf7281\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl" Jul 28 15:14:39.545800 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.545781 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zphww\" (UniqueName: \"kubernetes.io/projected/20a5b722-f707-4df1-af7e-c0d0b690bc29-kube-api-access-zphww\") pod \"console-operator-584dcb6b54-4xs9h\" (UID: \"20a5b722-f707-4df1-af7e-c0d0b690bc29\") " pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" Jul 28 15:14:39.628474 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.628396 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kb59w\" (UID: \"bb3e2f63-5d00-485f-b4bb-56ae63e9f028\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w" Jul 28 15:14:39.628474 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.628430 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr775\" (UniqueName: \"kubernetes.io/projected/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-kube-api-access-qr775\") pod \"cluster-samples-operator-6748489656-kb59w\" (UID: \"bb3e2f63-5d00-485f-b4bb-56ae63e9f028\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w" Jul 28 15:14:39.628863 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:39.628547 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 15:14:39.628863 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:39.628611 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls podName:bb3e2f63-5d00-485f-b4bb-56ae63e9f028 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:40.128595522 +0000 UTC m=+52.783288670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls") pod "cluster-samples-operator-6748489656-kb59w" (UID: "bb3e2f63-5d00-485f-b4bb-56ae63e9f028") : secret "samples-operator-tls" not found Jul 28 15:14:39.644746 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.644712 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr775\" (UniqueName: \"kubernetes.io/projected/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-kube-api-access-qr775\") pod \"cluster-samples-operator-6748489656-kb59w\" (UID: \"bb3e2f63-5d00-485f-b4bb-56ae63e9f028\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w" Jul 28 15:14:39.695403 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.695373 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl" Jul 28 15:14:39.707901 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.707884 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" Jul 28 15:14:39.835682 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.835640 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl"] Jul 28 15:14:39.840757 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:14:39.840722 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf19fccd4_56c7_40d9_8bbf_bf6bccbf7281.slice/crio-cc7b1088c76ab0474cc2291b119a8f4795f25ffa0f929fbc13f016dc81ad660f WatchSource:0}: Error finding container cc7b1088c76ab0474cc2291b119a8f4795f25ffa0f929fbc13f016dc81ad660f: Status 404 returned error can't find the container with id cc7b1088c76ab0474cc2291b119a8f4795f25ffa0f929fbc13f016dc81ad660f Jul 28 15:14:39.849359 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.849331 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-4xs9h"] Jul 28 15:14:39.968348 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.968315 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" event={"ID":"20a5b722-f707-4df1-af7e-c0d0b690bc29","Type":"ContainerStarted","Data":"5b4ee72d650c4bb0659b7bb2ba29719f9ba7505a0f17a288796ea6a2feef8f00"} Jul 28 15:14:39.969348 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:39.969313 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl" event={"ID":"f19fccd4-56c7-40d9-8bbf-bf6bccbf7281","Type":"ContainerStarted","Data":"cc7b1088c76ab0474cc2291b119a8f4795f25ffa0f929fbc13f016dc81ad660f"} Jul 28 15:14:40.132599 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:40.132567 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kb59w\" (UID: \"bb3e2f63-5d00-485f-b4bb-56ae63e9f028\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w" Jul 28 15:14:40.132753 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:40.132692 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 15:14:40.132753 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:40.132743 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls podName:bb3e2f63-5d00-485f-b4bb-56ae63e9f028 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:41.132729261 +0000 UTC m=+53.787422410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls") pod "cluster-samples-operator-6748489656-kb59w" (UID: "bb3e2f63-5d00-485f-b4bb-56ae63e9f028") : secret "samples-operator-tls" not found Jul 28 15:14:41.139739 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:41.139695 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kb59w\" (UID: \"bb3e2f63-5d00-485f-b4bb-56ae63e9f028\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w" Jul 28 15:14:41.140299 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:41.139823 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 15:14:41.140299 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:41.139905 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls podName:bb3e2f63-5d00-485f-b4bb-56ae63e9f028 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:43.139884928 +0000 UTC m=+55.794578098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls") pod "cluster-samples-operator-6748489656-kb59w" (UID: "bb3e2f63-5d00-485f-b4bb-56ae63e9f028") : secret "samples-operator-tls" not found Jul 28 15:14:41.803637 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:41.803601 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-9zv4c"] Jul 28 15:14:41.817297 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:41.817257 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-9zv4c"] Jul 28 15:14:41.817448 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:41.817381 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-9zv4c" Jul 28 15:14:41.820434 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:41.820209 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 28 15:14:41.820434 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:41.820264 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fd5nq\"" Jul 28 15:14:41.820434 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:41.820308 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 28 15:14:41.845775 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:41.845747 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0ff0e73c-9735-4325-a1d8-8f9278d5d279-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-9zv4c\" (UID: \"0ff0e73c-9735-4325-a1d8-8f9278d5d279\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-9zv4c" Jul 28 15:14:41.845900 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:41.845790 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-9zv4c\" (UID: \"0ff0e73c-9735-4325-a1d8-8f9278d5d279\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-9zv4c" Jul 28 15:14:41.946883 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:41.946843 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0ff0e73c-9735-4325-a1d8-8f9278d5d279-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-9zv4c\" (UID: \"0ff0e73c-9735-4325-a1d8-8f9278d5d279\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-9zv4c" Jul 28 15:14:41.946883 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:41.946897 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-9zv4c\" (UID: \"0ff0e73c-9735-4325-a1d8-8f9278d5d279\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-9zv4c" Jul 28 15:14:41.947170 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:41.947027 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 15:14:41.947170 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:41.947095 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert podName:0ff0e73c-9735-4325-a1d8-8f9278d5d279 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:42.447075333 +0000 UTC m=+55.101768489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-9zv4c" (UID: "0ff0e73c-9735-4325-a1d8-8f9278d5d279") : secret "networking-console-plugin-cert" not found Jul 28 15:14:41.947666 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:41.947641 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0ff0e73c-9735-4325-a1d8-8f9278d5d279-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-9zv4c\" (UID: \"0ff0e73c-9735-4325-a1d8-8f9278d5d279\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-9zv4c" Jul 28 15:14:42.450712 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:42.450671 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-9zv4c\" (UID: \"0ff0e73c-9735-4325-a1d8-8f9278d5d279\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-9zv4c" Jul 28 15:14:42.451134 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:42.450827 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 15:14:42.451134 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:42.450892 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert podName:0ff0e73c-9735-4325-a1d8-8f9278d5d279 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:43.45087725 +0000 UTC m=+56.105570406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-9zv4c" (UID: "0ff0e73c-9735-4325-a1d8-8f9278d5d279") : secret "networking-console-plugin-cert" not found Jul 28 15:14:42.978913 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:42.978839 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/0.log" Jul 28 15:14:42.978913 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:42.978880 2560 generic.go:356] "Generic (PLEG): container finished" podID="20a5b722-f707-4df1-af7e-c0d0b690bc29" containerID="d5cdc60989bcc98a314d750726d67958b9045b9584927936e6565cd74ab12614" exitCode=255 Jul 28 15:14:42.979134 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:42.978921 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" event={"ID":"20a5b722-f707-4df1-af7e-c0d0b690bc29","Type":"ContainerDied","Data":"d5cdc60989bcc98a314d750726d67958b9045b9584927936e6565cd74ab12614"} Jul 28 15:14:42.979213 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:42.979196 2560 scope.go:117] "RemoveContainer" containerID="d5cdc60989bcc98a314d750726d67958b9045b9584927936e6565cd74ab12614" Jul 28 15:14:42.980483 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:42.980462 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl" event={"ID":"f19fccd4-56c7-40d9-8bbf-bf6bccbf7281","Type":"ContainerStarted","Data":"db197b98cffa37b1fd13c63d3b9d41b4bd2ab249ad3a0d38aeeb6c6ef90c123f"} Jul 28 15:14:43.018000 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:43.017944 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl" podStartSLOduration=1.2711626630000001 podStartE2EDuration="4.017929493s" totalImagesPullingTime="2.74676683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:43.016905033 +0000 UTC m=+55.671598204" watchObservedRunningTime="2026-07-28 15:14:43.017929493 +0000 UTC m=+55.672622663" Jul 28 15:14:43.157325 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:43.157296 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kb59w\" (UID: \"bb3e2f63-5d00-485f-b4bb-56ae63e9f028\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w" Jul 28 15:14:43.157445 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:43.157429 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 15:14:43.157494 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:43.157488 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls podName:bb3e2f63-5d00-485f-b4bb-56ae63e9f028 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:47.157474966 +0000 UTC m=+59.812168119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls") pod "cluster-samples-operator-6748489656-kb59w" (UID: "bb3e2f63-5d00-485f-b4bb-56ae63e9f028") : secret "samples-operator-tls" not found Jul 28 15:14:43.460272 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:43.460238 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-9zv4c\" (UID: \"0ff0e73c-9735-4325-a1d8-8f9278d5d279\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-9zv4c" Jul 28 15:14:43.460646 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:43.460392 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 15:14:43.460646 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:43.460457 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert podName:0ff0e73c-9735-4325-a1d8-8f9278d5d279 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:45.46044251 +0000 UTC m=+58.115135660 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-9zv4c" (UID: "0ff0e73c-9735-4325-a1d8-8f9278d5d279") : secret "networking-console-plugin-cert" not found Jul 28 15:14:43.984119 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:43.984090 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/1.log" Jul 28 15:14:43.984534 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:43.984519 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/0.log" Jul 28 15:14:43.984587 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:43.984556 2560 generic.go:356] "Generic (PLEG): container finished" podID="20a5b722-f707-4df1-af7e-c0d0b690bc29" containerID="59c5da1e0b9ad34df81d56a8662123b8b6891c9296e3a1b297f7c4c5306ad5be" exitCode=255 Jul 28 15:14:43.984673 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:43.984651 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" event={"ID":"20a5b722-f707-4df1-af7e-c0d0b690bc29","Type":"ContainerDied","Data":"59c5da1e0b9ad34df81d56a8662123b8b6891c9296e3a1b297f7c4c5306ad5be"} Jul 28 15:14:43.984775 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:43.984762 2560 scope.go:117] "RemoveContainer" containerID="d5cdc60989bcc98a314d750726d67958b9045b9584927936e6565cd74ab12614" Jul 28 15:14:43.984829 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:43.984821 2560 scope.go:117] "RemoveContainer" containerID="59c5da1e0b9ad34df81d56a8662123b8b6891c9296e3a1b297f7c4c5306ad5be" Jul 28 15:14:43.985018 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:43.984994 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-4xs9h_openshift-console-operator(20a5b722-f707-4df1-af7e-c0d0b690bc29)\"" pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" podUID="20a5b722-f707-4df1-af7e-c0d0b690bc29" Jul 28 15:14:44.966476 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:44.966431 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-722xx"] Jul 28 15:14:44.970553 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:44.970536 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-722xx" Jul 28 15:14:44.973830 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:44.973812 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 28 15:14:44.973998 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:44.973970 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-68bbk\"" Jul 28 15:14:44.975271 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:44.975252 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 28 15:14:44.981960 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:44.981941 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-722xx"] Jul 28 15:14:44.988428 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:44.988408 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/1.log" Jul 28 15:14:44.988699 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:44.988686 2560 scope.go:117] "RemoveContainer" containerID="59c5da1e0b9ad34df81d56a8662123b8b6891c9296e3a1b297f7c4c5306ad5be" Jul 28 15:14:44.988844 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:44.988824 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-4xs9h_openshift-console-operator(20a5b722-f707-4df1-af7e-c0d0b690bc29)\"" pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" podUID="20a5b722-f707-4df1-af7e-c0d0b690bc29" Jul 28 15:14:45.076601 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.076565 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pttxb\" (UniqueName: \"kubernetes.io/projected/80322693-e6ad-4908-a881-d9a596e6846d-kube-api-access-pttxb\") pod \"migrator-6865c9967-722xx\" (UID: \"80322693-e6ad-4908-a881-d9a596e6846d\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-722xx" Jul 28 15:14:45.177120 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.177088 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pttxb\" (UniqueName: \"kubernetes.io/projected/80322693-e6ad-4908-a881-d9a596e6846d-kube-api-access-pttxb\") pod \"migrator-6865c9967-722xx\" (UID: \"80322693-e6ad-4908-a881-d9a596e6846d\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-722xx" Jul 28 15:14:45.186702 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.186678 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pttxb\" (UniqueName: \"kubernetes.io/projected/80322693-e6ad-4908-a881-d9a596e6846d-kube-api-access-pttxb\") pod \"migrator-6865c9967-722xx\" (UID: \"80322693-e6ad-4908-a881-d9a596e6846d\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-722xx" Jul 28 15:14:45.278428 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.278361 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-722xx" Jul 28 15:14:45.396860 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.396829 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-722xx"] Jul 28 15:14:45.400027 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:14:45.400004 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80322693_e6ad_4908_a881_d9a596e6846d.slice/crio-c72d6adc282347089579bb3a364d49c18f00ba12777fe738b9327e35e78e1067 WatchSource:0}: Error finding container c72d6adc282347089579bb3a364d49c18f00ba12777fe738b9327e35e78e1067: Status 404 returned error can't find the container with id c72d6adc282347089579bb3a364d49c18f00ba12777fe738b9327e35e78e1067 Jul 28 15:14:45.479402 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.479367 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-9zv4c\" (UID: \"0ff0e73c-9735-4325-a1d8-8f9278d5d279\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-9zv4c" Jul 28 15:14:45.479551 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:45.479530 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 15:14:45.479610 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:45.479600 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert podName:0ff0e73c-9735-4325-a1d8-8f9278d5d279 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:49.479582375 +0000 UTC m=+62.134275524 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-9zv4c" (UID: "0ff0e73c-9735-4325-a1d8-8f9278d5d279") : secret "networking-console-plugin-cert" not found Jul 28 15:14:45.792489 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.792453 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w5z4f"] Jul 28 15:14:45.796704 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.796686 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:45.800852 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.800827 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 15:14:45.800940 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.800829 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 15:14:45.800940 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.800830 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 15:14:45.801141 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.801123 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bk52q\"" Jul 28 15:14:45.804163 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.804146 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 15:14:45.826450 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.826423 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w5z4f"] Jul 28 15:14:45.882147 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.882113 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:45.882309 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.882165 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/74de8c67-c520-44ba-b6a5-f40a2ba9d402-data-volume\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:45.882309 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.882235 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/74de8c67-c520-44ba-b6a5-f40a2ba9d402-crio-socket\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:45.882309 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.882269 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:45.882309 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.882294 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjqmt\" (UniqueName: \"kubernetes.io/projected/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-api-access-vjqmt\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:45.983455 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.983419 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/74de8c67-c520-44ba-b6a5-f40a2ba9d402-crio-socket\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:45.983455 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.983452 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:45.983921 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.983474 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjqmt\" (UniqueName: \"kubernetes.io/projected/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-api-access-vjqmt\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:45.983921 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:45.983554 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 15:14:45.983921 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.983560 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/74de8c67-c520-44ba-b6a5-f40a2ba9d402-crio-socket\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:45.983921 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:45.983636 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-rbac-proxy-cm podName:74de8c67-c520-44ba-b6a5-f40a2ba9d402 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:46.483609417 +0000 UTC m=+59.138302581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w5z4f" (UID: "74de8c67-c520-44ba-b6a5-f40a2ba9d402") : configmap "kube-rbac-proxy" not found Jul 28 15:14:45.983921 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.983688 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:45.983921 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.983744 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/74de8c67-c520-44ba-b6a5-f40a2ba9d402-data-volume\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:45.983921 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:45.983749 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 15:14:45.983921 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:45.983801 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls podName:74de8c67-c520-44ba-b6a5-f40a2ba9d402 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:46.483784432 +0000 UTC m=+59.138477582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w5z4f" (UID: "74de8c67-c520-44ba-b6a5-f40a2ba9d402") : secret "insights-runtime-extractor-tls" not found Jul 28 15:14:45.984188 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.984017 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/74de8c67-c520-44ba-b6a5-f40a2ba9d402-data-volume\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:45.992221 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.992194 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-722xx" event={"ID":"80322693-e6ad-4908-a881-d9a596e6846d","Type":"ContainerStarted","Data":"c72d6adc282347089579bb3a364d49c18f00ba12777fe738b9327e35e78e1067"} Jul 28 15:14:45.995025 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:45.995003 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjqmt\" (UniqueName: \"kubernetes.io/projected/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-api-access-vjqmt\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:46.486803 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:46.486763 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:46.486968 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:46.486851 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:46.486968 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:46.486916 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 15:14:46.486968 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:46.486921 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 15:14:46.487146 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:46.486998 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-rbac-proxy-cm podName:74de8c67-c520-44ba-b6a5-f40a2ba9d402 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:47.486963594 +0000 UTC m=+60.141656744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w5z4f" (UID: "74de8c67-c520-44ba-b6a5-f40a2ba9d402") : configmap "kube-rbac-proxy" not found Jul 28 15:14:46.487146 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:46.487013 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls podName:74de8c67-c520-44ba-b6a5-f40a2ba9d402 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:47.487006584 +0000 UTC m=+60.141699733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w5z4f" (UID: "74de8c67-c520-44ba-b6a5-f40a2ba9d402") : secret "insights-runtime-extractor-tls" not found Jul 28 15:14:46.995996 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:46.995892 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-722xx" event={"ID":"80322693-e6ad-4908-a881-d9a596e6846d","Type":"ContainerStarted","Data":"44f5c145a4ab78d40f76372a7c8c64ad2fdad444b7795b9d6147bcc3099d8236"} Jul 28 15:14:46.995996 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:46.995970 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-722xx" event={"ID":"80322693-e6ad-4908-a881-d9a596e6846d","Type":"ContainerStarted","Data":"7160e21f32c9925202482190adbfb49311adb12ff2f9010edb34ee21a821565a"} Jul 28 15:14:47.019460 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:47.019404 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-722xx" podStartSLOduration=1.7134468520000001 podStartE2EDuration="3.019388737s" totalImagesPullingTime="1.305941885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:47.01806484 +0000 UTC m=+59.672758011" watchObservedRunningTime="2026-07-28 15:14:47.019388737 +0000 UTC m=+59.674081954" Jul 28 15:14:47.193273 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:47.193232 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kb59w\" (UID: \"bb3e2f63-5d00-485f-b4bb-56ae63e9f028\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w" Jul 28 15:14:47.193444 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:47.193395 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 15:14:47.193484 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:47.193471 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls podName:bb3e2f63-5d00-485f-b4bb-56ae63e9f028 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:55.193455043 +0000 UTC m=+67.848148192 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls") pod "cluster-samples-operator-6748489656-kb59w" (UID: "bb3e2f63-5d00-485f-b4bb-56ae63e9f028") : secret "samples-operator-tls" not found Jul 28 15:14:47.496088 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:47.496045 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:47.496265 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:47.496111 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:47.496265 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:47.496206 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 15:14:47.496337 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:47.496272 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls podName:74de8c67-c520-44ba-b6a5-f40a2ba9d402 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:49.496257352 +0000 UTC m=+62.150950500 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w5z4f" (UID: "74de8c67-c520-44ba-b6a5-f40a2ba9d402") : secret "insights-runtime-extractor-tls" not found Jul 28 15:14:47.496337 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:47.496217 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 15:14:47.496409 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:47.496341 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-rbac-proxy-cm podName:74de8c67-c520-44ba-b6a5-f40a2ba9d402 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:49.496330465 +0000 UTC m=+62.151023627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w5z4f" (UID: "74de8c67-c520-44ba-b6a5-f40a2ba9d402") : configmap "kube-rbac-proxy" not found Jul 28 15:14:47.903317 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:47.903292 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5vlpq" Jul 28 15:14:48.360835 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:48.360766 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mwv8g_01dca34b-58ab-41e7-8b93-9fc4558afda8/dns-node-resolver/0.log" Jul 28 15:14:48.965894 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:48.965868 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6l2z9_eea28fce-a95a-42f4-acbb-99526480c2d0/node-ca/0.log" Jul 28 15:14:49.510888 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:49.510849 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:49.511386 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:49.510932 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:49.511386 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:49.511034 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-9zv4c\" (UID: \"0ff0e73c-9735-4325-a1d8-8f9278d5d279\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-9zv4c" Jul 28 15:14:49.511386 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:49.511055 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 15:14:49.511386 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:49.511055 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 15:14:49.511386 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:49.511156 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 15:14:49.511386 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:49.511127 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-rbac-proxy-cm podName:74de8c67-c520-44ba-b6a5-f40a2ba9d402 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:53.511109529 +0000 UTC m=+66.165802680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w5z4f" (UID: "74de8c67-c520-44ba-b6a5-f40a2ba9d402") : configmap "kube-rbac-proxy" not found Jul 28 15:14:49.511386 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:49.511225 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls podName:74de8c67-c520-44ba-b6a5-f40a2ba9d402 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:53.511207581 +0000 UTC m=+66.165900731 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w5z4f" (UID: "74de8c67-c520-44ba-b6a5-f40a2ba9d402") : secret "insights-runtime-extractor-tls" not found Jul 28 15:14:49.511386 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:49.511240 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert podName:0ff0e73c-9735-4325-a1d8-8f9278d5d279 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:57.51123249 +0000 UTC m=+70.165925639 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-9zv4c" (UID: "0ff0e73c-9735-4325-a1d8-8f9278d5d279") : secret "networking-console-plugin-cert" not found Jul 28 15:14:49.708786 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:49.708738 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" Jul 28 15:14:49.708963 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:49.708835 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" Jul 28 15:14:49.709180 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:49.709168 2560 scope.go:117] "RemoveContainer" containerID="59c5da1e0b9ad34df81d56a8662123b8b6891c9296e3a1b297f7c4c5306ad5be" Jul 28 15:14:49.709330 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:49.709311 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-4xs9h_openshift-console-operator(20a5b722-f707-4df1-af7e-c0d0b690bc29)\"" pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" podUID="20a5b722-f707-4df1-af7e-c0d0b690bc29" Jul 28 15:14:49.761003 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:49.760917 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d574s_3d778963-6cf3-4bdb-9c24-7873936333a2/serve-healthcheck-canary/0.log" Jul 28 15:14:50.162097 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:50.162072 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-722xx_80322693-e6ad-4908-a881-d9a596e6846d/migrator/0.log" Jul 28 15:14:50.361102 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:50.361076 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-722xx_80322693-e6ad-4908-a881-d9a596e6846d/graceful-termination/0.log" Jul 28 15:14:50.562741 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:50.562672 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl_f19fccd4-56c7-40d9-8bbf-bf6bccbf7281/kube-storage-version-migrator-operator/0.log" Jul 28 15:14:53.443092 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:53.443056 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs\") pod \"network-metrics-daemon-hlzj8\" (UID: \"4341eeac-de67-4bab-81c8-d2f8c62c677c\") " pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:14:53.446633 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:53.446611 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 15:14:53.454199 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:53.454172 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 15:14:53.454316 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:53.454243 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs podName:4341eeac-de67-4bab-81c8-d2f8c62c677c nodeName:}" failed. No retries permitted until 2026-07-28 15:15:57.454222472 +0000 UTC m=+130.108915623 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs") pod "network-metrics-daemon-hlzj8" (UID: "4341eeac-de67-4bab-81c8-d2f8c62c677c") : secret "metrics-daemon-secret" not found Jul 28 15:14:53.543405 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:53.543369 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqxtw\" (UniqueName: \"kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw\") pod \"network-check-target-vdlwj\" (UID: \"aeecf212-beb1-4ab4-acd6-5ae64fbb4416\") " pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:14:53.543568 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:53.543429 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret\") pod \"global-pull-secret-syncer-xvxzd\" (UID: \"54dd096b-0a03-4d8c-b288-ec52295ad7fd\") " pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:14:53.543568 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:53.543453 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:53.543568 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:53.543494 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:14:53.543671 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:53.543572 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 15:14:53.543671 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:53.543593 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 15:14:53.543671 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:53.543634 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-rbac-proxy-cm podName:74de8c67-c520-44ba-b6a5-f40a2ba9d402 nodeName:}" failed. No retries permitted until 2026-07-28 15:15:01.543616109 +0000 UTC m=+74.198309258 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w5z4f" (UID: "74de8c67-c520-44ba-b6a5-f40a2ba9d402") : configmap "kube-rbac-proxy" not found Jul 28 15:14:53.543671 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:53.543648 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls podName:74de8c67-c520-44ba-b6a5-f40a2ba9d402 nodeName:}" failed. No retries permitted until 2026-07-28 15:15:01.543642002 +0000 UTC m=+74.198335151 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w5z4f" (UID: "74de8c67-c520-44ba-b6a5-f40a2ba9d402") : secret "insights-runtime-extractor-tls" not found Jul 28 15:14:53.546352 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:53.546332 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 15:14:53.547150 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:53.547136 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 15:14:53.555991 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:53.555953 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54dd096b-0a03-4d8c-b288-ec52295ad7fd-original-pull-secret\") pod \"global-pull-secret-syncer-xvxzd\" (UID: \"54dd096b-0a03-4d8c-b288-ec52295ad7fd\") " pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:14:53.556654 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:53.556639 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 15:14:53.566305 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:53.566282 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqxtw\" (UniqueName: \"kubernetes.io/projected/aeecf212-beb1-4ab4-acd6-5ae64fbb4416-kube-api-access-rqxtw\") pod \"network-check-target-vdlwj\" (UID: \"aeecf212-beb1-4ab4-acd6-5ae64fbb4416\") " pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:14:53.634328 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:53.634278 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvxzd" Jul 28 15:14:53.747298 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:53.747275 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vfzkj\"" Jul 28 15:14:53.755689 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:53.755671 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:14:53.758059 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:53.758034 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xvxzd"] Jul 28 15:14:53.760662 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:14:53.760642 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54dd096b_0a03_4d8c_b288_ec52295ad7fd.slice/crio-543c7d7714ce7b0b1016f048bee1371cec2fe191c636325f435d8a31db343335 WatchSource:0}: Error finding container 543c7d7714ce7b0b1016f048bee1371cec2fe191c636325f435d8a31db343335: Status 404 returned error can't find the container with id 543c7d7714ce7b0b1016f048bee1371cec2fe191c636325f435d8a31db343335 Jul 28 15:14:53.880875 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:53.880843 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vdlwj"] Jul 28 15:14:53.883631 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:14:53.883602 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeecf212_beb1_4ab4_acd6_5ae64fbb4416.slice/crio-211a20f2b1ba4e876e3cfce940d6a49edfddc0b265dc0a24230fd9fec2efc21c WatchSource:0}: Error finding container 211a20f2b1ba4e876e3cfce940d6a49edfddc0b265dc0a24230fd9fec2efc21c: Status 404 returned error can't find the container with id 211a20f2b1ba4e876e3cfce940d6a49edfddc0b265dc0a24230fd9fec2efc21c Jul 28 15:14:54.015277 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:54.015193 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xvxzd" event={"ID":"54dd096b-0a03-4d8c-b288-ec52295ad7fd","Type":"ContainerStarted","Data":"543c7d7714ce7b0b1016f048bee1371cec2fe191c636325f435d8a31db343335"} Jul 28 15:14:54.016228 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:54.016201 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vdlwj" event={"ID":"aeecf212-beb1-4ab4-acd6-5ae64fbb4416","Type":"ContainerStarted","Data":"211a20f2b1ba4e876e3cfce940d6a49edfddc0b265dc0a24230fd9fec2efc21c"} Jul 28 15:14:54.653940 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:54.653900 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls\") pod \"dns-default-jh24b\" (UID: \"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d\") " pod="openshift-dns/dns-default-jh24b" Jul 28 15:14:54.654427 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:54.653970 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:14:54.654427 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:54.654108 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 15:14:54.654427 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:54.654175 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 15:14:54.654427 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:54.654196 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8cbbfdb-c4cz5: secret "image-registry-tls" not found Jul 28 15:14:54.654427 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:54.654183 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls podName:f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d nodeName:}" failed. No retries permitted until 2026-07-28 15:15:26.654162291 +0000 UTC m=+99.308855456 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls") pod "dns-default-jh24b" (UID: "f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d") : secret "dns-default-metrics-tls" not found Jul 28 15:14:54.654427 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:54.654293 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls podName:31df32ae-34aa-4340-bba3-ae4a626eb718 nodeName:}" failed. No retries permitted until 2026-07-28 15:15:26.654263504 +0000 UTC m=+99.308956666 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls") pod "image-registry-7c8cbbfdb-c4cz5" (UID: "31df32ae-34aa-4340-bba3-ae4a626eb718") : secret "image-registry-tls" not found Jul 28 15:14:55.260852 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:55.260815 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kb59w\" (UID: \"bb3e2f63-5d00-485f-b4bb-56ae63e9f028\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w" Jul 28 15:14:55.261104 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:55.261018 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 15:14:55.261104 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:55.261087 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls podName:bb3e2f63-5d00-485f-b4bb-56ae63e9f028 nodeName:}" failed. No retries permitted until 2026-07-28 15:15:11.261070985 +0000 UTC m=+83.915764136 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls") pod "cluster-samples-operator-6748489656-kb59w" (UID: "bb3e2f63-5d00-485f-b4bb-56ae63e9f028") : secret "samples-operator-tls" not found Jul 28 15:14:57.582086 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:57.582046 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-9zv4c\" (UID: \"0ff0e73c-9735-4325-a1d8-8f9278d5d279\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-9zv4c" Jul 28 15:14:57.582551 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:57.582200 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 15:14:57.582551 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:14:57.582271 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert podName:0ff0e73c-9735-4325-a1d8-8f9278d5d279 nodeName:}" failed. No retries permitted until 2026-07-28 15:15:13.582255888 +0000 UTC m=+86.236949038 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-9zv4c" (UID: "0ff0e73c-9735-4325-a1d8-8f9278d5d279") : secret "networking-console-plugin-cert" not found Jul 28 15:14:59.036173 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:59.035516 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vdlwj" event={"ID":"aeecf212-beb1-4ab4-acd6-5ae64fbb4416","Type":"ContainerStarted","Data":"25ddd2fb886b401527a27dbc61d8115f21ba0fe7d1c6dd734dbbd4dc34c2433c"} Jul 28 15:14:59.036173 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:59.036068 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:14:59.037556 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:59.037530 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xvxzd" event={"ID":"54dd096b-0a03-4d8c-b288-ec52295ad7fd","Type":"ContainerStarted","Data":"dfbc7de8ab8bb0b99344f190b3ca5ab212eced0ef860c91af1ddb63d037eb0b0"} Jul 28 15:14:59.058103 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:59.058058 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vdlwj" podStartSLOduration=66.350667877 podStartE2EDuration="1m11.058043346s" totalImagesPullingTime="4.707375469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:59.057134386 +0000 UTC m=+71.711827569" watchObservedRunningTime="2026-07-28 15:14:59.058043346 +0000 UTC m=+71.712736516" Jul 28 15:14:59.073407 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:14:59.073362 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xvxzd" podStartSLOduration=66.238716494 podStartE2EDuration="1m11.073344118s" totalImagesPullingTime="4.834627624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:59.073091437 +0000 UTC m=+71.727784607" watchObservedRunningTime="2026-07-28 15:14:59.073344118 +0000 UTC m=+71.728037290" Jul 28 15:15:01.616130 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:01.616094 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:15:01.616630 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:01.616194 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:15:01.616630 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:15:01.616293 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 15:15:01.616630 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:15:01.616342 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls podName:74de8c67-c520-44ba-b6a5-f40a2ba9d402 nodeName:}" failed. No retries permitted until 2026-07-28 15:15:17.616330005 +0000 UTC m=+90.271023154 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w5z4f" (UID: "74de8c67-c520-44ba-b6a5-f40a2ba9d402") : secret "insights-runtime-extractor-tls" not found Jul 28 15:15:01.616630 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:01.616623 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/74de8c67-c520-44ba-b6a5-f40a2ba9d402-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:15:03.723884 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:03.723856 2560 scope.go:117] "RemoveContainer" containerID="59c5da1e0b9ad34df81d56a8662123b8b6891c9296e3a1b297f7c4c5306ad5be" Jul 28 15:15:04.059524 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:04.059444 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/2.log" Jul 28 15:15:04.059933 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:04.059916 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/1.log" Jul 28 15:15:04.060010 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:04.059949 2560 generic.go:356] "Generic (PLEG): container finished" podID="20a5b722-f707-4df1-af7e-c0d0b690bc29" containerID="28241afcd10b4eb82afc54ca8a954a32e90cddd62bdeb4a5ff9aa22cfdbf6a94" exitCode=255 Jul 28 15:15:04.060010 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:04.059993 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" event={"ID":"20a5b722-f707-4df1-af7e-c0d0b690bc29","Type":"ContainerDied","Data":"28241afcd10b4eb82afc54ca8a954a32e90cddd62bdeb4a5ff9aa22cfdbf6a94"} Jul 28 15:15:04.060089 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:04.060056 2560 scope.go:117] "RemoveContainer" containerID="59c5da1e0b9ad34df81d56a8662123b8b6891c9296e3a1b297f7c4c5306ad5be" Jul 28 15:15:04.060355 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:04.060340 2560 scope.go:117] "RemoveContainer" containerID="28241afcd10b4eb82afc54ca8a954a32e90cddd62bdeb4a5ff9aa22cfdbf6a94" Jul 28 15:15:04.060544 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:15:04.060524 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-4xs9h_openshift-console-operator(20a5b722-f707-4df1-af7e-c0d0b690bc29)\"" pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" podUID="20a5b722-f707-4df1-af7e-c0d0b690bc29" Jul 28 15:15:05.064433 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:05.064407 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/2.log" Jul 28 15:15:09.709052 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:09.709010 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" Jul 28 15:15:09.709440 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:09.709088 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" Jul 28 15:15:09.709440 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:09.709433 2560 scope.go:117] "RemoveContainer" containerID="28241afcd10b4eb82afc54ca8a954a32e90cddd62bdeb4a5ff9aa22cfdbf6a94" Jul 28 15:15:09.709623 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:15:09.709601 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-4xs9h_openshift-console-operator(20a5b722-f707-4df1-af7e-c0d0b690bc29)\"" pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" podUID="20a5b722-f707-4df1-af7e-c0d0b690bc29" Jul 28 15:15:11.292355 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:11.292319 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kb59w\" (UID: \"bb3e2f63-5d00-485f-b4bb-56ae63e9f028\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w" Jul 28 15:15:11.294741 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:11.294711 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb3e2f63-5d00-485f-b4bb-56ae63e9f028-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kb59w\" (UID: \"bb3e2f63-5d00-485f-b4bb-56ae63e9f028\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w" Jul 28 15:15:11.298899 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:11.298878 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-248v2\"" Jul 28 15:15:11.307493 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:11.307472 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w" Jul 28 15:15:11.434453 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:11.434420 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w"] Jul 28 15:15:12.086636 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:12.086600 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w" event={"ID":"bb3e2f63-5d00-485f-b4bb-56ae63e9f028","Type":"ContainerStarted","Data":"d18436187d72755f5421c92d1c232a3e0664aef42e35d7319bc51bd99ddbc12d"} Jul 28 15:15:13.597797 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:13.597758 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-428wh"] Jul 28 15:15:13.600850 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:13.600827 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-428wh" Jul 28 15:15:13.603615 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:13.603594 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6ds5h\"" Jul 28 15:15:13.603738 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:13.603644 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 28 15:15:13.611268 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:13.611244 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-428wh"] Jul 28 15:15:13.613085 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:13.613063 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-9zv4c\" (UID: \"0ff0e73c-9735-4325-a1d8-8f9278d5d279\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-9zv4c" Jul 28 15:15:13.615535 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:13.615514 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ff0e73c-9735-4325-a1d8-8f9278d5d279-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-9zv4c\" (UID: \"0ff0e73c-9735-4325-a1d8-8f9278d5d279\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-9zv4c" Jul 28 15:15:13.631488 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:13.631459 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fd5nq\"" Jul 28 15:15:13.639272 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:13.639252 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-9zv4c" Jul 28 15:15:13.713555 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:13.713516 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/457708ef-6fa0-4b52-9c9e-5dfc4745d456-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-428wh\" (UID: \"457708ef-6fa0-4b52-9c9e-5dfc4745d456\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-428wh" Jul 28 15:15:13.762166 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:13.761962 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-9zv4c"] Jul 28 15:15:13.764438 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:15:13.764412 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff0e73c_9735_4325_a1d8_8f9278d5d279.slice/crio-c6b7f648de8fb916ffe24e4ba8d68c1af1c4a67597b86d688924d3f38beae57c WatchSource:0}: Error finding container c6b7f648de8fb916ffe24e4ba8d68c1af1c4a67597b86d688924d3f38beae57c: Status 404 returned error can't find the container with id c6b7f648de8fb916ffe24e4ba8d68c1af1c4a67597b86d688924d3f38beae57c Jul 28 15:15:13.814212 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:13.814181 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/457708ef-6fa0-4b52-9c9e-5dfc4745d456-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-428wh\" (UID: \"457708ef-6fa0-4b52-9c9e-5dfc4745d456\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-428wh" Jul 28 15:15:13.814385 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:15:13.814341 2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 28 15:15:13.814425 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:15:13.814411 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/457708ef-6fa0-4b52-9c9e-5dfc4745d456-tls-certificates podName:457708ef-6fa0-4b52-9c9e-5dfc4745d456 nodeName:}" failed. No retries permitted until 2026-07-28 15:15:14.314395017 +0000 UTC m=+86.969088165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/457708ef-6fa0-4b52-9c9e-5dfc4745d456-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-428wh" (UID: "457708ef-6fa0-4b52-9c9e-5dfc4745d456") : secret "prometheus-operator-admission-webhook-tls" not found Jul 28 15:15:14.094505 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:14.094468 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-9zv4c" event={"ID":"0ff0e73c-9735-4325-a1d8-8f9278d5d279","Type":"ContainerStarted","Data":"c6b7f648de8fb916ffe24e4ba8d68c1af1c4a67597b86d688924d3f38beae57c"} Jul 28 15:15:14.096161 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:14.096135 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w" event={"ID":"bb3e2f63-5d00-485f-b4bb-56ae63e9f028","Type":"ContainerStarted","Data":"05175adacdc015daa4f02100243dc497f9ddfdecade999c4bd8f9cfc6718c426"} Jul 28 15:15:14.096291 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:14.096177 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w" event={"ID":"bb3e2f63-5d00-485f-b4bb-56ae63e9f028","Type":"ContainerStarted","Data":"a7296c822f8deed887e0a6c6f9f3acf795010813b0b302e8d5b7699a4caa9b25"} Jul 28 15:15:14.115648 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:14.115602 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kb59w" podStartSLOduration=33.239798644 podStartE2EDuration="35.115586586s" totalImagesPullingTime="1.875787942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:14.114611419 +0000 UTC m=+86.769304589" watchObservedRunningTime="2026-07-28 15:15:14.115586586 +0000 UTC m=+86.770279757" Jul 28 15:15:14.317286 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:14.317247 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/457708ef-6fa0-4b52-9c9e-5dfc4745d456-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-428wh\" (UID: \"457708ef-6fa0-4b52-9c9e-5dfc4745d456\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-428wh" Jul 28 15:15:14.320089 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:14.320061 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/457708ef-6fa0-4b52-9c9e-5dfc4745d456-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-428wh\" (UID: \"457708ef-6fa0-4b52-9c9e-5dfc4745d456\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-428wh" Jul 28 15:15:14.509057 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:14.509015 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-428wh" Jul 28 15:15:14.655261 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:14.655221 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-428wh"] Jul 28 15:15:14.852474 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:15:14.852396 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod457708ef_6fa0_4b52_9c9e_5dfc4745d456.slice/crio-b36e151f8ff2a269080b441b729d596931ceb2d2031bcf84feb7a63ab1ce7557 WatchSource:0}: Error finding container b36e151f8ff2a269080b441b729d596931ceb2d2031bcf84feb7a63ab1ce7557: Status 404 returned error can't find the container with id b36e151f8ff2a269080b441b729d596931ceb2d2031bcf84feb7a63ab1ce7557 Jul 28 15:15:15.100905 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:15.100871 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-9zv4c" event={"ID":"0ff0e73c-9735-4325-a1d8-8f9278d5d279","Type":"ContainerStarted","Data":"78e58f46c0507a356890cb49a8af9bf5eae93c12dd8feb83fcdb5123209c3d02"} Jul 28 15:15:15.102108 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:15.102082 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-428wh" event={"ID":"457708ef-6fa0-4b52-9c9e-5dfc4745d456","Type":"ContainerStarted","Data":"b36e151f8ff2a269080b441b729d596931ceb2d2031bcf84feb7a63ab1ce7557"} Jul 28 15:15:15.119424 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:15.119342 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-9zv4c" podStartSLOduration=32.989619679 podStartE2EDuration="34.119328214s" totalImagesPullingTime="1.129708535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:15.117939472 +0000 UTC m=+87.772632643" watchObservedRunningTime="2026-07-28 15:15:15.119328214 +0000 UTC m=+87.774021386" Jul 28 15:15:16.106661 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:16.106620 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-428wh" event={"ID":"457708ef-6fa0-4b52-9c9e-5dfc4745d456","Type":"ContainerStarted","Data":"37821eb9675ace2ee4f557b0d0eec16c1c5d3fe93127f21840df596331f132a5"} Jul 28 15:15:16.127458 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:16.127401 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-428wh" podStartSLOduration=1.99958418 podStartE2EDuration="3.127382519s" totalImagesPullingTime="1.127798339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:15:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:16.126855432 +0000 UTC m=+88.781548602" watchObservedRunningTime="2026-07-28 15:15:16.127382519 +0000 UTC m=+88.782075691" Jul 28 15:15:17.109822 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:17.109791 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-428wh" Jul 28 15:15:17.114496 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:17.114471 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-428wh" Jul 28 15:15:17.641674 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:17.641620 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:15:17.643908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:17.643886 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/74de8c67-c520-44ba-b6a5-f40a2ba9d402-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w5z4f\" (UID: \"74de8c67-c520-44ba-b6a5-f40a2ba9d402\") " pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:15:17.907986 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:17.907948 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bk52q\"" Jul 28 15:15:17.915562 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:17.915546 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w5z4f" Jul 28 15:15:18.041188 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:18.041155 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w5z4f"] Jul 28 15:15:18.044286 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:15:18.044258 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74de8c67_c520_44ba_b6a5_f40a2ba9d402.slice/crio-61f6fb86b766e81fc865ff5a450713fa555e972f274f1a4467737b15d73132c3 WatchSource:0}: Error finding container 61f6fb86b766e81fc865ff5a450713fa555e972f274f1a4467737b15d73132c3: Status 404 returned error can't find the container with id 61f6fb86b766e81fc865ff5a450713fa555e972f274f1a4467737b15d73132c3 Jul 28 15:15:18.114029 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:18.113994 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w5z4f" event={"ID":"74de8c67-c520-44ba-b6a5-f40a2ba9d402","Type":"ContainerStarted","Data":"61f6fb86b766e81fc865ff5a450713fa555e972f274f1a4467737b15d73132c3"} Jul 28 15:15:22.069352 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.069311 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt"] Jul 28 15:15:22.095738 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.095706 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt"] Jul 28 15:15:22.095907 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.095831 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt" Jul 28 15:15:22.099833 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.099106 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 15:15:22.099833 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.099442 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 15:15:22.099833 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.099674 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-b8hwn\"" Jul 28 15:15:22.099833 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.099814 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 28 15:15:22.100302 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.100278 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 28 15:15:22.100785 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.100768 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 15:15:22.121453 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.121423 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rfgbp"] Jul 28 15:15:22.126830 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.126801 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.129746 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.129719 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 15:15:22.129890 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.129856 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gx7p2\"" Jul 28 15:15:22.129961 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.129924 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 15:15:22.130357 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.130337 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 15:15:22.177500 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.177461 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb725a33-317a-474c-93a1-0848f57e9f38-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-6s7qt\" (UID: \"cb725a33-317a-474c-93a1-0848f57e9f38\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt" Jul 28 15:15:22.177782 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.177749 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxzg6\" (UniqueName: \"kubernetes.io/projected/cb725a33-317a-474c-93a1-0848f57e9f38-kube-api-access-xxzg6\") pod \"openshift-state-metrics-b8f49f5c6-6s7qt\" (UID: \"cb725a33-317a-474c-93a1-0848f57e9f38\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt" Jul 28 15:15:22.177908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.177872 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb725a33-317a-474c-93a1-0848f57e9f38-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-6s7qt\" (UID: \"cb725a33-317a-474c-93a1-0848f57e9f38\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt" Jul 28 15:15:22.177996 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.177923 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb725a33-317a-474c-93a1-0848f57e9f38-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-6s7qt\" (UID: \"cb725a33-317a-474c-93a1-0848f57e9f38\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt" Jul 28 15:15:22.279248 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.279206 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1741e78-8f3f-46c2-8afe-d861d4b931ab-metrics-client-ca\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.279444 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.279256 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1741e78-8f3f-46c2-8afe-d861d4b931ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.279444 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.279314 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c1741e78-8f3f-46c2-8afe-d861d4b931ab-node-exporter-textfile\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.279444 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.279365 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c1741e78-8f3f-46c2-8afe-d861d4b931ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.279444 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.279393 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c1741e78-8f3f-46c2-8afe-d861d4b931ab-root\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.279444 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.279420 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb725a33-317a-474c-93a1-0848f57e9f38-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-6s7qt\" (UID: \"cb725a33-317a-474c-93a1-0848f57e9f38\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt" Jul 28 15:15:22.279444 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.279441 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1741e78-8f3f-46c2-8afe-d861d4b931ab-sys\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.279695 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.279519 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxzg6\" (UniqueName: \"kubernetes.io/projected/cb725a33-317a-474c-93a1-0848f57e9f38-kube-api-access-xxzg6\") pod \"openshift-state-metrics-b8f49f5c6-6s7qt\" (UID: \"cb725a33-317a-474c-93a1-0848f57e9f38\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt" Jul 28 15:15:22.279695 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.279565 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c1741e78-8f3f-46c2-8afe-d861d4b931ab-node-exporter-tls\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.279695 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.279609 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjd7x\" (UniqueName: \"kubernetes.io/projected/c1741e78-8f3f-46c2-8afe-d861d4b931ab-kube-api-access-pjd7x\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.279695 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.279661 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c1741e78-8f3f-46c2-8afe-d861d4b931ab-node-exporter-wtmp\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.279858 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.279731 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb725a33-317a-474c-93a1-0848f57e9f38-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-6s7qt\" (UID: \"cb725a33-317a-474c-93a1-0848f57e9f38\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt" Jul 28 15:15:22.279858 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.279766 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb725a33-317a-474c-93a1-0848f57e9f38-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-6s7qt\" (UID: \"cb725a33-317a-474c-93a1-0848f57e9f38\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt" Jul 28 15:15:22.280176 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.280158 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb725a33-317a-474c-93a1-0848f57e9f38-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-6s7qt\" (UID: \"cb725a33-317a-474c-93a1-0848f57e9f38\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt" Jul 28 15:15:22.282450 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.282422 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb725a33-317a-474c-93a1-0848f57e9f38-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-6s7qt\" (UID: \"cb725a33-317a-474c-93a1-0848f57e9f38\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt" Jul 28 15:15:22.282559 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.282433 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb725a33-317a-474c-93a1-0848f57e9f38-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-6s7qt\" (UID: \"cb725a33-317a-474c-93a1-0848f57e9f38\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt" Jul 28 15:15:22.293600 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.293574 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxzg6\" (UniqueName: \"kubernetes.io/projected/cb725a33-317a-474c-93a1-0848f57e9f38-kube-api-access-xxzg6\") pod \"openshift-state-metrics-b8f49f5c6-6s7qt\" (UID: \"cb725a33-317a-474c-93a1-0848f57e9f38\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt" Jul 28 15:15:22.381343 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.381248 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c1741e78-8f3f-46c2-8afe-d861d4b931ab-node-exporter-wtmp\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.381343 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.381340 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1741e78-8f3f-46c2-8afe-d861d4b931ab-metrics-client-ca\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.381557 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.381375 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1741e78-8f3f-46c2-8afe-d861d4b931ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.381557 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.381426 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c1741e78-8f3f-46c2-8afe-d861d4b931ab-node-exporter-wtmp\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.381557 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.381440 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c1741e78-8f3f-46c2-8afe-d861d4b931ab-node-exporter-textfile\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.381557 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.381533 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c1741e78-8f3f-46c2-8afe-d861d4b931ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.381723 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.381562 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c1741e78-8f3f-46c2-8afe-d861d4b931ab-root\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.381723 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.381589 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1741e78-8f3f-46c2-8afe-d861d4b931ab-sys\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.381723 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.381634 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c1741e78-8f3f-46c2-8afe-d861d4b931ab-node-exporter-tls\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.381723 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.381677 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjd7x\" (UniqueName: \"kubernetes.io/projected/c1741e78-8f3f-46c2-8afe-d861d4b931ab-kube-api-access-pjd7x\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.381873 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.381802 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c1741e78-8f3f-46c2-8afe-d861d4b931ab-node-exporter-textfile\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.381919 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.381877 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c1741e78-8f3f-46c2-8afe-d861d4b931ab-root\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.381995 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.381947 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1741e78-8f3f-46c2-8afe-d861d4b931ab-sys\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.382084 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.382042 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1741e78-8f3f-46c2-8afe-d861d4b931ab-metrics-client-ca\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.382369 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.382346 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c1741e78-8f3f-46c2-8afe-d861d4b931ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.384009 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.383970 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1741e78-8f3f-46c2-8afe-d861d4b931ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.384317 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.384294 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c1741e78-8f3f-46c2-8afe-d861d4b931ab-node-exporter-tls\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.397346 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.397304 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjd7x\" (UniqueName: \"kubernetes.io/projected/c1741e78-8f3f-46c2-8afe-d861d4b931ab-kube-api-access-pjd7x\") pod \"node-exporter-rfgbp\" (UID: \"c1741e78-8f3f-46c2-8afe-d861d4b931ab\") " pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:22.408267 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.408236 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt" Jul 28 15:15:22.438128 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:22.438094 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rfgbp" Jul 28 15:15:23.191126 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.191087 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 15:15:23.195313 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.195286 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.198970 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.198943 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 15:15:23.199340 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.199319 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 15:15:23.199453 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.199398 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 15:15:23.199895 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.199839 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 15:15:23.199895 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.199842 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 15:15:23.199895 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.199845 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 15:15:23.200109 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.199890 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 15:15:23.200386 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.200365 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lzr4v\"" Jul 28 15:15:23.200732 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.200714 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 15:15:23.204471 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.204448 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 15:15:23.217090 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.217043 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 15:15:23.277428 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:15:23.277398 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1741e78_8f3f_46c2_8afe_d861d4b931ab.slice/crio-921ef92f2283f4c0a88070625e6d33899b245bb30e7bb2269175ad6d3777c747 WatchSource:0}: Error finding container 921ef92f2283f4c0a88070625e6d33899b245bb30e7bb2269175ad6d3777c747: Status 404 returned error can't find the container with id 921ef92f2283f4c0a88070625e6d33899b245bb30e7bb2269175ad6d3777c747 Jul 28 15:15:23.288821 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.288793 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.288947 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.288845 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.288947 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.288923 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.289093 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.288991 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.289093 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.289043 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.289093 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.289087 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-web-config\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.289244 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.289124 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-config-volume\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.289244 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.289151 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt42m\" (UniqueName: \"kubernetes.io/projected/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-kube-api-access-jt42m\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.289244 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.289185 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.289244 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.289213 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-config-out\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.289479 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.289287 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-tls-assets\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.289479 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.289333 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.289479 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.289358 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.389901 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.389872 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.390072 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.389917 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.390072 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.389943 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.390072 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.389984 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.390072 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.390030 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-web-config\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.390293 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.390070 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-config-volume\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.390293 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.390102 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt42m\" (UniqueName: \"kubernetes.io/projected/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-kube-api-access-jt42m\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.390293 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.390131 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.390293 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.390156 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-config-out\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.390293 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:15:23.390163 2560 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 28 15:15:23.390293 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.390204 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-tls-assets\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.390293 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:15:23.390229 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-main-tls podName:021a6730-0722-4f3c-bc2c-2d0e92cb3e17 nodeName:}" failed. No retries permitted until 2026-07-28 15:15:23.890209273 +0000 UTC m=+96.544902426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "021a6730-0722-4f3c-bc2c-2d0e92cb3e17") : secret "alertmanager-main-tls" not found Jul 28 15:15:23.390293 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.390279 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.390711 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.390306 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.390711 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.390351 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.390711 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.390489 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.390954 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.390931 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.391586 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.391563 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.392968 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.392675 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-tls-assets\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.393099 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.392967 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.393099 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.392967 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.393218 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.393150 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-config-volume\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.393218 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.393198 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.393469 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.393408 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-web-config\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.394643 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.394626 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-config-out\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.394719 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.394686 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.403937 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.403912 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt42m\" (UniqueName: \"kubernetes.io/projected/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-kube-api-access-jt42m\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.411518 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.411493 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt"] Jul 28 15:15:23.413496 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:15:23.413392 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb725a33_317a_474c_93a1_0848f57e9f38.slice/crio-e7c9cd85e28042216b345105b94d212a4dbdfc083d7264e8cbb46559698e8111 WatchSource:0}: Error finding container e7c9cd85e28042216b345105b94d212a4dbdfc083d7264e8cbb46559698e8111: Status 404 returned error can't find the container with id e7c9cd85e28042216b345105b94d212a4dbdfc083d7264e8cbb46559698e8111 Jul 28 15:15:23.723739 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.723655 2560 scope.go:117] "RemoveContainer" containerID="28241afcd10b4eb82afc54ca8a954a32e90cddd62bdeb4a5ff9aa22cfdbf6a94" Jul 28 15:15:23.723905 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:15:23.723835 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-4xs9h_openshift-console-operator(20a5b722-f707-4df1-af7e-c0d0b690bc29)\"" pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" podUID="20a5b722-f707-4df1-af7e-c0d0b690bc29" Jul 28 15:15:23.895578 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.895461 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:23.899131 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:23.899074 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:24.106579 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:24.106481 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:15:24.137842 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:24.137752 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rfgbp" event={"ID":"c1741e78-8f3f-46c2-8afe-d861d4b931ab","Type":"ContainerStarted","Data":"921ef92f2283f4c0a88070625e6d33899b245bb30e7bb2269175ad6d3777c747"} Jul 28 15:15:24.139565 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:24.139531 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w5z4f" event={"ID":"74de8c67-c520-44ba-b6a5-f40a2ba9d402","Type":"ContainerStarted","Data":"dfc9104cca602af9afc36a0a60bc2c4f8eb048380702b789ffb8ae7ce7a58d85"} Jul 28 15:15:24.141553 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:24.141424 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt" event={"ID":"cb725a33-317a-474c-93a1-0848f57e9f38","Type":"ContainerStarted","Data":"c49ad16647249aedf7bebd51e9d3b7fcc4f0ce57e1ce43a83abd6bc3acbbef74"} Jul 28 15:15:24.141553 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:24.141484 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt" event={"ID":"cb725a33-317a-474c-93a1-0848f57e9f38","Type":"ContainerStarted","Data":"4271f8d0a6c37ae678406cbc0102c746f31a045fa93f89571ec7d7161a341061"} Jul 28 15:15:24.141553 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:24.141516 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt" event={"ID":"cb725a33-317a-474c-93a1-0848f57e9f38","Type":"ContainerStarted","Data":"e7c9cd85e28042216b345105b94d212a4dbdfc083d7264e8cbb46559698e8111"} Jul 28 15:15:24.378733 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:24.378622 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 15:15:24.383427 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:15:24.383384 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod021a6730_0722_4f3c_bc2c_2d0e92cb3e17.slice/crio-68c700364732807d21936fb153e6dffa38618a88b71a7fbb8f6c17ba50f3d1c8 WatchSource:0}: Error finding container 68c700364732807d21936fb153e6dffa38618a88b71a7fbb8f6c17ba50f3d1c8: Status 404 returned error can't find the container with id 68c700364732807d21936fb153e6dffa38618a88b71a7fbb8f6c17ba50f3d1c8 Jul 28 15:15:25.149100 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:25.149052 2560 generic.go:356] "Generic (PLEG): container finished" podID="c1741e78-8f3f-46c2-8afe-d861d4b931ab" containerID="d1951b59288b7b6bbf335f8ad96affd2abc9c046fb88f3df1b46f32d89d22377" exitCode=0 Jul 28 15:15:25.149290 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:25.149147 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rfgbp" event={"ID":"c1741e78-8f3f-46c2-8afe-d861d4b931ab","Type":"ContainerDied","Data":"d1951b59288b7b6bbf335f8ad96affd2abc9c046fb88f3df1b46f32d89d22377"} Jul 28 15:15:25.151205 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:25.151169 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"021a6730-0722-4f3c-bc2c-2d0e92cb3e17","Type":"ContainerStarted","Data":"68c700364732807d21936fb153e6dffa38618a88b71a7fbb8f6c17ba50f3d1c8"} Jul 28 15:15:26.078784 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.078750 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6f4558d958-dj4gv"] Jul 28 15:15:26.097562 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.097405 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6f4558d958-dj4gv"] Jul 28 15:15:26.097562 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.097510 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.101205 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.101175 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 28 15:15:26.101361 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.101178 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-34ncge6bhid44\"" Jul 28 15:15:26.101361 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.101178 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 28 15:15:26.101557 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.101539 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 28 15:15:26.101557 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.101549 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 28 15:15:26.101702 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.101588 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zchjn\"" Jul 28 15:15:26.101897 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.101880 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 28 15:15:26.219108 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.219066 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-secret-grpc-tls\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.219108 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.219113 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-metrics-client-ca\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.219329 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.219135 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.219329 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.219164 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq2rx\" (UniqueName: \"kubernetes.io/projected/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-kube-api-access-dq2rx\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.219329 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.219255 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-secret-thanos-querier-tls\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.219438 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.219384 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.219486 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.219433 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.219532 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.219495 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.320480 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.320438 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.320674 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.320492 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.320674 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.320531 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.320674 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.320561 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-secret-grpc-tls\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.320674 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.320589 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-metrics-client-ca\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.320674 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.320619 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.320674 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.320654 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq2rx\" (UniqueName: \"kubernetes.io/projected/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-kube-api-access-dq2rx\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.320997 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.320705 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-secret-thanos-querier-tls\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.321759 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.321704 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-metrics-client-ca\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.323903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.323851 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.324271 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.324223 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.324375 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.324295 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.324544 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.324521 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-secret-thanos-querier-tls\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.324544 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.324534 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-secret-grpc-tls\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.324758 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.324737 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.330623 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.330562 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq2rx\" (UniqueName: \"kubernetes.io/projected/6f4d18c5-dccd-4a23-bee0-987e5aac5d93-kube-api-access-dq2rx\") pod \"thanos-querier-6f4558d958-dj4gv\" (UID: \"6f4d18c5-dccd-4a23-bee0-987e5aac5d93\") " pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.408815 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.408777 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:26.559178 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.559140 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6dbf99f75b-qw4x8"] Jul 28 15:15:26.563918 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.563889 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.568888 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.568812 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vbtzd\"" Jul 28 15:15:26.568888 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.568811 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 15:15:26.568888 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.568870 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 28 15:15:26.570214 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.570190 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ei5toqc4tafra\"" Jul 28 15:15:26.570332 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.570310 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 28 15:15:26.570478 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.570426 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 28 15:15:26.580534 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.580502 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6dbf99f75b-qw4x8"] Jul 28 15:15:26.725077 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.725039 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8a33c49-8efa-4756-8503-dde78571a565-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.725277 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.725127 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f8a33c49-8efa-4756-8503-dde78571a565-audit-log\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.725277 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.725164 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f8a33c49-8efa-4756-8503-dde78571a565-metrics-server-audit-profiles\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.725277 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.725206 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls\") pod \"dns-default-jh24b\" (UID: \"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d\") " pod="openshift-dns/dns-default-jh24b" Jul 28 15:15:26.725453 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.725291 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncm8h\" (UniqueName: \"kubernetes.io/projected/f8a33c49-8efa-4756-8503-dde78571a565-kube-api-access-ncm8h\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.725453 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.725357 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:15:26.725453 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.725399 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8a33c49-8efa-4756-8503-dde78571a565-client-ca-bundle\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.725453 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.725422 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f8a33c49-8efa-4756-8503-dde78571a565-secret-metrics-server-tls\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.725647 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.725465 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f8a33c49-8efa-4756-8503-dde78571a565-secret-metrics-server-client-certs\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.727801 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.727765 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d-metrics-tls\") pod \"dns-default-jh24b\" (UID: \"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d\") " pod="openshift-dns/dns-default-jh24b" Jul 28 15:15:26.727940 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.727911 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls\") pod \"image-registry-7c8cbbfdb-c4cz5\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:15:26.826581 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.826536 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8a33c49-8efa-4756-8503-dde78571a565-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.826765 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.826594 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f8a33c49-8efa-4756-8503-dde78571a565-audit-log\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.826765 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.826630 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f8a33c49-8efa-4756-8503-dde78571a565-metrics-server-audit-profiles\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.826765 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.826681 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncm8h\" (UniqueName: \"kubernetes.io/projected/f8a33c49-8efa-4756-8503-dde78571a565-kube-api-access-ncm8h\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.826765 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.826715 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8a33c49-8efa-4756-8503-dde78571a565-client-ca-bundle\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.826765 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.826739 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f8a33c49-8efa-4756-8503-dde78571a565-secret-metrics-server-tls\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.827051 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.826774 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f8a33c49-8efa-4756-8503-dde78571a565-secret-metrics-server-client-certs\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.827438 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.827099 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f8a33c49-8efa-4756-8503-dde78571a565-audit-log\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.827438 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.827326 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8a33c49-8efa-4756-8503-dde78571a565-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.827935 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.827906 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f8a33c49-8efa-4756-8503-dde78571a565-metrics-server-audit-profiles\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.829879 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.829847 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8a33c49-8efa-4756-8503-dde78571a565-client-ca-bundle\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.830009 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.829931 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f8a33c49-8efa-4756-8503-dde78571a565-secret-metrics-server-tls\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.830069 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.830032 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f8a33c49-8efa-4756-8503-dde78571a565-secret-metrics-server-client-certs\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.842737 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.842710 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncm8h\" (UniqueName: \"kubernetes.io/projected/f8a33c49-8efa-4756-8503-dde78571a565-kube-api-access-ncm8h\") pod \"metrics-server-6dbf99f75b-qw4x8\" (UID: \"f8a33c49-8efa-4756-8503-dde78571a565\") " pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.876601 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.876561 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:26.953993 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.953940 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p229n\"" Jul 28 15:15:26.961757 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.961720 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:15:26.990763 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.990682 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wplwl\"" Jul 28 15:15:26.997746 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:26.997711 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jh24b" Jul 28 15:15:27.323169 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.323099 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-b567d8f6-zjpls"] Jul 28 15:15:27.328151 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.328130 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.331401 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.331305 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hqfcb\"" Jul 28 15:15:27.331899 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.331743 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 28 15:15:27.331899 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.331797 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 28 15:15:27.331899 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.331854 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 28 15:15:27.334020 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.332551 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 28 15:15:27.334020 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.333407 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 28 15:15:27.340964 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.340940 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 28 15:15:27.344126 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.344104 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-b567d8f6-zjpls"] Jul 28 15:15:27.386893 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.386048 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6dbf99f75b-qw4x8"] Jul 28 15:15:27.392737 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:15:27.392705 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8a33c49_8efa_4756_8503_dde78571a565.slice/crio-5e679103daf0c2c130c6040b04e904ca6dfdd1e21295a26acdf8a51fd78631fc WatchSource:0}: Error finding container 5e679103daf0c2c130c6040b04e904ca6dfdd1e21295a26acdf8a51fd78631fc: Status 404 returned error can't find the container with id 5e679103daf0c2c130c6040b04e904ca6dfdd1e21295a26acdf8a51fd78631fc Jul 28 15:15:27.433065 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.433033 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc749\" (UniqueName: \"kubernetes.io/projected/8c837ef1-3620-44b6-973b-963ee1fe3d73-kube-api-access-tc749\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.433202 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.433086 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c837ef1-3620-44b6-973b-963ee1fe3d73-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.433202 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.433139 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c837ef1-3620-44b6-973b-963ee1fe3d73-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.433202 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.433157 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c837ef1-3620-44b6-973b-963ee1fe3d73-serving-certs-ca-bundle\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.433202 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.433173 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8c837ef1-3620-44b6-973b-963ee1fe3d73-secret-telemeter-client\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.433202 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.433188 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8c837ef1-3620-44b6-973b-963ee1fe3d73-federate-client-tls\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.433481 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.433249 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c837ef1-3620-44b6-973b-963ee1fe3d73-metrics-client-ca\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.433481 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.433348 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8c837ef1-3620-44b6-973b-963ee1fe3d73-telemeter-client-tls\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.533996 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.533946 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c837ef1-3620-44b6-973b-963ee1fe3d73-metrics-client-ca\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.534157 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.534025 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8c837ef1-3620-44b6-973b-963ee1fe3d73-telemeter-client-tls\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.534157 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.534052 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc749\" (UniqueName: \"kubernetes.io/projected/8c837ef1-3620-44b6-973b-963ee1fe3d73-kube-api-access-tc749\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.534272 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.534177 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c837ef1-3620-44b6-973b-963ee1fe3d73-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.534336 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.534277 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c837ef1-3620-44b6-973b-963ee1fe3d73-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.534336 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.534311 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c837ef1-3620-44b6-973b-963ee1fe3d73-serving-certs-ca-bundle\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.534440 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.534339 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8c837ef1-3620-44b6-973b-963ee1fe3d73-secret-telemeter-client\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.534440 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.534365 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8c837ef1-3620-44b6-973b-963ee1fe3d73-federate-client-tls\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.534733 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.534710 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c837ef1-3620-44b6-973b-963ee1fe3d73-metrics-client-ca\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.535034 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.535012 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c837ef1-3620-44b6-973b-963ee1fe3d73-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.535602 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.535577 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c837ef1-3620-44b6-973b-963ee1fe3d73-serving-certs-ca-bundle\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.536767 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.536741 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c837ef1-3620-44b6-973b-963ee1fe3d73-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.536890 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.536870 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8c837ef1-3620-44b6-973b-963ee1fe3d73-telemeter-client-tls\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.536959 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.536938 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8c837ef1-3620-44b6-973b-963ee1fe3d73-secret-telemeter-client\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.537171 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.537157 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8c837ef1-3620-44b6-973b-963ee1fe3d73-federate-client-tls\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.544372 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.544345 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc749\" (UniqueName: \"kubernetes.io/projected/8c837ef1-3620-44b6-973b-963ee1fe3d73-kube-api-access-tc749\") pod \"telemeter-client-b567d8f6-zjpls\" (UID: \"8c837ef1-3620-44b6-973b-963ee1fe3d73\") " pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.626733 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.626709 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jh24b"] Jul 28 15:15:27.629383 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:15:27.629328 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d4f44f_6a4d_4f50_afb9_2d1c624a2a0d.slice/crio-6ecd06c9fbc1e16fea47034fd2e2c09f90878b67f90e04cbd21889d28782cda9 WatchSource:0}: Error finding container 6ecd06c9fbc1e16fea47034fd2e2c09f90878b67f90e04cbd21889d28782cda9: Status 404 returned error can't find the container with id 6ecd06c9fbc1e16fea47034fd2e2c09f90878b67f90e04cbd21889d28782cda9 Jul 28 15:15:27.629929 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.629909 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c8cbbfdb-c4cz5"] Jul 28 15:15:27.631778 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:15:27.631751 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31df32ae_34aa_4340_bba3_ae4a626eb718.slice/crio-b47b7bf9d124c375ac80b1f47dcaef908e248d6b66f8a097a9fed7baf7f25426 WatchSource:0}: Error finding container b47b7bf9d124c375ac80b1f47dcaef908e248d6b66f8a097a9fed7baf7f25426: Status 404 returned error can't find the container with id b47b7bf9d124c375ac80b1f47dcaef908e248d6b66f8a097a9fed7baf7f25426 Jul 28 15:15:27.634857 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.634836 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6f4558d958-dj4gv"] Jul 28 15:15:27.638112 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:15:27.638092 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4d18c5_dccd_4a23_bee0_987e5aac5d93.slice/crio-cdc48cadd355666419f61d9d7da2008197278721c0766aa21e4c85f154b1796d WatchSource:0}: Error finding container cdc48cadd355666419f61d9d7da2008197278721c0766aa21e4c85f154b1796d: Status 404 returned error can't find the container with id cdc48cadd355666419f61d9d7da2008197278721c0766aa21e4c85f154b1796d Jul 28 15:15:27.685743 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.685718 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" Jul 28 15:15:27.833745 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:27.833712 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-b567d8f6-zjpls"] Jul 28 15:15:27.836910 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:15:27.836887 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c837ef1_3620_44b6_973b_963ee1fe3d73.slice/crio-f8aa4b60aa6283da88d494be51889808041ea09eb985b8cf52960871172f537d WatchSource:0}: Error finding container f8aa4b60aa6283da88d494be51889808041ea09eb985b8cf52960871172f537d: Status 404 returned error can't find the container with id f8aa4b60aa6283da88d494be51889808041ea09eb985b8cf52960871172f537d Jul 28 15:15:28.165339 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.165232 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" event={"ID":"f8a33c49-8efa-4756-8503-dde78571a565","Type":"ContainerStarted","Data":"5e679103daf0c2c130c6040b04e904ca6dfdd1e21295a26acdf8a51fd78631fc"} Jul 28 15:15:28.173775 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.173656 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w5z4f" event={"ID":"74de8c67-c520-44ba-b6a5-f40a2ba9d402","Type":"ContainerStarted","Data":"ccbff98934b0160d8ff4b43fc76b2120e5e58dca7819a8e08433b53dfbe0487f"} Jul 28 15:15:28.176303 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.176267 2560 generic.go:356] "Generic (PLEG): container finished" podID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerID="ae58b41a83bb50fe1f11f97cc8cc358193668f8c64ca93ff8276c5b232c4113b" exitCode=0 Jul 28 15:15:28.176421 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.176341 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"021a6730-0722-4f3c-bc2c-2d0e92cb3e17","Type":"ContainerDied","Data":"ae58b41a83bb50fe1f11f97cc8cc358193668f8c64ca93ff8276c5b232c4113b"} Jul 28 15:15:28.178922 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.178898 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" event={"ID":"8c837ef1-3620-44b6-973b-963ee1fe3d73","Type":"ContainerStarted","Data":"f8aa4b60aa6283da88d494be51889808041ea09eb985b8cf52960871172f537d"} Jul 28 15:15:28.180518 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.180490 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" event={"ID":"6f4d18c5-dccd-4a23-bee0-987e5aac5d93","Type":"ContainerStarted","Data":"cdc48cadd355666419f61d9d7da2008197278721c0766aa21e4c85f154b1796d"} Jul 28 15:15:28.185246 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.185148 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rfgbp" event={"ID":"c1741e78-8f3f-46c2-8afe-d861d4b931ab","Type":"ContainerStarted","Data":"70f4ac848bca490050a7f6c677cb76b1e4f878ba641364a7c3dd5b225ac39d71"} Jul 28 15:15:28.185246 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.185194 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rfgbp" event={"ID":"c1741e78-8f3f-46c2-8afe-d861d4b931ab","Type":"ContainerStarted","Data":"1e0c12f781c7ba58051cee3347ece6eec3ff534fd3c40439ad17d3616fbb5547"} Jul 28 15:15:28.188193 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.188129 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" event={"ID":"31df32ae-34aa-4340-bba3-ae4a626eb718","Type":"ContainerStarted","Data":"9433c65f727cd97269b233a6d45e38fabdcf9ec7c2a15e0c78edc0de01c607d3"} Jul 28 15:15:28.188193 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.188165 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" event={"ID":"31df32ae-34aa-4340-bba3-ae4a626eb718","Type":"ContainerStarted","Data":"b47b7bf9d124c375ac80b1f47dcaef908e248d6b66f8a097a9fed7baf7f25426"} Jul 28 15:15:28.188565 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.188407 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:15:28.191185 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.191078 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt" event={"ID":"cb725a33-317a-474c-93a1-0848f57e9f38","Type":"ContainerStarted","Data":"ab9ab5a6d14b4b588e1376e45ca612923025d8d2ac14d72444db63bd9ec76aa4"} Jul 28 15:15:28.193812 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.193788 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jh24b" event={"ID":"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d","Type":"ContainerStarted","Data":"6ecd06c9fbc1e16fea47034fd2e2c09f90878b67f90e04cbd21889d28782cda9"} Jul 28 15:15:28.259856 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.259754 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rfgbp" podStartSLOduration=5.199454102 podStartE2EDuration="6.259733934s" totalImagesPullingTime="970.251712ms" totalInitContainerRuntime="90.02812ms" isStatefulPod=true podCreationTimestamp="2026-07-28 15:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:28.258331972 +0000 UTC m=+100.913025166" watchObservedRunningTime="2026-07-28 15:15:28.259733934 +0000 UTC m=+100.914427083" Jul 28 15:15:28.298842 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.298784 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-6s7qt" podStartSLOduration=2.753757087 podStartE2EDuration="6.298762382s" totalImagesPullingTime="3.545005295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:28.296664739 +0000 UTC m=+100.951357911" watchObservedRunningTime="2026-07-28 15:15:28.298762382 +0000 UTC m=+100.953455554" Jul 28 15:15:28.457226 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.455340 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" podStartSLOduration=77.455316466 podStartE2EDuration="1m17.455316466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:14:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:28.332692027 +0000 UTC m=+100.987385199" watchObservedRunningTime="2026-07-28 15:15:28.455316466 +0000 UTC m=+101.110009639" Jul 28 15:15:28.457226 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.456048 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 15:15:28.461749 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.461727 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.471451 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.467932 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 15:15:28.471451 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.468334 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 15:15:28.471451 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.468693 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 15:15:28.471451 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.469001 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1je4mphr9n5e9\"" Jul 28 15:15:28.471451 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.470097 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 15:15:28.471451 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.470373 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 15:15:28.471451 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.470495 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 15:15:28.471451 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.470558 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 15:15:28.471451 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.470743 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 15:15:28.471451 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.470927 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n4rzm\"" Jul 28 15:15:28.471451 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.471147 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 15:15:28.471451 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.471285 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 15:15:28.473916 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.473195 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 15:15:28.473916 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.473691 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 15:15:28.474786 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.474648 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 15:15:28.477859 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.477658 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 15:15:28.495769 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.495736 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 15:15:28.646686 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.646650 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.646876 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.646715 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.646876 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.646755 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.646876 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.646785 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.646876 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.646840 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-config\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.647109 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.646910 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5e221b4-226a-4ec8-a2e2-64a58c273769-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.647109 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.646943 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.647109 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.646998 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.647109 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.647023 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.647109 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.647054 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-web-config\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.647347 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.647110 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.647347 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.647195 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.647347 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.647225 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.647347 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.647253 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.647347 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.647289 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.647347 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.647318 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.647347 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.647344 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7zxd\" (UniqueName: \"kubernetes.io/projected/b5e221b4-226a-4ec8-a2e2-64a58c273769-kube-api-access-v7zxd\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.647679 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.647375 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.647679 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.647397 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.647679 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.647441 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5e221b4-226a-4ec8-a2e2-64a58c273769-config-out\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.748904 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.748811 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5e221b4-226a-4ec8-a2e2-64a58c273769-config-out\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.748904 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.748870 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.749149 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.748918 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.749149 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.748950 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.749149 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.748993 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.749149 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.749047 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-config\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.749149 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.749079 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5e221b4-226a-4ec8-a2e2-64a58c273769-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.749149 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.749110 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.749149 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.749150 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.749488 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.749175 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.749488 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.749209 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-web-config\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.749488 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.749237 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.749488 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.749268 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.749488 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.749309 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.749488 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.749340 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.749488 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.749377 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.749488 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.749412 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.749488 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.749439 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7zxd\" (UniqueName: \"kubernetes.io/projected/b5e221b4-226a-4ec8-a2e2-64a58c273769-kube-api-access-v7zxd\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.749488 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.749470 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.749933 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.749496 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.750766 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.750617 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.750766 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.750724 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.750931 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.750860 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.753401 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.751513 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.753401 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.752455 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.753401 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.753106 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.753932 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.753618 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.757998 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.757944 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.758613 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.758291 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.758894 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.758876 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.758894 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.758889 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.759589 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.759567 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.760198 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.760158 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-web-config\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.760629 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.760588 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5e221b4-226a-4ec8-a2e2-64a58c273769-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.761657 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.761623 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5e221b4-226a-4ec8-a2e2-64a58c273769-config-out\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.762132 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.762106 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.762535 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.762509 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.763498 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.763461 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-config\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.767231 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.767158 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.769730 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.769706 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7zxd\" (UniqueName: \"kubernetes.io/projected/b5e221b4-226a-4ec8-a2e2-64a58c273769-kube-api-access-v7zxd\") pod \"prometheus-k8s-0\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:28.780806 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:28.780776 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:30.043732 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:30.043700 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vdlwj" Jul 28 15:15:33.228629 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:33.228607 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 15:15:33.285842 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:33.285762 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c8cbbfdb-c4cz5"] Jul 28 15:15:33.434716 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:15:33.434685 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e221b4_226a_4ec8_a2e2_64a58c273769.slice/crio-c1f94062579beb68ab69704e185b06737698014f7f5e2ce5e1fb316f1c054498 WatchSource:0}: Error finding container c1f94062579beb68ab69704e185b06737698014f7f5e2ce5e1fb316f1c054498: Status 404 returned error can't find the container with id c1f94062579beb68ab69704e185b06737698014f7f5e2ce5e1fb316f1c054498 Jul 28 15:15:34.224856 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:34.224822 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" event={"ID":"f8a33c49-8efa-4756-8503-dde78571a565","Type":"ContainerStarted","Data":"1c4e449d18837832419cc69bf02eed8d92ded83da2317f152f5de87291239510"} Jul 28 15:15:34.228584 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:34.228528 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w5z4f" event={"ID":"74de8c67-c520-44ba-b6a5-f40a2ba9d402","Type":"ContainerStarted","Data":"5f20dd72c4668a72bd164e76192557b3d27f906e213bc8e0c9d924f21fb23a32"} Jul 28 15:15:34.236488 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:34.236461 2560 generic.go:356] "Generic (PLEG): container finished" podID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerID="24289f69dec73e95860ca9ec2edf267921cb2ca6af5cfa175f2d341e995fe148" exitCode=0 Jul 28 15:15:34.236831 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:34.236560 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e221b4-226a-4ec8-a2e2-64a58c273769","Type":"ContainerDied","Data":"24289f69dec73e95860ca9ec2edf267921cb2ca6af5cfa175f2d341e995fe148"} Jul 28 15:15:34.236831 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:34.236649 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e221b4-226a-4ec8-a2e2-64a58c273769","Type":"ContainerStarted","Data":"c1f94062579beb68ab69704e185b06737698014f7f5e2ce5e1fb316f1c054498"} Jul 28 15:15:34.238766 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:34.238712 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"021a6730-0722-4f3c-bc2c-2d0e92cb3e17","Type":"ContainerStarted","Data":"9e3f63911e24c93e3d972ded48de10b7a0314fdaeeae57b81a307a02a352d172"} Jul 28 15:15:34.240542 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:34.240520 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" event={"ID":"8c837ef1-3620-44b6-973b-963ee1fe3d73","Type":"ContainerStarted","Data":"2359cfdad0f92a657ba1c36ca43ab761a23de4fc73c55a2a8cefa984d1662407"} Jul 28 15:15:34.241961 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:34.241936 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" event={"ID":"6f4d18c5-dccd-4a23-bee0-987e5aac5d93","Type":"ContainerStarted","Data":"545d0ab03544990e53f7cd094f259862bf7c0f1afd04f40adf1c9ead401e1e5f"} Jul 28 15:15:34.244221 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:34.244018 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jh24b" event={"ID":"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d","Type":"ContainerStarted","Data":"f5cf16ae152f3b2e56844c5575894f6b7e2ea2625de220f6db30542f3d0c1e00"} Jul 28 15:15:34.247134 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:34.246743 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" podStartSLOduration=2.550006065 podStartE2EDuration="8.246725323s" totalImagesPullingTime="5.696719258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:34.244661711 +0000 UTC m=+106.899354883" watchObservedRunningTime="2026-07-28 15:15:34.246725323 +0000 UTC m=+106.901418499" Jul 28 15:15:34.301043 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:34.300596 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w5z4f" podStartSLOduration=33.572787116 podStartE2EDuration="49.300574303s" totalImagesPullingTime="15.727787187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:14:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:34.299993664 +0000 UTC m=+106.954686828" watchObservedRunningTime="2026-07-28 15:15:34.300574303 +0000 UTC m=+106.955267476" Jul 28 15:15:35.250907 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:35.250876 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jh24b" event={"ID":"f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d","Type":"ContainerStarted","Data":"9c1925a7ac51f03ef43b01481b0b1a8ce988c6cbba3401eccd5f5497d28c1887"} Jul 28 15:15:35.251266 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:35.250987 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jh24b" Jul 28 15:15:35.253918 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:35.253893 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"021a6730-0722-4f3c-bc2c-2d0e92cb3e17","Type":"ContainerStarted","Data":"6ef0f204658f6211c840155cb590481df13fe00e480b3b971a54b824b6875f10"} Jul 28 15:15:35.254093 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:35.253947 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"021a6730-0722-4f3c-bc2c-2d0e92cb3e17","Type":"ContainerStarted","Data":"4e53ac426222f80035b9eec3768e3b5f1e8c6a91c228a787385f016f320353e9"} Jul 28 15:15:35.254093 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:35.254010 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"021a6730-0722-4f3c-bc2c-2d0e92cb3e17","Type":"ContainerStarted","Data":"1a19ee24b71c8a82fef565e2df51fb9f4db88b12303f11d0bf705b37e941cfd3"} Jul 28 15:15:35.254093 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:35.254037 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"021a6730-0722-4f3c-bc2c-2d0e92cb3e17","Type":"ContainerStarted","Data":"14663ac1615cfac1d6d2e7ea521e761fde2fb9a26f67d4a36914dd85173fbf64"} Jul 28 15:15:35.255994 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:35.255955 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" event={"ID":"8c837ef1-3620-44b6-973b-963ee1fe3d73","Type":"ContainerStarted","Data":"37f2578eedc2380315c781108d0ca99125e2df9999cf9b43b4814d688a2bde32"} Jul 28 15:15:35.256087 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:35.256023 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" event={"ID":"8c837ef1-3620-44b6-973b-963ee1fe3d73","Type":"ContainerStarted","Data":"9f414458b8ab883beae2e0416a14dad574fd82f4fc45e113162ef4e6b0d0e5ab"} Jul 28 15:15:35.258070 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:35.258045 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" event={"ID":"6f4d18c5-dccd-4a23-bee0-987e5aac5d93","Type":"ContainerStarted","Data":"6de4bd2c5373eab0c0d41477243a12ef564918e555d28753d67e7b2640667c44"} Jul 28 15:15:35.258140 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:35.258117 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" event={"ID":"6f4d18c5-dccd-4a23-bee0-987e5aac5d93","Type":"ContainerStarted","Data":"77359771679e1193a961abeb3ecaf736105ab848d921564ccf068fc32574df09"} Jul 28 15:15:35.271719 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:35.271684 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jh24b" podStartSLOduration=66.91371653 podStartE2EDuration="1m13.271672763s" totalImagesPullingTime="6.357956233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:35.271476379 +0000 UTC m=+107.926169623" watchObservedRunningTime="2026-07-28 15:15:35.271672763 +0000 UTC m=+107.926365935" Jul 28 15:15:35.298300 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:35.298267 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-b567d8f6-zjpls" podStartSLOduration=2.148317367 podStartE2EDuration="8.298252205s" totalImagesPullingTime="6.149934838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:35.296942325 +0000 UTC m=+107.951635497" watchObservedRunningTime="2026-07-28 15:15:35.298252205 +0000 UTC m=+107.952945376" Jul 28 15:15:36.267733 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:36.267631 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" event={"ID":"6f4d18c5-dccd-4a23-bee0-987e5aac5d93","Type":"ContainerStarted","Data":"2e7c31281f7cbe635a63d28ff54c0b990f5df28a70cb404afcab56fd12c072e6"} Jul 28 15:15:36.267733 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:36.267718 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" event={"ID":"6f4d18c5-dccd-4a23-bee0-987e5aac5d93","Type":"ContainerStarted","Data":"35a16eee231ea8caa0bc27d9b4a3c126b13d093a91dd89000cc4225cc604dbc8"} Jul 28 15:15:36.268269 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:36.267757 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" event={"ID":"6f4d18c5-dccd-4a23-bee0-987e5aac5d93","Type":"ContainerStarted","Data":"f09bc4d5b9b4db692ac9ebbd693b6407aec9ce4d81242a679cb29ca8222eafdc"} Jul 28 15:15:36.268269 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:36.268102 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:36.296798 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:36.296733 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" podStartSLOduration=3.037086321 podStartE2EDuration="10.296713379s" totalImagesPullingTime="7.259627058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:15:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:36.295219702 +0000 UTC m=+108.949912875" watchObservedRunningTime="2026-07-28 15:15:36.296713379 +0000 UTC m=+108.951406552" Jul 28 15:15:36.723355 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:36.723317 2560 scope.go:117] "RemoveContainer" containerID="28241afcd10b4eb82afc54ca8a954a32e90cddd62bdeb4a5ff9aa22cfdbf6a94" Jul 28 15:15:37.275763 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:37.275719 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"021a6730-0722-4f3c-bc2c-2d0e92cb3e17","Type":"ContainerStarted","Data":"b626d92e4d2b37b07b8de9ac6a5d852e1334e6c69a4c22a0d719cf6eb973705e"} Jul 28 15:15:37.277677 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:37.277652 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/2.log" Jul 28 15:15:37.277807 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:37.277713 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" event={"ID":"20a5b722-f707-4df1-af7e-c0d0b690bc29","Type":"ContainerStarted","Data":"908dfe5d60684dfdd5da9bdac5d9e8fe3a5ec9dcb73ad1ea5c4d292dee600d2f"} Jul 28 15:15:37.378165 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:37.378100 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.863181141 podStartE2EDuration="14.378078327s" totalImagesPullingTime="10.495607256s" totalInitContainerRuntime="19.28993ms" isStatefulPod=false podCreationTimestamp="2026-07-28 15:15:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:37.341519542 +0000 UTC m=+109.996212715" watchObservedRunningTime="2026-07-28 15:15:37.378078327 +0000 UTC m=+110.032771499" Jul 28 15:15:37.378657 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:37.378614 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" podStartSLOduration=55.647540885 podStartE2EDuration="58.378601445s" totalImagesPullingTime="2.73106056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:37.376420578 +0000 UTC m=+110.031113752" watchObservedRunningTime="2026-07-28 15:15:37.378601445 +0000 UTC m=+110.033294618" Jul 28 15:15:39.289612 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:39.289577 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e221b4-226a-4ec8-a2e2-64a58c273769","Type":"ContainerStarted","Data":"6a44dcc1706058a83aea73be1e503782df6f8310111b48d724d4398628e420f1"} Jul 28 15:15:39.290060 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:39.289645 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e221b4-226a-4ec8-a2e2-64a58c273769","Type":"ContainerStarted","Data":"976058e914300777e352281ed027f7f11512d4350b264f65746769e42c935790"} Jul 28 15:15:39.290060 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:39.289678 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e221b4-226a-4ec8-a2e2-64a58c273769","Type":"ContainerStarted","Data":"314e95cdb3351efbb29660920211779fd448fb7dd8782f52cf23ffb522c9882d"} Jul 28 15:15:39.290060 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:39.289702 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e221b4-226a-4ec8-a2e2-64a58c273769","Type":"ContainerStarted","Data":"2ed591241f1e86d6d73b897abb16659752e80f849ea1cab0f878b6e7034c8c2a"} Jul 28 15:15:39.290060 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:39.289731 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e221b4-226a-4ec8-a2e2-64a58c273769","Type":"ContainerStarted","Data":"f21e55758aeb9b7cc5b7dc3a3b39f6cfb482b7da02a442dfd7a993f4685fb0bd"} Jul 28 15:15:39.290060 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:39.289763 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e221b4-226a-4ec8-a2e2-64a58c273769","Type":"ContainerStarted","Data":"805e8e215b0950101622ac20c7c3117b70c8fdae198c41c2d45c9837184af852"} Jul 28 15:15:39.327929 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:39.327829 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.718276511 podStartE2EDuration="11.327812369s" totalImagesPullingTime="4.555053711s" totalInitContainerRuntime="54.482147ms" isStatefulPod=false podCreationTimestamp="2026-07-28 15:15:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:39.326791523 +0000 UTC m=+111.981484694" watchObservedRunningTime="2026-07-28 15:15:39.327812369 +0000 UTC m=+111.982505539" Jul 28 15:15:42.284426 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:42.284399 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6f4558d958-dj4gv" Jul 28 15:15:43.291992 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:43.291946 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:15:43.781779 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:43.781746 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:15:45.269984 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:45.269955 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jh24b" Jul 28 15:15:46.877060 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:46.877028 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:46.877425 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:46.877079 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:15:47.278362 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:47.278329 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" Jul 28 15:15:47.282160 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:47.282134 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-4xs9h" Jul 28 15:15:57.522531 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:57.522494 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs\") pod \"network-metrics-daemon-hlzj8\" (UID: \"4341eeac-de67-4bab-81c8-d2f8c62c677c\") " pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:15:57.524756 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:57.524736 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4341eeac-de67-4bab-81c8-d2f8c62c677c-metrics-certs\") pod \"network-metrics-daemon-hlzj8\" (UID: \"4341eeac-de67-4bab-81c8-d2f8c62c677c\") " pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:15:57.642252 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:57.642227 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zdqjt\"" Jul 28 15:15:57.649472 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:57.649448 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hlzj8" Jul 28 15:15:57.956866 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:57.956721 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hlzj8"] Jul 28 15:15:57.959427 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:15:57.959399 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4341eeac_de67_4bab_81c8_d2f8c62c677c.slice/crio-6f152f841400a02ecd0bcf4fd3d64108abb55c194397d8cffd6942bc1bab4660 WatchSource:0}: Error finding container 6f152f841400a02ecd0bcf4fd3d64108abb55c194397d8cffd6942bc1bab4660: Status 404 returned error can't find the container with id 6f152f841400a02ecd0bcf4fd3d64108abb55c194397d8cffd6942bc1bab4660 Jul 28 15:15:58.307297 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.307262 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" podUID="31df32ae-34aa-4340-bba3-ae4a626eb718" containerName="registry" containerID="cri-o://9433c65f727cd97269b233a6d45e38fabdcf9ec7c2a15e0c78edc0de01c607d3" gracePeriod=30 Jul 28 15:15:58.372443 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.372415 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hlzj8" event={"ID":"4341eeac-de67-4bab-81c8-d2f8c62c677c","Type":"ContainerStarted","Data":"6f152f841400a02ecd0bcf4fd3d64108abb55c194397d8cffd6942bc1bab4660"} Jul 28 15:15:58.574508 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.574445 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:15:58.731667 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.731635 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls\") pod \"31df32ae-34aa-4340-bba3-ae4a626eb718\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " Jul 28 15:15:58.731852 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.731675 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31df32ae-34aa-4340-bba3-ae4a626eb718-trusted-ca\") pod \"31df32ae-34aa-4340-bba3-ae4a626eb718\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " Jul 28 15:15:58.731852 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.731718 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-certificates\") pod \"31df32ae-34aa-4340-bba3-ae4a626eb718\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " Jul 28 15:15:58.731852 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.731825 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lp8rk\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-kube-api-access-lp8rk\") pod \"31df32ae-34aa-4340-bba3-ae4a626eb718\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " Jul 28 15:15:58.732059 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.731865 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31df32ae-34aa-4340-bba3-ae4a626eb718-image-registry-private-configuration\") pod \"31df32ae-34aa-4340-bba3-ae4a626eb718\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " Jul 28 15:15:58.732059 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.731888 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-bound-sa-token\") pod \"31df32ae-34aa-4340-bba3-ae4a626eb718\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " Jul 28 15:15:58.732059 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.731936 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31df32ae-34aa-4340-bba3-ae4a626eb718-ca-trust-extracted\") pod \"31df32ae-34aa-4340-bba3-ae4a626eb718\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " Jul 28 15:15:58.732059 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.732022 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31df32ae-34aa-4340-bba3-ae4a626eb718-installation-pull-secrets\") pod \"31df32ae-34aa-4340-bba3-ae4a626eb718\" (UID: \"31df32ae-34aa-4340-bba3-ae4a626eb718\") " Jul 28 15:15:58.732251 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.732127 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "31df32ae-34aa-4340-bba3-ae4a626eb718" (UID: "31df32ae-34aa-4340-bba3-ae4a626eb718"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 15:15:58.732251 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.732196 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31df32ae-34aa-4340-bba3-ae4a626eb718-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "31df32ae-34aa-4340-bba3-ae4a626eb718" (UID: "31df32ae-34aa-4340-bba3-ae4a626eb718"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 15:15:58.732366 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.732337 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31df32ae-34aa-4340-bba3-ae4a626eb718-trusted-ca\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:15:58.732366 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.732359 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-certificates\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:15:58.734173 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.734142 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "31df32ae-34aa-4340-bba3-ae4a626eb718" (UID: "31df32ae-34aa-4340-bba3-ae4a626eb718"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 15:15:58.734337 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.734314 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31df32ae-34aa-4340-bba3-ae4a626eb718-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "31df32ae-34aa-4340-bba3-ae4a626eb718" (UID: "31df32ae-34aa-4340-bba3-ae4a626eb718"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:15:58.734442 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.734406 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-kube-api-access-lp8rk" (OuterVolumeSpecName: "kube-api-access-lp8rk") pod "31df32ae-34aa-4340-bba3-ae4a626eb718" (UID: "31df32ae-34aa-4340-bba3-ae4a626eb718"). InnerVolumeSpecName "kube-api-access-lp8rk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 15:15:58.734578 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.734545 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31df32ae-34aa-4340-bba3-ae4a626eb718-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "31df32ae-34aa-4340-bba3-ae4a626eb718" (UID: "31df32ae-34aa-4340-bba3-ae4a626eb718"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:15:58.734700 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.734672 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "31df32ae-34aa-4340-bba3-ae4a626eb718" (UID: "31df32ae-34aa-4340-bba3-ae4a626eb718"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 15:15:58.741190 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.741166 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31df32ae-34aa-4340-bba3-ae4a626eb718-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "31df32ae-34aa-4340-bba3-ae4a626eb718" (UID: "31df32ae-34aa-4340-bba3-ae4a626eb718"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 15:15:58.833155 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.833099 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lp8rk\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-kube-api-access-lp8rk\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:15:58.833155 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.833121 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31df32ae-34aa-4340-bba3-ae4a626eb718-image-registry-private-configuration\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:15:58.833155 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.833133 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-bound-sa-token\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:15:58.833155 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.833143 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31df32ae-34aa-4340-bba3-ae4a626eb718-ca-trust-extracted\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:15:58.833155 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.833151 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31df32ae-34aa-4340-bba3-ae4a626eb718-installation-pull-secrets\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:15:58.833155 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:58.833160 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31df32ae-34aa-4340-bba3-ae4a626eb718-registry-tls\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:15:59.377883 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:59.377852 2560 generic.go:356] "Generic (PLEG): container finished" podID="31df32ae-34aa-4340-bba3-ae4a626eb718" containerID="9433c65f727cd97269b233a6d45e38fabdcf9ec7c2a15e0c78edc0de01c607d3" exitCode=0 Jul 28 15:15:59.378128 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:59.377901 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" Jul 28 15:15:59.378128 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:59.377936 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" event={"ID":"31df32ae-34aa-4340-bba3-ae4a626eb718","Type":"ContainerDied","Data":"9433c65f727cd97269b233a6d45e38fabdcf9ec7c2a15e0c78edc0de01c607d3"} Jul 28 15:15:59.378128 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:59.378014 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c8cbbfdb-c4cz5" event={"ID":"31df32ae-34aa-4340-bba3-ae4a626eb718","Type":"ContainerDied","Data":"b47b7bf9d124c375ac80b1f47dcaef908e248d6b66f8a097a9fed7baf7f25426"} Jul 28 15:15:59.378128 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:59.378044 2560 scope.go:117] "RemoveContainer" containerID="9433c65f727cd97269b233a6d45e38fabdcf9ec7c2a15e0c78edc0de01c607d3" Jul 28 15:15:59.391114 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:59.391095 2560 scope.go:117] "RemoveContainer" containerID="9433c65f727cd97269b233a6d45e38fabdcf9ec7c2a15e0c78edc0de01c607d3" Jul 28 15:15:59.391356 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:15:59.391336 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9433c65f727cd97269b233a6d45e38fabdcf9ec7c2a15e0c78edc0de01c607d3\": container with ID starting with 9433c65f727cd97269b233a6d45e38fabdcf9ec7c2a15e0c78edc0de01c607d3 not found: ID does not exist" containerID="9433c65f727cd97269b233a6d45e38fabdcf9ec7c2a15e0c78edc0de01c607d3" Jul 28 15:15:59.391420 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:59.391364 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9433c65f727cd97269b233a6d45e38fabdcf9ec7c2a15e0c78edc0de01c607d3"} err="failed to get container status \"9433c65f727cd97269b233a6d45e38fabdcf9ec7c2a15e0c78edc0de01c607d3\": rpc error: code = NotFound desc = could not find container \"9433c65f727cd97269b233a6d45e38fabdcf9ec7c2a15e0c78edc0de01c607d3\": container with ID starting with 9433c65f727cd97269b233a6d45e38fabdcf9ec7c2a15e0c78edc0de01c607d3 not found: ID does not exist" Jul 28 15:15:59.403898 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:59.403874 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c8cbbfdb-c4cz5"] Jul 28 15:15:59.407845 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:59.407826 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c8cbbfdb-c4cz5"] Jul 28 15:15:59.728476 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:15:59.728448 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31df32ae-34aa-4340-bba3-ae4a626eb718" path="/var/lib/kubelet/pods/31df32ae-34aa-4340-bba3-ae4a626eb718/volumes" Jul 28 15:16:01.388703 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:01.388664 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hlzj8" event={"ID":"4341eeac-de67-4bab-81c8-d2f8c62c677c","Type":"ContainerStarted","Data":"415fe3885179e14d15134916be01db0ea4c86a9d102f661891a518770123a843"} Jul 28 15:16:01.389197 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:01.388729 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hlzj8" event={"ID":"4341eeac-de67-4bab-81c8-d2f8c62c677c","Type":"ContainerStarted","Data":"4f915962631e6f6becde6a1b882948a135f3bffead81b06494632c29c86a4f66"} Jul 28 15:16:01.407629 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:01.407569 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hlzj8" podStartSLOduration=130.723205058 podStartE2EDuration="2m13.407551461s" totalImagesPullingTime="2.684346403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:16:01.407383912 +0000 UTC m=+134.062077083" watchObservedRunningTime="2026-07-28 15:16:01.407551461 +0000 UTC m=+134.062244634" Jul 28 15:16:06.882911 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:06.882883 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:16:06.886740 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:06.886716 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6dbf99f75b-qw4x8" Jul 28 15:16:08.417547 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:08.417512 2560 generic.go:356] "Generic (PLEG): container finished" podID="f19fccd4-56c7-40d9-8bbf-bf6bccbf7281" containerID="db197b98cffa37b1fd13c63d3b9d41b4bd2ab249ad3a0d38aeeb6c6ef90c123f" exitCode=0 Jul 28 15:16:08.417962 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:08.417586 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl" event={"ID":"f19fccd4-56c7-40d9-8bbf-bf6bccbf7281","Type":"ContainerDied","Data":"db197b98cffa37b1fd13c63d3b9d41b4bd2ab249ad3a0d38aeeb6c6ef90c123f"} Jul 28 15:16:08.417962 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:08.417911 2560 scope.go:117] "RemoveContainer" containerID="db197b98cffa37b1fd13c63d3b9d41b4bd2ab249ad3a0d38aeeb6c6ef90c123f" Jul 28 15:16:09.423742 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:09.423703 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl" event={"ID":"f19fccd4-56c7-40d9-8bbf-bf6bccbf7281","Type":"ContainerStarted","Data":"53495cbf295223bcd2caf4ac163a01e81cf72a71050ee66b5e8b27b031083f72"} Jul 28 15:16:11.868850 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:11.868802 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d574s_3d778963-6cf3-4bdb-9c24-7873936333a2/serve-healthcheck-canary/0.log" Jul 28 15:16:28.781704 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:28.781661 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:28.799820 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:28.799798 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:29.528479 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:29.528446 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:42.606649 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:42.606620 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 15:16:42.607177 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:42.606876 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="alertmanager" containerID="cri-o://9e3f63911e24c93e3d972ded48de10b7a0314fdaeeae57b81a307a02a352d172" gracePeriod=120 Jul 28 15:16:42.607177 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:42.606914 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="kube-rbac-proxy-web" containerID="cri-o://1a19ee24b71c8a82fef565e2df51fb9f4db88b12303f11d0bf705b37e941cfd3" gracePeriod=120 Jul 28 15:16:42.607177 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:42.606903 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="kube-rbac-proxy-metric" containerID="cri-o://6ef0f204658f6211c840155cb590481df13fe00e480b3b971a54b824b6875f10" gracePeriod=120 Jul 28 15:16:42.607177 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:42.606938 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="kube-rbac-proxy" containerID="cri-o://4e53ac426222f80035b9eec3768e3b5f1e8c6a91c228a787385f016f320353e9" gracePeriod=120 Jul 28 15:16:42.607177 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:42.606918 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="config-reloader" containerID="cri-o://14663ac1615cfac1d6d2e7ea521e761fde2fb9a26f67d4a36914dd85173fbf64" gracePeriod=120 Jul 28 15:16:42.607177 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:42.606939 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="prom-label-proxy" containerID="cri-o://b626d92e4d2b37b07b8de9ac6a5d852e1334e6c69a4c22a0d719cf6eb973705e" gracePeriod=120 Jul 28 15:16:43.574576 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:43.574544 2560 generic.go:356] "Generic (PLEG): container finished" podID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerID="b626d92e4d2b37b07b8de9ac6a5d852e1334e6c69a4c22a0d719cf6eb973705e" exitCode=0 Jul 28 15:16:43.574576 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:43.574573 2560 generic.go:356] "Generic (PLEG): container finished" podID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerID="6ef0f204658f6211c840155cb590481df13fe00e480b3b971a54b824b6875f10" exitCode=0 Jul 28 15:16:43.574576 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:43.574579 2560 generic.go:356] "Generic (PLEG): container finished" podID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerID="4e53ac426222f80035b9eec3768e3b5f1e8c6a91c228a787385f016f320353e9" exitCode=0 Jul 28 15:16:43.574576 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:43.574585 2560 generic.go:356] "Generic (PLEG): container finished" podID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerID="14663ac1615cfac1d6d2e7ea521e761fde2fb9a26f67d4a36914dd85173fbf64" exitCode=0 Jul 28 15:16:43.574831 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:43.574591 2560 generic.go:356] "Generic (PLEG): container finished" podID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerID="9e3f63911e24c93e3d972ded48de10b7a0314fdaeeae57b81a307a02a352d172" exitCode=0 Jul 28 15:16:43.574831 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:43.574607 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"021a6730-0722-4f3c-bc2c-2d0e92cb3e17","Type":"ContainerDied","Data":"b626d92e4d2b37b07b8de9ac6a5d852e1334e6c69a4c22a0d719cf6eb973705e"} Jul 28 15:16:43.574831 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:43.574693 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"021a6730-0722-4f3c-bc2c-2d0e92cb3e17","Type":"ContainerDied","Data":"6ef0f204658f6211c840155cb590481df13fe00e480b3b971a54b824b6875f10"} Jul 28 15:16:43.574831 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:43.574721 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"021a6730-0722-4f3c-bc2c-2d0e92cb3e17","Type":"ContainerDied","Data":"4e53ac426222f80035b9eec3768e3b5f1e8c6a91c228a787385f016f320353e9"} Jul 28 15:16:43.574831 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:43.574748 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"021a6730-0722-4f3c-bc2c-2d0e92cb3e17","Type":"ContainerDied","Data":"14663ac1615cfac1d6d2e7ea521e761fde2fb9a26f67d4a36914dd85173fbf64"} Jul 28 15:16:43.574831 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:43.574772 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"021a6730-0722-4f3c-bc2c-2d0e92cb3e17","Type":"ContainerDied","Data":"9e3f63911e24c93e3d972ded48de10b7a0314fdaeeae57b81a307a02a352d172"} Jul 28 15:16:43.850841 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:43.850819 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.007634 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.007604 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-config-volume\") pod \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " Jul 28 15:16:44.007634 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.007642 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-tls-assets\") pod \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " Jul 28 15:16:44.007885 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.007672 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jt42m\" (UniqueName: \"kubernetes.io/projected/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-kube-api-access-jt42m\") pod \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " Jul 28 15:16:44.007885 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.007692 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-kube-rbac-proxy\") pod \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " Jul 28 15:16:44.007885 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.007712 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-web-config\") pod \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " Jul 28 15:16:44.007885 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.007739 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-main-tls\") pod \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " Jul 28 15:16:44.007885 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.007767 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-cluster-tls-config\") pod \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " Jul 28 15:16:44.007885 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.007794 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-kube-rbac-proxy-web\") pod \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " Jul 28 15:16:44.007885 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.007829 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-alertmanager-main-db\") pod \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " Jul 28 15:16:44.007885 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.007869 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-kube-rbac-proxy-metric\") pod \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " Jul 28 15:16:44.008312 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.007894 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-config-out\") pod \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " Jul 28 15:16:44.008312 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.007920 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-metrics-client-ca\") pod \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " Jul 28 15:16:44.008312 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.007952 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-alertmanager-trusted-ca-bundle\") pod \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\" (UID: \"021a6730-0722-4f3c-bc2c-2d0e92cb3e17\") " Jul 28 15:16:44.008876 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.008591 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "021a6730-0722-4f3c-bc2c-2d0e92cb3e17" (UID: "021a6730-0722-4f3c-bc2c-2d0e92cb3e17"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 15:16:44.010432 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.010405 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-config-volume" (OuterVolumeSpecName: "config-volume") pod "021a6730-0722-4f3c-bc2c-2d0e92cb3e17" (UID: "021a6730-0722-4f3c-bc2c-2d0e92cb3e17"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:16:44.010599 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.010577 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-kube-api-access-jt42m" (OuterVolumeSpecName: "kube-api-access-jt42m") pod "021a6730-0722-4f3c-bc2c-2d0e92cb3e17" (UID: "021a6730-0722-4f3c-bc2c-2d0e92cb3e17"). InnerVolumeSpecName "kube-api-access-jt42m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 15:16:44.011087 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.011060 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "021a6730-0722-4f3c-bc2c-2d0e92cb3e17" (UID: "021a6730-0722-4f3c-bc2c-2d0e92cb3e17"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 15:16:44.011087 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.011073 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "021a6730-0722-4f3c-bc2c-2d0e92cb3e17" (UID: "021a6730-0722-4f3c-bc2c-2d0e92cb3e17"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:16:44.011246 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.011099 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "021a6730-0722-4f3c-bc2c-2d0e92cb3e17" (UID: "021a6730-0722-4f3c-bc2c-2d0e92cb3e17"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:16:44.011367 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.011346 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "021a6730-0722-4f3c-bc2c-2d0e92cb3e17" (UID: "021a6730-0722-4f3c-bc2c-2d0e92cb3e17"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 15:16:44.011440 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.011375 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "021a6730-0722-4f3c-bc2c-2d0e92cb3e17" (UID: "021a6730-0722-4f3c-bc2c-2d0e92cb3e17"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 15:16:44.011504 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.011443 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "021a6730-0722-4f3c-bc2c-2d0e92cb3e17" (UID: "021a6730-0722-4f3c-bc2c-2d0e92cb3e17"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:16:44.011646 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.011629 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-config-out" (OuterVolumeSpecName: "config-out") pod "021a6730-0722-4f3c-bc2c-2d0e92cb3e17" (UID: "021a6730-0722-4f3c-bc2c-2d0e92cb3e17"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 15:16:44.012538 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.012510 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "021a6730-0722-4f3c-bc2c-2d0e92cb3e17" (UID: "021a6730-0722-4f3c-bc2c-2d0e92cb3e17"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:16:44.014758 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.014732 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "021a6730-0722-4f3c-bc2c-2d0e92cb3e17" (UID: "021a6730-0722-4f3c-bc2c-2d0e92cb3e17"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:16:44.024263 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.024243 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-web-config" (OuterVolumeSpecName: "web-config") pod "021a6730-0722-4f3c-bc2c-2d0e92cb3e17" (UID: "021a6730-0722-4f3c-bc2c-2d0e92cb3e17"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:16:44.109596 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.109543 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-tls-assets\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:44.109596 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.109566 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jt42m\" (UniqueName: \"kubernetes.io/projected/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-kube-api-access-jt42m\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:44.109596 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.109578 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:44.109596 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.109587 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-web-config\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:44.109596 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.109596 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-main-tls\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:44.109800 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.109605 2560 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-cluster-tls-config\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:44.109800 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.109614 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:44.109800 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.109622 2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-alertmanager-main-db\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:44.109800 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.109630 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:44.109800 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.109639 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-config-out\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:44.109800 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.109646 2560 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-metrics-client-ca\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:44.109800 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.109654 2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:44.109800 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.109663 2560 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/021a6730-0722-4f3c-bc2c-2d0e92cb3e17-config-volume\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:44.581819 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.581790 2560 generic.go:356] "Generic (PLEG): container finished" podID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerID="1a19ee24b71c8a82fef565e2df51fb9f4db88b12303f11d0bf705b37e941cfd3" exitCode=0 Jul 28 15:16:44.581990 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.581834 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"021a6730-0722-4f3c-bc2c-2d0e92cb3e17","Type":"ContainerDied","Data":"1a19ee24b71c8a82fef565e2df51fb9f4db88b12303f11d0bf705b37e941cfd3"} Jul 28 15:16:44.581990 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.581868 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.581990 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.581890 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"021a6730-0722-4f3c-bc2c-2d0e92cb3e17","Type":"ContainerDied","Data":"68c700364732807d21936fb153e6dffa38618a88b71a7fbb8f6c17ba50f3d1c8"} Jul 28 15:16:44.581990 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.581929 2560 scope.go:117] "RemoveContainer" containerID="b626d92e4d2b37b07b8de9ac6a5d852e1334e6c69a4c22a0d719cf6eb973705e" Jul 28 15:16:44.589908 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.589815 2560 scope.go:117] "RemoveContainer" containerID="6ef0f204658f6211c840155cb590481df13fe00e480b3b971a54b824b6875f10" Jul 28 15:16:44.597077 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.597056 2560 scope.go:117] "RemoveContainer" containerID="4e53ac426222f80035b9eec3768e3b5f1e8c6a91c228a787385f016f320353e9" Jul 28 15:16:44.603532 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.603518 2560 scope.go:117] "RemoveContainer" containerID="1a19ee24b71c8a82fef565e2df51fb9f4db88b12303f11d0bf705b37e941cfd3" Jul 28 15:16:44.608599 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.608573 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 15:16:44.610856 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.610842 2560 scope.go:117] "RemoveContainer" containerID="14663ac1615cfac1d6d2e7ea521e761fde2fb9a26f67d4a36914dd85173fbf64" Jul 28 15:16:44.616110 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.616091 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 15:16:44.618415 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.618393 2560 scope.go:117] "RemoveContainer" containerID="9e3f63911e24c93e3d972ded48de10b7a0314fdaeeae57b81a307a02a352d172" Jul 28 15:16:44.625199 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.625184 2560 scope.go:117] "RemoveContainer" containerID="ae58b41a83bb50fe1f11f97cc8cc358193668f8c64ca93ff8276c5b232c4113b" Jul 28 15:16:44.631792 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.631777 2560 scope.go:117] "RemoveContainer" containerID="b626d92e4d2b37b07b8de9ac6a5d852e1334e6c69a4c22a0d719cf6eb973705e" Jul 28 15:16:44.632052 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:16:44.632035 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b626d92e4d2b37b07b8de9ac6a5d852e1334e6c69a4c22a0d719cf6eb973705e\": container with ID starting with b626d92e4d2b37b07b8de9ac6a5d852e1334e6c69a4c22a0d719cf6eb973705e not found: ID does not exist" containerID="b626d92e4d2b37b07b8de9ac6a5d852e1334e6c69a4c22a0d719cf6eb973705e" Jul 28 15:16:44.632116 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.632062 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b626d92e4d2b37b07b8de9ac6a5d852e1334e6c69a4c22a0d719cf6eb973705e"} err="failed to get container status \"b626d92e4d2b37b07b8de9ac6a5d852e1334e6c69a4c22a0d719cf6eb973705e\": rpc error: code = NotFound desc = could not find container \"b626d92e4d2b37b07b8de9ac6a5d852e1334e6c69a4c22a0d719cf6eb973705e\": container with ID starting with b626d92e4d2b37b07b8de9ac6a5d852e1334e6c69a4c22a0d719cf6eb973705e not found: ID does not exist" Jul 28 15:16:44.632116 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.632087 2560 scope.go:117] "RemoveContainer" containerID="6ef0f204658f6211c840155cb590481df13fe00e480b3b971a54b824b6875f10" Jul 28 15:16:44.632328 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:16:44.632312 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ef0f204658f6211c840155cb590481df13fe00e480b3b971a54b824b6875f10\": container with ID starting with 6ef0f204658f6211c840155cb590481df13fe00e480b3b971a54b824b6875f10 not found: ID does not exist" containerID="6ef0f204658f6211c840155cb590481df13fe00e480b3b971a54b824b6875f10" Jul 28 15:16:44.632366 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.632336 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef0f204658f6211c840155cb590481df13fe00e480b3b971a54b824b6875f10"} err="failed to get container status \"6ef0f204658f6211c840155cb590481df13fe00e480b3b971a54b824b6875f10\": rpc error: code = NotFound desc = could not find container \"6ef0f204658f6211c840155cb590481df13fe00e480b3b971a54b824b6875f10\": container with ID starting with 6ef0f204658f6211c840155cb590481df13fe00e480b3b971a54b824b6875f10 not found: ID does not exist" Jul 28 15:16:44.632366 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.632352 2560 scope.go:117] "RemoveContainer" containerID="4e53ac426222f80035b9eec3768e3b5f1e8c6a91c228a787385f016f320353e9" Jul 28 15:16:44.632592 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:16:44.632574 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e53ac426222f80035b9eec3768e3b5f1e8c6a91c228a787385f016f320353e9\": container with ID starting with 4e53ac426222f80035b9eec3768e3b5f1e8c6a91c228a787385f016f320353e9 not found: ID does not exist" containerID="4e53ac426222f80035b9eec3768e3b5f1e8c6a91c228a787385f016f320353e9" Jul 28 15:16:44.632654 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.632599 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e53ac426222f80035b9eec3768e3b5f1e8c6a91c228a787385f016f320353e9"} err="failed to get container status \"4e53ac426222f80035b9eec3768e3b5f1e8c6a91c228a787385f016f320353e9\": rpc error: code = NotFound desc = could not find container \"4e53ac426222f80035b9eec3768e3b5f1e8c6a91c228a787385f016f320353e9\": container with ID starting with 4e53ac426222f80035b9eec3768e3b5f1e8c6a91c228a787385f016f320353e9 not found: ID does not exist" Jul 28 15:16:44.632654 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.632619 2560 scope.go:117] "RemoveContainer" containerID="1a19ee24b71c8a82fef565e2df51fb9f4db88b12303f11d0bf705b37e941cfd3" Jul 28 15:16:44.632855 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:16:44.632837 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a19ee24b71c8a82fef565e2df51fb9f4db88b12303f11d0bf705b37e941cfd3\": container with ID starting with 1a19ee24b71c8a82fef565e2df51fb9f4db88b12303f11d0bf705b37e941cfd3 not found: ID does not exist" containerID="1a19ee24b71c8a82fef565e2df51fb9f4db88b12303f11d0bf705b37e941cfd3" Jul 28 15:16:44.632894 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.632859 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a19ee24b71c8a82fef565e2df51fb9f4db88b12303f11d0bf705b37e941cfd3"} err="failed to get container status \"1a19ee24b71c8a82fef565e2df51fb9f4db88b12303f11d0bf705b37e941cfd3\": rpc error: code = NotFound desc = could not find container \"1a19ee24b71c8a82fef565e2df51fb9f4db88b12303f11d0bf705b37e941cfd3\": container with ID starting with 1a19ee24b71c8a82fef565e2df51fb9f4db88b12303f11d0bf705b37e941cfd3 not found: ID does not exist" Jul 28 15:16:44.632894 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.632873 2560 scope.go:117] "RemoveContainer" containerID="14663ac1615cfac1d6d2e7ea521e761fde2fb9a26f67d4a36914dd85173fbf64" Jul 28 15:16:44.633123 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:16:44.633109 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14663ac1615cfac1d6d2e7ea521e761fde2fb9a26f67d4a36914dd85173fbf64\": container with ID starting with 14663ac1615cfac1d6d2e7ea521e761fde2fb9a26f67d4a36914dd85173fbf64 not found: ID does not exist" containerID="14663ac1615cfac1d6d2e7ea521e761fde2fb9a26f67d4a36914dd85173fbf64" Jul 28 15:16:44.633161 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.633125 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14663ac1615cfac1d6d2e7ea521e761fde2fb9a26f67d4a36914dd85173fbf64"} err="failed to get container status \"14663ac1615cfac1d6d2e7ea521e761fde2fb9a26f67d4a36914dd85173fbf64\": rpc error: code = NotFound desc = could not find container \"14663ac1615cfac1d6d2e7ea521e761fde2fb9a26f67d4a36914dd85173fbf64\": container with ID starting with 14663ac1615cfac1d6d2e7ea521e761fde2fb9a26f67d4a36914dd85173fbf64 not found: ID does not exist" Jul 28 15:16:44.633161 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.633137 2560 scope.go:117] "RemoveContainer" containerID="9e3f63911e24c93e3d972ded48de10b7a0314fdaeeae57b81a307a02a352d172" Jul 28 15:16:44.633336 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:16:44.633312 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e3f63911e24c93e3d972ded48de10b7a0314fdaeeae57b81a307a02a352d172\": container with ID starting with 9e3f63911e24c93e3d972ded48de10b7a0314fdaeeae57b81a307a02a352d172 not found: ID does not exist" containerID="9e3f63911e24c93e3d972ded48de10b7a0314fdaeeae57b81a307a02a352d172" Jul 28 15:16:44.633400 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.633344 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e3f63911e24c93e3d972ded48de10b7a0314fdaeeae57b81a307a02a352d172"} err="failed to get container status \"9e3f63911e24c93e3d972ded48de10b7a0314fdaeeae57b81a307a02a352d172\": rpc error: code = NotFound desc = could not find container \"9e3f63911e24c93e3d972ded48de10b7a0314fdaeeae57b81a307a02a352d172\": container with ID starting with 9e3f63911e24c93e3d972ded48de10b7a0314fdaeeae57b81a307a02a352d172 not found: ID does not exist" Jul 28 15:16:44.633400 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.633363 2560 scope.go:117] "RemoveContainer" containerID="ae58b41a83bb50fe1f11f97cc8cc358193668f8c64ca93ff8276c5b232c4113b" Jul 28 15:16:44.633554 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:16:44.633540 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae58b41a83bb50fe1f11f97cc8cc358193668f8c64ca93ff8276c5b232c4113b\": container with ID starting with ae58b41a83bb50fe1f11f97cc8cc358193668f8c64ca93ff8276c5b232c4113b not found: ID does not exist" containerID="ae58b41a83bb50fe1f11f97cc8cc358193668f8c64ca93ff8276c5b232c4113b" Jul 28 15:16:44.633591 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.633557 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae58b41a83bb50fe1f11f97cc8cc358193668f8c64ca93ff8276c5b232c4113b"} err="failed to get container status \"ae58b41a83bb50fe1f11f97cc8cc358193668f8c64ca93ff8276c5b232c4113b\": rpc error: code = NotFound desc = could not find container \"ae58b41a83bb50fe1f11f97cc8cc358193668f8c64ca93ff8276c5b232c4113b\": container with ID starting with ae58b41a83bb50fe1f11f97cc8cc358193668f8c64ca93ff8276c5b232c4113b not found: ID does not exist" Jul 28 15:16:44.645665 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.645645 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 15:16:44.645946 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.645934 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="prom-label-proxy" Jul 28 15:16:44.646001 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.645948 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="prom-label-proxy" Jul 28 15:16:44.646001 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.645956 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31df32ae-34aa-4340-bba3-ae4a626eb718" containerName="registry" Jul 28 15:16:44.646001 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.645962 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="31df32ae-34aa-4340-bba3-ae4a626eb718" containerName="registry" Jul 28 15:16:44.646001 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.645987 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="config-reloader" Jul 28 15:16:44.646001 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.645997 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="config-reloader" Jul 28 15:16:44.646172 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.646007 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="alertmanager" Jul 28 15:16:44.646172 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.646012 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="alertmanager" Jul 28 15:16:44.646172 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.646021 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="kube-rbac-proxy-metric" Jul 28 15:16:44.646172 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.646026 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="kube-rbac-proxy-metric" Jul 28 15:16:44.646172 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.646036 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="init-config-reloader" Jul 28 15:16:44.646172 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.646041 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="init-config-reloader" Jul 28 15:16:44.646172 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.646052 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="kube-rbac-proxy-web" Jul 28 15:16:44.646172 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.646057 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="kube-rbac-proxy-web" Jul 28 15:16:44.646172 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.646066 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="kube-rbac-proxy" Jul 28 15:16:44.646172 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.646071 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="kube-rbac-proxy" Jul 28 15:16:44.646172 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.646119 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="31df32ae-34aa-4340-bba3-ae4a626eb718" containerName="registry" Jul 28 15:16:44.646172 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.646128 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="kube-rbac-proxy-web" Jul 28 15:16:44.646172 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.646134 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="kube-rbac-proxy-metric" Jul 28 15:16:44.646172 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.646139 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="config-reloader" Jul 28 15:16:44.646172 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.646144 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="alertmanager" Jul 28 15:16:44.646172 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.646149 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="prom-label-proxy" Jul 28 15:16:44.646172 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.646155 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" containerName="kube-rbac-proxy" Jul 28 15:16:44.651285 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.651271 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.654444 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.654418 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 15:16:44.654546 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.654519 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 15:16:44.654546 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.654530 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lzr4v\"" Jul 28 15:16:44.654820 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.654786 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 15:16:44.654910 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.654877 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 15:16:44.654910 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.654897 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 15:16:44.655278 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.655253 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 15:16:44.655332 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.655300 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 15:16:44.655433 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.655413 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 15:16:44.660442 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.660423 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 15:16:44.670187 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.670164 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 15:16:44.715062 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.715036 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.715147 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.715081 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-web-config\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.715147 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.715119 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.715219 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.715149 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rntl7\" (UniqueName: \"kubernetes.io/projected/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-kube-api-access-rntl7\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.715219 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.715168 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-config-volume\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.715282 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.715222 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.715282 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.715251 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.715282 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.715275 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.715380 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.715317 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-config-out\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.715380 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.715336 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.715380 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.715361 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.715509 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.715390 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.715509 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.715412 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.816657 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.816632 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.816747 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.816663 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.816747 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.816682 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.816747 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.816711 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-config-out\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.816866 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.816750 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.817611 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.816921 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.817611 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.816963 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.817611 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.817027 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.817611 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.817071 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.817611 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.817120 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-web-config\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.817611 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.817214 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.817611 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.817259 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rntl7\" (UniqueName: \"kubernetes.io/projected/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-kube-api-access-rntl7\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.817611 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.817286 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-config-volume\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.818081 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.817712 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.818081 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.817785 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.819931 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.819574 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-config-out\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.819931 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.819858 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.819931 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.819923 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.820165 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.820080 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-web-config\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.820379 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.820337 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.820453 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.820421 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.820504 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.820489 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-config-volume\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.820811 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.820791 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.820846 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.820803 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.821916 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.821895 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.829498 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.829477 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rntl7\" (UniqueName: \"kubernetes.io/projected/0c7f6d91-4820-4618-9ecb-6a4f704b22cb-kube-api-access-rntl7\") pod \"alertmanager-main-0\" (UID: \"0c7f6d91-4820-4618-9ecb-6a4f704b22cb\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:44.961529 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:44.961506 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 15:16:45.104420 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:45.104385 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 15:16:45.107785 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:16:45.107753 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c7f6d91_4820_4618_9ecb_6a4f704b22cb.slice/crio-e258a2071ad833f4ee1794d62da00addeb141e547a41554431be8a32585eb5db WatchSource:0}: Error finding container e258a2071ad833f4ee1794d62da00addeb141e547a41554431be8a32585eb5db: Status 404 returned error can't find the container with id e258a2071ad833f4ee1794d62da00addeb141e547a41554431be8a32585eb5db Jul 28 15:16:45.587780 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:45.587743 2560 generic.go:356] "Generic (PLEG): container finished" podID="0c7f6d91-4820-4618-9ecb-6a4f704b22cb" containerID="08c5867edb3b38d175c4fcd0e8e4f73abfaf3b96be45a839eec1405731e84aa4" exitCode=0 Jul 28 15:16:45.587947 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:45.587834 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c7f6d91-4820-4618-9ecb-6a4f704b22cb","Type":"ContainerDied","Data":"08c5867edb3b38d175c4fcd0e8e4f73abfaf3b96be45a839eec1405731e84aa4"} Jul 28 15:16:45.587947 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:45.587919 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c7f6d91-4820-4618-9ecb-6a4f704b22cb","Type":"ContainerStarted","Data":"e258a2071ad833f4ee1794d62da00addeb141e547a41554431be8a32585eb5db"} Jul 28 15:16:45.731650 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:45.731617 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="021a6730-0722-4f3c-bc2c-2d0e92cb3e17" path="/var/lib/kubelet/pods/021a6730-0722-4f3c-bc2c-2d0e92cb3e17/volumes" Jul 28 15:16:46.596391 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:46.596353 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c7f6d91-4820-4618-9ecb-6a4f704b22cb","Type":"ContainerStarted","Data":"fc6e66c266d359db1f3194a18193e31c4a9c4a29deba42dba513d3fefc06676a"} Jul 28 15:16:46.596758 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:46.596436 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c7f6d91-4820-4618-9ecb-6a4f704b22cb","Type":"ContainerStarted","Data":"75c2197459286dbd3602db15d5b374e4bf48fcd07eaf27583b7a3080770410b2"} Jul 28 15:16:46.596758 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:46.596477 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c7f6d91-4820-4618-9ecb-6a4f704b22cb","Type":"ContainerStarted","Data":"70b78a231697a529668b1f6f99da38483110fd6344896edfc50c082c44744383"} Jul 28 15:16:46.596758 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:46.596515 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c7f6d91-4820-4618-9ecb-6a4f704b22cb","Type":"ContainerStarted","Data":"8b76f37134229ceacfc69013967dd16a39b88fbc43ea697ed29f92d933cfc08c"} Jul 28 15:16:46.596758 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:46.596555 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c7f6d91-4820-4618-9ecb-6a4f704b22cb","Type":"ContainerStarted","Data":"f00a1a90d479932092e7d34a97fb434168d5eff30b7a69b18a8213b81c1191c0"} Jul 28 15:16:46.596758 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:46.596592 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0c7f6d91-4820-4618-9ecb-6a4f704b22cb","Type":"ContainerStarted","Data":"f32912af0738a1fec997660220aa12492103baf3658dabd5ca9a2efe842003ff"} Jul 28 15:16:46.629268 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:46.629224 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.614897393 podStartE2EDuration="2.629208319s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.310926ms" isStatefulPod=false podCreationTimestamp="2026-07-28 15:16:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:16:46.627197634 +0000 UTC m=+179.281890830" watchObservedRunningTime="2026-07-28 15:16:46.629208319 +0000 UTC m=+179.283901490" Jul 28 15:16:46.790957 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:46.790924 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 15:16:46.791252 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:46.791207 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="prometheus" containerID="cri-o://805e8e215b0950101622ac20c7c3117b70c8fdae198c41c2d45c9837184af852" gracePeriod=600 Jul 28 15:16:46.791332 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:46.791251 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="thanos-sidecar" containerID="cri-o://2ed591241f1e86d6d73b897abb16659752e80f849ea1cab0f878b6e7034c8c2a" gracePeriod=600 Jul 28 15:16:46.791332 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:46.791284 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="config-reloader" containerID="cri-o://f21e55758aeb9b7cc5b7dc3a3b39f6cfb482b7da02a442dfd7a993f4685fb0bd" gracePeriod=600 Jul 28 15:16:46.791441 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:46.791278 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6a44dcc1706058a83aea73be1e503782df6f8310111b48d724d4398628e420f1" gracePeriod=600 Jul 28 15:16:46.791441 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:46.791258 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="kube-rbac-proxy-web" containerID="cri-o://314e95cdb3351efbb29660920211779fd448fb7dd8782f52cf23ffb522c9882d" gracePeriod=600 Jul 28 15:16:46.791441 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:46.791229 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="kube-rbac-proxy" containerID="cri-o://976058e914300777e352281ed027f7f11512d4350b264f65746769e42c935790" gracePeriod=600 Jul 28 15:16:47.604428 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:47.604396 2560 generic.go:356] "Generic (PLEG): container finished" podID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerID="6a44dcc1706058a83aea73be1e503782df6f8310111b48d724d4398628e420f1" exitCode=0 Jul 28 15:16:47.604428 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:47.604423 2560 generic.go:356] "Generic (PLEG): container finished" podID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerID="976058e914300777e352281ed027f7f11512d4350b264f65746769e42c935790" exitCode=0 Jul 28 15:16:47.604428 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:47.604430 2560 generic.go:356] "Generic (PLEG): container finished" podID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerID="2ed591241f1e86d6d73b897abb16659752e80f849ea1cab0f878b6e7034c8c2a" exitCode=0 Jul 28 15:16:47.604428 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:47.604437 2560 generic.go:356] "Generic (PLEG): container finished" podID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerID="f21e55758aeb9b7cc5b7dc3a3b39f6cfb482b7da02a442dfd7a993f4685fb0bd" exitCode=0 Jul 28 15:16:47.605049 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:47.604446 2560 generic.go:356] "Generic (PLEG): container finished" podID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerID="805e8e215b0950101622ac20c7c3117b70c8fdae198c41c2d45c9837184af852" exitCode=0 Jul 28 15:16:47.605049 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:47.604468 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e221b4-226a-4ec8-a2e2-64a58c273769","Type":"ContainerDied","Data":"6a44dcc1706058a83aea73be1e503782df6f8310111b48d724d4398628e420f1"} Jul 28 15:16:47.605049 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:47.604535 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e221b4-226a-4ec8-a2e2-64a58c273769","Type":"ContainerDied","Data":"976058e914300777e352281ed027f7f11512d4350b264f65746769e42c935790"} Jul 28 15:16:47.605049 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:47.604564 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e221b4-226a-4ec8-a2e2-64a58c273769","Type":"ContainerDied","Data":"2ed591241f1e86d6d73b897abb16659752e80f849ea1cab0f878b6e7034c8c2a"} Jul 28 15:16:47.605049 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:47.604588 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e221b4-226a-4ec8-a2e2-64a58c273769","Type":"ContainerDied","Data":"f21e55758aeb9b7cc5b7dc3a3b39f6cfb482b7da02a442dfd7a993f4685fb0bd"} Jul 28 15:16:47.605049 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:47.604612 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e221b4-226a-4ec8-a2e2-64a58c273769","Type":"ContainerDied","Data":"805e8e215b0950101622ac20c7c3117b70c8fdae198c41c2d45c9837184af852"} Jul 28 15:16:48.055611 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.055589 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.151200 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.151124 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5e221b4-226a-4ec8-a2e2-64a58c273769-tls-assets\") pod \"b5e221b4-226a-4ec8-a2e2-64a58c273769\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " Jul 28 15:16:48.151200 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.151182 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-configmap-metrics-client-ca\") pod \"b5e221b4-226a-4ec8-a2e2-64a58c273769\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " Jul 28 15:16:48.151382 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.151210 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7zxd\" (UniqueName: \"kubernetes.io/projected/b5e221b4-226a-4ec8-a2e2-64a58c273769-kube-api-access-v7zxd\") pod \"b5e221b4-226a-4ec8-a2e2-64a58c273769\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " Jul 28 15:16:48.151382 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.151318 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b5e221b4-226a-4ec8-a2e2-64a58c273769\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " Jul 28 15:16:48.151382 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.151350 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-rulefiles-0\") pod \"b5e221b4-226a-4ec8-a2e2-64a58c273769\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " Jul 28 15:16:48.151382 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.151368 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-trusted-ca-bundle\") pod \"b5e221b4-226a-4ec8-a2e2-64a58c273769\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " Jul 28 15:16:48.151576 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.151383 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-prometheus-k8s-tls\") pod \"b5e221b4-226a-4ec8-a2e2-64a58c273769\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " Jul 28 15:16:48.151697 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.151669 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b5e221b4-226a-4ec8-a2e2-64a58c273769" (UID: "b5e221b4-226a-4ec8-a2e2-64a58c273769"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 15:16:48.151859 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.151754 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-configmap-kubelet-serving-ca-bundle\") pod \"b5e221b4-226a-4ec8-a2e2-64a58c273769\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " Jul 28 15:16:48.152053 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.151865 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b5e221b4-226a-4ec8-a2e2-64a58c273769" (UID: "b5e221b4-226a-4ec8-a2e2-64a58c273769"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 15:16:48.152144 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.152076 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b5e221b4-226a-4ec8-a2e2-64a58c273769" (UID: "b5e221b4-226a-4ec8-a2e2-64a58c273769"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 15:16:48.152240 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.152214 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-kube-rbac-proxy\") pod \"b5e221b4-226a-4ec8-a2e2-64a58c273769\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " Jul 28 15:16:48.152343 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.152282 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-db\") pod \"b5e221b4-226a-4ec8-a2e2-64a58c273769\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " Jul 28 15:16:48.152343 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.152328 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-rulefiles-2\") pod \"b5e221b4-226a-4ec8-a2e2-64a58c273769\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " Jul 28 15:16:48.152454 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.152359 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-config\") pod \"b5e221b4-226a-4ec8-a2e2-64a58c273769\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " Jul 28 15:16:48.152454 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.152408 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b5e221b4-226a-4ec8-a2e2-64a58c273769\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " Jul 28 15:16:48.152557 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.152452 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5e221b4-226a-4ec8-a2e2-64a58c273769-config-out\") pod \"b5e221b4-226a-4ec8-a2e2-64a58c273769\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " Jul 28 15:16:48.152557 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.152477 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-web-config\") pod \"b5e221b4-226a-4ec8-a2e2-64a58c273769\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " Jul 28 15:16:48.152557 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.152508 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-metrics-client-certs\") pod \"b5e221b4-226a-4ec8-a2e2-64a58c273769\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " Jul 28 15:16:48.152557 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.152536 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-grpc-tls\") pod \"b5e221b4-226a-4ec8-a2e2-64a58c273769\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " Jul 28 15:16:48.152759 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.152588 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-configmap-serving-certs-ca-bundle\") pod \"b5e221b4-226a-4ec8-a2e2-64a58c273769\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " Jul 28 15:16:48.152759 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.152634 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-thanos-prometheus-http-client-file\") pod \"b5e221b4-226a-4ec8-a2e2-64a58c273769\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " Jul 28 15:16:48.152759 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.152667 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-rulefiles-1\") pod \"b5e221b4-226a-4ec8-a2e2-64a58c273769\" (UID: \"b5e221b4-226a-4ec8-a2e2-64a58c273769\") " Jul 28 15:16:48.152962 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.152939 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-configmap-metrics-client-ca\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:48.153051 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.152969 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:48.153051 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.153005 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:48.153051 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.153015 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b5e221b4-226a-4ec8-a2e2-64a58c273769" (UID: "b5e221b4-226a-4ec8-a2e2-64a58c273769"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 15:16:48.153429 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.153402 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b5e221b4-226a-4ec8-a2e2-64a58c273769" (UID: "b5e221b4-226a-4ec8-a2e2-64a58c273769"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 15:16:48.153769 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.153742 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b5e221b4-226a-4ec8-a2e2-64a58c273769" (UID: "b5e221b4-226a-4ec8-a2e2-64a58c273769"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 15:16:48.155026 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.154015 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5e221b4-226a-4ec8-a2e2-64a58c273769-kube-api-access-v7zxd" (OuterVolumeSpecName: "kube-api-access-v7zxd") pod "b5e221b4-226a-4ec8-a2e2-64a58c273769" (UID: "b5e221b4-226a-4ec8-a2e2-64a58c273769"). InnerVolumeSpecName "kube-api-access-v7zxd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 15:16:48.155026 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.154031 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5e221b4-226a-4ec8-a2e2-64a58c273769-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b5e221b4-226a-4ec8-a2e2-64a58c273769" (UID: "b5e221b4-226a-4ec8-a2e2-64a58c273769"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 15:16:48.155026 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.154243 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b5e221b4-226a-4ec8-a2e2-64a58c273769" (UID: "b5e221b4-226a-4ec8-a2e2-64a58c273769"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:16:48.155026 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.154300 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b5e221b4-226a-4ec8-a2e2-64a58c273769" (UID: "b5e221b4-226a-4ec8-a2e2-64a58c273769"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:16:48.155026 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.154374 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b5e221b4-226a-4ec8-a2e2-64a58c273769" (UID: "b5e221b4-226a-4ec8-a2e2-64a58c273769"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 15:16:48.155544 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.155516 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b5e221b4-226a-4ec8-a2e2-64a58c273769" (UID: "b5e221b4-226a-4ec8-a2e2-64a58c273769"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 15:16:48.155746 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.155720 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b5e221b4-226a-4ec8-a2e2-64a58c273769" (UID: "b5e221b4-226a-4ec8-a2e2-64a58c273769"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:16:48.155873 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.155846 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b5e221b4-226a-4ec8-a2e2-64a58c273769" (UID: "b5e221b4-226a-4ec8-a2e2-64a58c273769"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:16:48.155944 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.155924 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b5e221b4-226a-4ec8-a2e2-64a58c273769" (UID: "b5e221b4-226a-4ec8-a2e2-64a58c273769"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:16:48.156102 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.156075 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5e221b4-226a-4ec8-a2e2-64a58c273769-config-out" (OuterVolumeSpecName: "config-out") pod "b5e221b4-226a-4ec8-a2e2-64a58c273769" (UID: "b5e221b4-226a-4ec8-a2e2-64a58c273769"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 15:16:48.156354 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.156332 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-config" (OuterVolumeSpecName: "config") pod "b5e221b4-226a-4ec8-a2e2-64a58c273769" (UID: "b5e221b4-226a-4ec8-a2e2-64a58c273769"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:16:48.156486 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.156463 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b5e221b4-226a-4ec8-a2e2-64a58c273769" (UID: "b5e221b4-226a-4ec8-a2e2-64a58c273769"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:16:48.157371 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.157350 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b5e221b4-226a-4ec8-a2e2-64a58c273769" (UID: "b5e221b4-226a-4ec8-a2e2-64a58c273769"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:16:48.168023 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.167997 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-web-config" (OuterVolumeSpecName: "web-config") pod "b5e221b4-226a-4ec8-a2e2-64a58c273769" (UID: "b5e221b4-226a-4ec8-a2e2-64a58c273769"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 15:16:48.253336 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.253307 2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-kube-rbac-proxy\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:48.253336 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.253335 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-db\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:48.253478 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.253345 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:48.253478 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.253354 2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-config\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:48.253478 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.253364 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:48.253478 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.253373 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5e221b4-226a-4ec8-a2e2-64a58c273769-config-out\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:48.253478 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.253381 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-web-config\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:48.253478 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.253388 2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-metrics-client-certs\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:48.253478 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.253396 2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-grpc-tls\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:48.253478 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.253404 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:48.253478 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.253413 2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:48.253478 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.253421 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:48.253478 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.253429 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5e221b4-226a-4ec8-a2e2-64a58c273769-tls-assets\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:48.253478 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.253437 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7zxd\" (UniqueName: \"kubernetes.io/projected/b5e221b4-226a-4ec8-a2e2-64a58c273769-kube-api-access-v7zxd\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:48.253478 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.253446 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:48.253478 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.253454 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5e221b4-226a-4ec8-a2e2-64a58c273769-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:48.253478 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.253462 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5e221b4-226a-4ec8-a2e2-64a58c273769-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:16:48.612854 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.612821 2560 generic.go:356] "Generic (PLEG): container finished" podID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerID="314e95cdb3351efbb29660920211779fd448fb7dd8782f52cf23ffb522c9882d" exitCode=0 Jul 28 15:16:48.613285 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.612905 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.613285 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.612906 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e221b4-226a-4ec8-a2e2-64a58c273769","Type":"ContainerDied","Data":"314e95cdb3351efbb29660920211779fd448fb7dd8782f52cf23ffb522c9882d"} Jul 28 15:16:48.613285 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.613027 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5e221b4-226a-4ec8-a2e2-64a58c273769","Type":"ContainerDied","Data":"c1f94062579beb68ab69704e185b06737698014f7f5e2ce5e1fb316f1c054498"} Jul 28 15:16:48.613285 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.613066 2560 scope.go:117] "RemoveContainer" containerID="6a44dcc1706058a83aea73be1e503782df6f8310111b48d724d4398628e420f1" Jul 28 15:16:48.620928 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.620912 2560 scope.go:117] "RemoveContainer" containerID="976058e914300777e352281ed027f7f11512d4350b264f65746769e42c935790" Jul 28 15:16:48.627969 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.627952 2560 scope.go:117] "RemoveContainer" containerID="314e95cdb3351efbb29660920211779fd448fb7dd8782f52cf23ffb522c9882d" Jul 28 15:16:48.634894 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.634877 2560 scope.go:117] "RemoveContainer" containerID="2ed591241f1e86d6d73b897abb16659752e80f849ea1cab0f878b6e7034c8c2a" Jul 28 15:16:48.641406 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.641381 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 15:16:48.642006 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.641991 2560 scope.go:117] "RemoveContainer" containerID="f21e55758aeb9b7cc5b7dc3a3b39f6cfb482b7da02a442dfd7a993f4685fb0bd" Jul 28 15:16:48.646739 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.646719 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 15:16:48.649822 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.649806 2560 scope.go:117] "RemoveContainer" containerID="805e8e215b0950101622ac20c7c3117b70c8fdae198c41c2d45c9837184af852" Jul 28 15:16:48.656664 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.656648 2560 scope.go:117] "RemoveContainer" containerID="24289f69dec73e95860ca9ec2edf267921cb2ca6af5cfa175f2d341e995fe148" Jul 28 15:16:48.662945 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.662923 2560 scope.go:117] "RemoveContainer" containerID="6a44dcc1706058a83aea73be1e503782df6f8310111b48d724d4398628e420f1" Jul 28 15:16:48.663219 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:16:48.663198 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a44dcc1706058a83aea73be1e503782df6f8310111b48d724d4398628e420f1\": container with ID starting with 6a44dcc1706058a83aea73be1e503782df6f8310111b48d724d4398628e420f1 not found: ID does not exist" containerID="6a44dcc1706058a83aea73be1e503782df6f8310111b48d724d4398628e420f1" Jul 28 15:16:48.663269 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.663227 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a44dcc1706058a83aea73be1e503782df6f8310111b48d724d4398628e420f1"} err="failed to get container status \"6a44dcc1706058a83aea73be1e503782df6f8310111b48d724d4398628e420f1\": rpc error: code = NotFound desc = could not find container \"6a44dcc1706058a83aea73be1e503782df6f8310111b48d724d4398628e420f1\": container with ID starting with 6a44dcc1706058a83aea73be1e503782df6f8310111b48d724d4398628e420f1 not found: ID does not exist" Jul 28 15:16:48.663269 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.663246 2560 scope.go:117] "RemoveContainer" containerID="976058e914300777e352281ed027f7f11512d4350b264f65746769e42c935790" Jul 28 15:16:48.663498 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:16:48.663480 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"976058e914300777e352281ed027f7f11512d4350b264f65746769e42c935790\": container with ID starting with 976058e914300777e352281ed027f7f11512d4350b264f65746769e42c935790 not found: ID does not exist" containerID="976058e914300777e352281ed027f7f11512d4350b264f65746769e42c935790" Jul 28 15:16:48.663539 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.663505 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"976058e914300777e352281ed027f7f11512d4350b264f65746769e42c935790"} err="failed to get container status \"976058e914300777e352281ed027f7f11512d4350b264f65746769e42c935790\": rpc error: code = NotFound desc = could not find container \"976058e914300777e352281ed027f7f11512d4350b264f65746769e42c935790\": container with ID starting with 976058e914300777e352281ed027f7f11512d4350b264f65746769e42c935790 not found: ID does not exist" Jul 28 15:16:48.663539 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.663525 2560 scope.go:117] "RemoveContainer" containerID="314e95cdb3351efbb29660920211779fd448fb7dd8782f52cf23ffb522c9882d" Jul 28 15:16:48.663730 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:16:48.663713 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"314e95cdb3351efbb29660920211779fd448fb7dd8782f52cf23ffb522c9882d\": container with ID starting with 314e95cdb3351efbb29660920211779fd448fb7dd8782f52cf23ffb522c9882d not found: ID does not exist" containerID="314e95cdb3351efbb29660920211779fd448fb7dd8782f52cf23ffb522c9882d" Jul 28 15:16:48.663792 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.663738 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"314e95cdb3351efbb29660920211779fd448fb7dd8782f52cf23ffb522c9882d"} err="failed to get container status \"314e95cdb3351efbb29660920211779fd448fb7dd8782f52cf23ffb522c9882d\": rpc error: code = NotFound desc = could not find container \"314e95cdb3351efbb29660920211779fd448fb7dd8782f52cf23ffb522c9882d\": container with ID starting with 314e95cdb3351efbb29660920211779fd448fb7dd8782f52cf23ffb522c9882d not found: ID does not exist" Jul 28 15:16:48.663792 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.663763 2560 scope.go:117] "RemoveContainer" containerID="2ed591241f1e86d6d73b897abb16659752e80f849ea1cab0f878b6e7034c8c2a" Jul 28 15:16:48.664020 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:16:48.663996 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ed591241f1e86d6d73b897abb16659752e80f849ea1cab0f878b6e7034c8c2a\": container with ID starting with 2ed591241f1e86d6d73b897abb16659752e80f849ea1cab0f878b6e7034c8c2a not found: ID does not exist" containerID="2ed591241f1e86d6d73b897abb16659752e80f849ea1cab0f878b6e7034c8c2a" Jul 28 15:16:48.664141 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.664024 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ed591241f1e86d6d73b897abb16659752e80f849ea1cab0f878b6e7034c8c2a"} err="failed to get container status \"2ed591241f1e86d6d73b897abb16659752e80f849ea1cab0f878b6e7034c8c2a\": rpc error: code = NotFound desc = could not find container \"2ed591241f1e86d6d73b897abb16659752e80f849ea1cab0f878b6e7034c8c2a\": container with ID starting with 2ed591241f1e86d6d73b897abb16659752e80f849ea1cab0f878b6e7034c8c2a not found: ID does not exist" Jul 28 15:16:48.664141 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.664044 2560 scope.go:117] "RemoveContainer" containerID="f21e55758aeb9b7cc5b7dc3a3b39f6cfb482b7da02a442dfd7a993f4685fb0bd" Jul 28 15:16:48.664288 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:16:48.664264 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f21e55758aeb9b7cc5b7dc3a3b39f6cfb482b7da02a442dfd7a993f4685fb0bd\": container with ID starting with f21e55758aeb9b7cc5b7dc3a3b39f6cfb482b7da02a442dfd7a993f4685fb0bd not found: ID does not exist" containerID="f21e55758aeb9b7cc5b7dc3a3b39f6cfb482b7da02a442dfd7a993f4685fb0bd" Jul 28 15:16:48.664345 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.664296 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f21e55758aeb9b7cc5b7dc3a3b39f6cfb482b7da02a442dfd7a993f4685fb0bd"} err="failed to get container status \"f21e55758aeb9b7cc5b7dc3a3b39f6cfb482b7da02a442dfd7a993f4685fb0bd\": rpc error: code = NotFound desc = could not find container \"f21e55758aeb9b7cc5b7dc3a3b39f6cfb482b7da02a442dfd7a993f4685fb0bd\": container with ID starting with f21e55758aeb9b7cc5b7dc3a3b39f6cfb482b7da02a442dfd7a993f4685fb0bd not found: ID does not exist" Jul 28 15:16:48.664345 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.664320 2560 scope.go:117] "RemoveContainer" containerID="805e8e215b0950101622ac20c7c3117b70c8fdae198c41c2d45c9837184af852" Jul 28 15:16:48.664621 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:16:48.664588 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"805e8e215b0950101622ac20c7c3117b70c8fdae198c41c2d45c9837184af852\": container with ID starting with 805e8e215b0950101622ac20c7c3117b70c8fdae198c41c2d45c9837184af852 not found: ID does not exist" containerID="805e8e215b0950101622ac20c7c3117b70c8fdae198c41c2d45c9837184af852" Jul 28 15:16:48.664713 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.664620 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"805e8e215b0950101622ac20c7c3117b70c8fdae198c41c2d45c9837184af852"} err="failed to get container status \"805e8e215b0950101622ac20c7c3117b70c8fdae198c41c2d45c9837184af852\": rpc error: code = NotFound desc = could not find container \"805e8e215b0950101622ac20c7c3117b70c8fdae198c41c2d45c9837184af852\": container with ID starting with 805e8e215b0950101622ac20c7c3117b70c8fdae198c41c2d45c9837184af852 not found: ID does not exist" Jul 28 15:16:48.664713 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.664641 2560 scope.go:117] "RemoveContainer" containerID="24289f69dec73e95860ca9ec2edf267921cb2ca6af5cfa175f2d341e995fe148" Jul 28 15:16:48.664882 ip-10-0-138-160 kubenswrapper[2560]: E0728 15:16:48.664865 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24289f69dec73e95860ca9ec2edf267921cb2ca6af5cfa175f2d341e995fe148\": container with ID starting with 24289f69dec73e95860ca9ec2edf267921cb2ca6af5cfa175f2d341e995fe148 not found: ID does not exist" containerID="24289f69dec73e95860ca9ec2edf267921cb2ca6af5cfa175f2d341e995fe148" Jul 28 15:16:48.664924 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.664887 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24289f69dec73e95860ca9ec2edf267921cb2ca6af5cfa175f2d341e995fe148"} err="failed to get container status \"24289f69dec73e95860ca9ec2edf267921cb2ca6af5cfa175f2d341e995fe148\": rpc error: code = NotFound desc = could not find container \"24289f69dec73e95860ca9ec2edf267921cb2ca6af5cfa175f2d341e995fe148\": container with ID starting with 24289f69dec73e95860ca9ec2edf267921cb2ca6af5cfa175f2d341e995fe148 not found: ID does not exist" Jul 28 15:16:48.674391 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674370 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 15:16:48.674670 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674658 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="kube-rbac-proxy-thanos" Jul 28 15:16:48.674710 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674672 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="kube-rbac-proxy-thanos" Jul 28 15:16:48.674710 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674690 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="prometheus" Jul 28 15:16:48.674710 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674696 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="prometheus" Jul 28 15:16:48.674800 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674712 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="init-config-reloader" Jul 28 15:16:48.674800 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674718 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="init-config-reloader" Jul 28 15:16:48.674800 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674727 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="config-reloader" Jul 28 15:16:48.674800 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674732 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="config-reloader" Jul 28 15:16:48.674800 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674743 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="thanos-sidecar" Jul 28 15:16:48.674800 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674749 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="thanos-sidecar" Jul 28 15:16:48.674800 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674755 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="kube-rbac-proxy-web" Jul 28 15:16:48.674800 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674760 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="kube-rbac-proxy-web" Jul 28 15:16:48.674800 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674766 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="kube-rbac-proxy" Jul 28 15:16:48.674800 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674771 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="kube-rbac-proxy" Jul 28 15:16:48.675099 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674812 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="config-reloader" Jul 28 15:16:48.675099 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674819 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="kube-rbac-proxy-thanos" Jul 28 15:16:48.675099 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674825 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="prometheus" Jul 28 15:16:48.675099 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674832 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="kube-rbac-proxy-web" Jul 28 15:16:48.675099 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674837 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="kube-rbac-proxy" Jul 28 15:16:48.675099 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.674844 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" containerName="thanos-sidecar" Jul 28 15:16:48.680376 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.680360 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.684101 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.684075 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 15:16:48.684268 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.684246 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n4rzm\"" Jul 28 15:16:48.684378 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.684307 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 15:16:48.684716 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.684693 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 15:16:48.685127 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.685106 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 15:16:48.685424 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.685162 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 15:16:48.685424 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.685169 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1je4mphr9n5e9\"" Jul 28 15:16:48.685424 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.685158 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 15:16:48.685424 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.685227 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 15:16:48.685424 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.685268 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 15:16:48.685424 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.685308 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 15:16:48.685642 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.685613 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 15:16:48.685724 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.685702 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 15:16:48.685890 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.685875 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 15:16:48.686788 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.686769 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 15:16:48.692165 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.692147 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 15:16:48.700160 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.700137 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 15:16:48.757463 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.757435 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-web-config\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.757577 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.757470 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-config-out\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.757577 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.757490 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-config\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.757577 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.757521 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.757577 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.757548 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.757577 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.757564 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.757732 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.757593 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.757732 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.757624 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.757732 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.757644 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.757732 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.757669 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.757732 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.757684 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.757732 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.757704 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.757732 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.757725 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.757932 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.757774 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.757932 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.757801 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.757932 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.757841 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.757932 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.757860 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.757932 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.757880 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gczwc\" (UniqueName: \"kubernetes.io/projected/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-kube-api-access-gczwc\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.757932 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.757897 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.757932 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.757913 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.858318 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.858293 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.858403 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.858322 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.858403 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.858338 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.858403 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.858358 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.858403 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.858376 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.858533 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.858512 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.858576 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.858550 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.858627 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.858578 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.858627 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.858612 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.858730 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.858635 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.858730 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.858664 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.858730 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.858696 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.858878 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.858731 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.858878 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.858756 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.858878 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.858798 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gczwc\" (UniqueName: \"kubernetes.io/projected/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-kube-api-access-gczwc\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.858878 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.858825 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.858878 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.858847 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.859158 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.858884 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-web-config\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.859158 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.858914 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-config-out\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.859158 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.858937 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-config\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.861133 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.859360 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.861133 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.859508 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.861133 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.859658 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.861133 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.859958 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.861133 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.859968 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.861133 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.860933 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.861518 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.861493 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.861576 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.861545 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.861684 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.861657 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.861684 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.861673 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.862090 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.861941 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.862090 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.862037 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-config\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.862434 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.862415 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.862638 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.862615 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.863406 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.863360 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-web-config\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.863492 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.863473 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-config-out\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.864147 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.864127 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.864237 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.864220 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.865422 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.865402 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.868983 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.868952 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gczwc\" (UniqueName: \"kubernetes.io/projected/1cad35d5-9e3c-4be3-a6b1-f98548bbc73d-kube-api-access-gczwc\") pod \"prometheus-k8s-0\" (UID: \"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:48.990749 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:48.990724 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:16:49.131999 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:49.131915 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 15:16:49.136277 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:16:49.136251 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cad35d5_9e3c_4be3_a6b1_f98548bbc73d.slice/crio-723dc179e595748c2f8661f52b79b81347f99e1a17cddea1790a37e65808e854 WatchSource:0}: Error finding container 723dc179e595748c2f8661f52b79b81347f99e1a17cddea1790a37e65808e854: Status 404 returned error can't find the container with id 723dc179e595748c2f8661f52b79b81347f99e1a17cddea1790a37e65808e854 Jul 28 15:16:49.619590 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:49.619556 2560 generic.go:356] "Generic (PLEG): container finished" podID="1cad35d5-9e3c-4be3-a6b1-f98548bbc73d" containerID="e2ec86253f7431478de45028c9a26a1c401453bce42130c0d3e2ab0130ffdc96" exitCode=0 Jul 28 15:16:49.620079 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:49.619596 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d","Type":"ContainerDied","Data":"e2ec86253f7431478de45028c9a26a1c401453bce42130c0d3e2ab0130ffdc96"} Jul 28 15:16:49.620079 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:49.619646 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d","Type":"ContainerStarted","Data":"723dc179e595748c2f8661f52b79b81347f99e1a17cddea1790a37e65808e854"} Jul 28 15:16:49.729487 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:49.729456 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5e221b4-226a-4ec8-a2e2-64a58c273769" path="/var/lib/kubelet/pods/b5e221b4-226a-4ec8-a2e2-64a58c273769/volumes" Jul 28 15:16:50.626588 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:50.626557 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d","Type":"ContainerStarted","Data":"ba42f28b606baf7b1881ad46ca7ad5f503ab1cc61ec3ac3ae12c0d07a88acbbd"} Jul 28 15:16:50.627043 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:50.626619 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d","Type":"ContainerStarted","Data":"6e7b6c284f3e0b02effaacfa0e97c42e25a4852821dd7ff8db7da75e9413eb4b"} Jul 28 15:16:50.627043 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:50.626644 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d","Type":"ContainerStarted","Data":"4cd95e7ffa3b509e816ae04fd0507ce00e640853b7c1b3501d7bf793bb05417f"} Jul 28 15:16:50.627043 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:50.626669 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d","Type":"ContainerStarted","Data":"7d54a9bb6745ff21d208171c63e8f0c1bfd9299744b407a6118078f920cef7ed"} Jul 28 15:16:50.627043 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:50.626697 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d","Type":"ContainerStarted","Data":"7f03e4492bd2e5158905f5889f657c5a7199a0487f73dc745e87c18c66efb044"} Jul 28 15:16:50.627043 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:50.626723 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cad35d5-9e3c-4be3-a6b1-f98548bbc73d","Type":"ContainerStarted","Data":"6824df255cbf84ff7d717f8855913f67e1541f9ead52f4579a38fffa4c43dffb"} Jul 28 15:16:50.662422 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:50.662378 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.645399685 podStartE2EDuration="2.662364651s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.964966ms" isStatefulPod=false podCreationTimestamp="2026-07-28 15:16:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:16:50.661117449 +0000 UTC m=+183.315810641" watchObservedRunningTime="2026-07-28 15:16:50.662364651 +0000 UTC m=+183.317057821" Jul 28 15:16:53.991878 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:16:53.991839 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:17:48.991106 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:17:48.991074 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:17:49.005952 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:17:49.005926 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:17:49.874050 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:17:49.874023 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:18:47.640433 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:18:47.640394 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/2.log" Jul 28 15:18:47.647278 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:18:47.647255 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/2.log" Jul 28 15:18:47.651038 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:18:47.651017 2560 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 15:23:47.669589 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:23:47.669560 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/2.log" Jul 28 15:23:47.673934 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:23:47.673912 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/2.log" Jul 28 15:25:18.113482 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:18.113449 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-ljc76"] Jul 28 15:25:18.116869 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:18.116851 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-ljc76" Jul 28 15:25:18.125021 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:18.124998 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 28 15:25:18.125146 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:18.125028 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 28 15:25:18.129241 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:18.129226 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-qr7wm\"" Jul 28 15:25:18.147144 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:18.147111 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-ljc76"] Jul 28 15:25:18.227228 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:18.227189 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh8fd\" (UniqueName: \"kubernetes.io/projected/a0e039f8-6999-4a69-a81f-666995019205-kube-api-access-qh8fd\") pod \"redis-69bbd798b6-ljc76\" (UID: \"a0e039f8-6999-4a69-a81f-666995019205\") " pod="test-ns-feast/redis-69bbd798b6-ljc76" Jul 28 15:25:18.327782 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:18.327750 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh8fd\" (UniqueName: \"kubernetes.io/projected/a0e039f8-6999-4a69-a81f-666995019205-kube-api-access-qh8fd\") pod \"redis-69bbd798b6-ljc76\" (UID: \"a0e039f8-6999-4a69-a81f-666995019205\") " pod="test-ns-feast/redis-69bbd798b6-ljc76" Jul 28 15:25:18.342643 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:18.342612 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh8fd\" (UniqueName: \"kubernetes.io/projected/a0e039f8-6999-4a69-a81f-666995019205-kube-api-access-qh8fd\") pod \"redis-69bbd798b6-ljc76\" (UID: \"a0e039f8-6999-4a69-a81f-666995019205\") " pod="test-ns-feast/redis-69bbd798b6-ljc76" Jul 28 15:25:18.433067 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:18.433034 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-ljc76" Jul 28 15:25:18.572181 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:18.572150 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-ljc76"] Jul 28 15:25:18.577160 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:25:18.577134 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0e039f8_6999_4a69_a81f_666995019205.slice/crio-c25500852af598503fe2e27e7dcf2374ec27f3c91f159d051753977541982e95 WatchSource:0}: Error finding container c25500852af598503fe2e27e7dcf2374ec27f3c91f159d051753977541982e95: Status 404 returned error can't find the container with id c25500852af598503fe2e27e7dcf2374ec27f3c91f159d051753977541982e95 Jul 28 15:25:18.579061 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:18.579044 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 15:25:18.673035 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:18.673000 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-ljc76" event={"ID":"a0e039f8-6999-4a69-a81f-666995019205","Type":"ContainerStarted","Data":"c25500852af598503fe2e27e7dcf2374ec27f3c91f159d051753977541982e95"} Jul 28 15:25:20.684222 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:20.684187 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-ljc76" event={"ID":"a0e039f8-6999-4a69-a81f-666995019205","Type":"ContainerStarted","Data":"b380251509e850c3fb51e0f1e2017a4e8e5fb0577b65fe83f728e24e9205d639"} Jul 28 15:25:20.704802 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:20.704757 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-ljc76" podStartSLOduration=1.152616463 podStartE2EDuration="2.704743947s" totalImagesPullingTime="1.552127484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:25:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:25:20.702427367 +0000 UTC m=+693.357120538" watchObservedRunningTime="2026-07-28 15:25:20.704743947 +0000 UTC m=+693.359437140" Jul 28 15:25:51.700731 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:51.700695 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-kvz8g"] Jul 28 15:25:51.704103 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:51.704087 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-kvz8g" Jul 28 15:25:51.707676 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:51.707655 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-jp69g\"" Jul 28 15:25:51.708037 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:51.708022 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Jul 28 15:25:51.718361 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:51.718339 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-kvz8g"] Jul 28 15:25:51.790740 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:51.790712 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrsg9\" (UniqueName: \"kubernetes.io/projected/fb91efff-b4ab-4689-be50-ce7ade971412-kube-api-access-lrsg9\") pod \"feast-test-apply-kvz8g\" (UID: \"fb91efff-b4ab-4689-be50-ce7ade971412\") " pod="test-ns-feast/feast-test-apply-kvz8g" Jul 28 15:25:51.891223 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:51.891196 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrsg9\" (UniqueName: \"kubernetes.io/projected/fb91efff-b4ab-4689-be50-ce7ade971412-kube-api-access-lrsg9\") pod \"feast-test-apply-kvz8g\" (UID: \"fb91efff-b4ab-4689-be50-ce7ade971412\") " pod="test-ns-feast/feast-test-apply-kvz8g" Jul 28 15:25:51.900909 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:51.900876 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrsg9\" (UniqueName: \"kubernetes.io/projected/fb91efff-b4ab-4689-be50-ce7ade971412-kube-api-access-lrsg9\") pod \"feast-test-apply-kvz8g\" (UID: \"fb91efff-b4ab-4689-be50-ce7ade971412\") " pod="test-ns-feast/feast-test-apply-kvz8g" Jul 28 15:25:52.012898 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:52.012836 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-kvz8g" Jul 28 15:25:52.142216 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:52.142187 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-kvz8g"] Jul 28 15:25:52.145217 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:25:52.145191 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb91efff_b4ab_4689_be50_ce7ade971412.slice/crio-40e4ea7e1cc918cdeff9bfc94664ccf19ebbee16b3bd4bcc1ae007a3ad5b5a3a WatchSource:0}: Error finding container 40e4ea7e1cc918cdeff9bfc94664ccf19ebbee16b3bd4bcc1ae007a3ad5b5a3a: Status 404 returned error can't find the container with id 40e4ea7e1cc918cdeff9bfc94664ccf19ebbee16b3bd4bcc1ae007a3ad5b5a3a Jul 28 15:25:52.810159 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:52.810124 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-kvz8g" event={"ID":"fb91efff-b4ab-4689-be50-ce7ade971412","Type":"ContainerStarted","Data":"40e4ea7e1cc918cdeff9bfc94664ccf19ebbee16b3bd4bcc1ae007a3ad5b5a3a"} Jul 28 15:25:57.834568 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:25:57.834526 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-kvz8g" event={"ID":"fb91efff-b4ab-4689-be50-ce7ade971412","Type":"ContainerStarted","Data":"dc5d672ad60d843f402632bce27dc111155d339652c8feabba6a0c5ec20f2200"} Jul 28 15:26:03.860197 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:03.860161 2560 generic.go:356] "Generic (PLEG): container finished" podID="fb91efff-b4ab-4689-be50-ce7ade971412" containerID="dc5d672ad60d843f402632bce27dc111155d339652c8feabba6a0c5ec20f2200" exitCode=0 Jul 28 15:26:03.860544 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:03.860233 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-kvz8g" event={"ID":"fb91efff-b4ab-4689-be50-ce7ade971412","Type":"ContainerDied","Data":"dc5d672ad60d843f402632bce27dc111155d339652c8feabba6a0c5ec20f2200"} Jul 28 15:26:04.866242 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:04.866205 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-kvz8g" event={"ID":"fb91efff-b4ab-4689-be50-ce7ade971412","Type":"ContainerStarted","Data":"4c22cd1b161180314b06b8d4fb7fb0cc17ddf0a62064ba4f99a0bbb63d7ab867"} Jul 28 15:26:04.897120 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:04.897075 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-kvz8g" podStartSLOduration=2.347081234 podStartE2EDuration="13.897061432s" totalImagesPullingTime="5.14429984s" totalInitContainerRuntime="6.405680358s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:25:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:26:04.895423856 +0000 UTC m=+737.550117026" watchObservedRunningTime="2026-07-28 15:26:04.897061432 +0000 UTC m=+737.551754602" Jul 28 15:26:13.903692 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:13.903651 2560 generic.go:356] "Generic (PLEG): container finished" podID="fb91efff-b4ab-4689-be50-ce7ade971412" containerID="4c22cd1b161180314b06b8d4fb7fb0cc17ddf0a62064ba4f99a0bbb63d7ab867" exitCode=0 Jul 28 15:26:13.904079 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:13.903719 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-kvz8g" event={"ID":"fb91efff-b4ab-4689-be50-ce7ade971412","Type":"ContainerDied","Data":"4c22cd1b161180314b06b8d4fb7fb0cc17ddf0a62064ba4f99a0bbb63d7ab867"} Jul 28 15:26:15.035125 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:15.035100 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-kvz8g" Jul 28 15:26:15.076153 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:15.076124 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrsg9\" (UniqueName: \"kubernetes.io/projected/fb91efff-b4ab-4689-be50-ce7ade971412-kube-api-access-lrsg9\") pod \"fb91efff-b4ab-4689-be50-ce7ade971412\" (UID: \"fb91efff-b4ab-4689-be50-ce7ade971412\") " Jul 28 15:26:15.078160 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:15.078137 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb91efff-b4ab-4689-be50-ce7ade971412-kube-api-access-lrsg9" (OuterVolumeSpecName: "kube-api-access-lrsg9") pod "fb91efff-b4ab-4689-be50-ce7ade971412" (UID: "fb91efff-b4ab-4689-be50-ce7ade971412"). InnerVolumeSpecName "kube-api-access-lrsg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 15:26:15.177102 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:15.177040 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrsg9\" (UniqueName: \"kubernetes.io/projected/fb91efff-b4ab-4689-be50-ce7ade971412-kube-api-access-lrsg9\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:26:15.913211 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:15.913187 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-kvz8g" Jul 28 15:26:15.913398 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:15.913181 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-kvz8g" event={"ID":"fb91efff-b4ab-4689-be50-ce7ade971412","Type":"ContainerDied","Data":"40e4ea7e1cc918cdeff9bfc94664ccf19ebbee16b3bd4bcc1ae007a3ad5b5a3a"} Jul 28 15:26:15.913398 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:15.913304 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40e4ea7e1cc918cdeff9bfc94664ccf19ebbee16b3bd4bcc1ae007a3ad5b5a3a" Jul 28 15:26:16.170878 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:16.170849 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-kvz8g_fb91efff-b4ab-4689-be50-ce7ade971412/feast-0/0.log" Jul 28 15:26:16.184888 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:16.184866 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-kvz8g_fb91efff-b4ab-4689-be50-ce7ade971412/feast-1/0.log" Jul 28 15:26:52.902309 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:52.902277 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-kvz8g"] Jul 28 15:26:52.922403 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:52.922376 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-kvz8g"] Jul 28 15:26:52.941910 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:52.941886 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-ljc76"] Jul 28 15:26:52.942092 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:52.942054 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-ljc76" podUID="a0e039f8-6999-4a69-a81f-666995019205" containerName="redis" containerID="cri-o://b380251509e850c3fb51e0f1e2017a4e8e5fb0577b65fe83f728e24e9205d639" gracePeriod=30 Jul 28 15:26:53.065903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:53.065876 2560 generic.go:356] "Generic (PLEG): container finished" podID="a0e039f8-6999-4a69-a81f-666995019205" containerID="b380251509e850c3fb51e0f1e2017a4e8e5fb0577b65fe83f728e24e9205d639" exitCode=0 Jul 28 15:26:53.066035 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:53.065950 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-ljc76" event={"ID":"a0e039f8-6999-4a69-a81f-666995019205","Type":"ContainerDied","Data":"b380251509e850c3fb51e0f1e2017a4e8e5fb0577b65fe83f728e24e9205d639"} Jul 28 15:26:53.180187 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:53.180158 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-ljc76" Jul 28 15:26:53.273410 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:53.273387 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qh8fd\" (UniqueName: \"kubernetes.io/projected/a0e039f8-6999-4a69-a81f-666995019205-kube-api-access-qh8fd\") pod \"a0e039f8-6999-4a69-a81f-666995019205\" (UID: \"a0e039f8-6999-4a69-a81f-666995019205\") " Jul 28 15:26:53.275295 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:53.275276 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0e039f8-6999-4a69-a81f-666995019205-kube-api-access-qh8fd" (OuterVolumeSpecName: "kube-api-access-qh8fd") pod "a0e039f8-6999-4a69-a81f-666995019205" (UID: "a0e039f8-6999-4a69-a81f-666995019205"). InnerVolumeSpecName "kube-api-access-qh8fd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 15:26:53.374243 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:53.374213 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qh8fd\" (UniqueName: \"kubernetes.io/projected/a0e039f8-6999-4a69-a81f-666995019205-kube-api-access-qh8fd\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\"" Jul 28 15:26:53.728938 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:53.728897 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb91efff-b4ab-4689-be50-ce7ade971412" path="/var/lib/kubelet/pods/fb91efff-b4ab-4689-be50-ce7ade971412/volumes" Jul 28 15:26:54.071696 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:54.071616 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-ljc76" Jul 28 15:26:54.071696 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:54.071644 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-ljc76" event={"ID":"a0e039f8-6999-4a69-a81f-666995019205","Type":"ContainerDied","Data":"c25500852af598503fe2e27e7dcf2374ec27f3c91f159d051753977541982e95"} Jul 28 15:26:54.072180 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:54.071695 2560 scope.go:117] "RemoveContainer" containerID="b380251509e850c3fb51e0f1e2017a4e8e5fb0577b65fe83f728e24e9205d639" Jul 28 15:26:54.091760 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:54.091733 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-ljc76"] Jul 28 15:26:54.098344 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:54.098323 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-ljc76"] Jul 28 15:26:55.727542 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:26:55.727507 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0e039f8-6999-4a69-a81f-666995019205" path="/var/lib/kubelet/pods/a0e039f8-6999-4a69-a81f-666995019205/volumes" Jul 28 15:28:47.698437 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:28:47.698409 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/2.log" Jul 28 15:28:47.701323 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:28:47.701288 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/2.log" Jul 28 15:32:47.747125 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:32:47.747095 2560 scope.go:117] "RemoveContainer" containerID="dc5d672ad60d843f402632bce27dc111155d339652c8feabba6a0c5ec20f2200" Jul 28 15:32:47.754746 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:32:47.754727 2560 scope.go:117] "RemoveContainer" containerID="4c22cd1b161180314b06b8d4fb7fb0cc17ddf0a62064ba4f99a0bbb63d7ab867" Jul 28 15:33:47.727898 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:33:47.727868 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/2.log" Jul 28 15:33:47.727898 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:33:47.727898 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/2.log" Jul 28 15:38:47.753833 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:38:47.753797 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/2.log" Jul 28 15:38:47.755475 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:38:47.755451 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/2.log" Jul 28 15:43:47.779580 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:43:47.779549 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/2.log" Jul 28 15:43:47.782728 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:43:47.782703 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/2.log" Jul 28 15:44:41.861182 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:41.861151 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vfwwp/must-gather-z68zj"] Jul 28 15:44:41.861628 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:41.861475 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb91efff-b4ab-4689-be50-ce7ade971412" containerName="feast-0" Jul 28 15:44:41.861628 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:41.861487 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb91efff-b4ab-4689-be50-ce7ade971412" containerName="feast-0" Jul 28 15:44:41.861628 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:41.861501 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb91efff-b4ab-4689-be50-ce7ade971412" containerName="feast-1" Jul 28 15:44:41.861628 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:41.861505 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb91efff-b4ab-4689-be50-ce7ade971412" containerName="feast-1" Jul 28 15:44:41.861628 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:41.861517 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0e039f8-6999-4a69-a81f-666995019205" containerName="redis" Jul 28 15:44:41.861628 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:41.861522 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0e039f8-6999-4a69-a81f-666995019205" containerName="redis" Jul 28 15:44:41.861628 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:41.861569 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0e039f8-6999-4a69-a81f-666995019205" containerName="redis" Jul 28 15:44:41.861628 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:41.861579 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb91efff-b4ab-4689-be50-ce7ade971412" containerName="feast-1" Jul 28 15:44:41.864120 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:41.864104 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vfwwp/must-gather-z68zj" Jul 28 15:44:41.866790 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:41.866763 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vfwwp\"/\"kube-root-ca.crt\"" Jul 28 15:44:41.866969 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:41.866866 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vfwwp\"/\"default-dockercfg-brzkc\"" Jul 28 15:44:41.866969 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:41.866904 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vfwwp\"/\"openshift-service-ca.crt\"" Jul 28 15:44:41.876363 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:41.876339 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vfwwp/must-gather-z68zj"] Jul 28 15:44:41.944991 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:41.944947 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlbdv\" (UniqueName: \"kubernetes.io/projected/be1e3ba9-db62-400e-8520-3a70da8705da-kube-api-access-jlbdv\") pod \"must-gather-z68zj\" (UID: \"be1e3ba9-db62-400e-8520-3a70da8705da\") " pod="openshift-must-gather-vfwwp/must-gather-z68zj" Jul 28 15:44:41.945135 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:41.945042 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/be1e3ba9-db62-400e-8520-3a70da8705da-must-gather-output\") pod \"must-gather-z68zj\" (UID: \"be1e3ba9-db62-400e-8520-3a70da8705da\") " pod="openshift-must-gather-vfwwp/must-gather-z68zj" Jul 28 15:44:42.045769 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:42.045742 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/be1e3ba9-db62-400e-8520-3a70da8705da-must-gather-output\") pod \"must-gather-z68zj\" (UID: \"be1e3ba9-db62-400e-8520-3a70da8705da\") " pod="openshift-must-gather-vfwwp/must-gather-z68zj" Jul 28 15:44:42.045881 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:42.045788 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlbdv\" (UniqueName: \"kubernetes.io/projected/be1e3ba9-db62-400e-8520-3a70da8705da-kube-api-access-jlbdv\") pod \"must-gather-z68zj\" (UID: \"be1e3ba9-db62-400e-8520-3a70da8705da\") " pod="openshift-must-gather-vfwwp/must-gather-z68zj" Jul 28 15:44:42.046109 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:42.046093 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/be1e3ba9-db62-400e-8520-3a70da8705da-must-gather-output\") pod \"must-gather-z68zj\" (UID: \"be1e3ba9-db62-400e-8520-3a70da8705da\") " pod="openshift-must-gather-vfwwp/must-gather-z68zj" Jul 28 15:44:42.055018 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:42.054993 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlbdv\" (UniqueName: \"kubernetes.io/projected/be1e3ba9-db62-400e-8520-3a70da8705da-kube-api-access-jlbdv\") pod \"must-gather-z68zj\" (UID: \"be1e3ba9-db62-400e-8520-3a70da8705da\") " pod="openshift-must-gather-vfwwp/must-gather-z68zj" Jul 28 15:44:42.181370 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:42.181346 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vfwwp/must-gather-z68zj" Jul 28 15:44:42.303036 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:42.303006 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vfwwp/must-gather-z68zj"] Jul 28 15:44:42.305588 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:44:42.305559 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe1e3ba9_db62_400e_8520_3a70da8705da.slice/crio-0a172a9cf7acfac6cb1223111844e03fc06e79c6ed743672f8b4a2604c190870 WatchSource:0}: Error finding container 0a172a9cf7acfac6cb1223111844e03fc06e79c6ed743672f8b4a2604c190870: Status 404 returned error can't find the container with id 0a172a9cf7acfac6cb1223111844e03fc06e79c6ed743672f8b4a2604c190870 Jul 28 15:44:42.307483 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:42.307466 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 15:44:43.312381 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:43.312295 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vfwwp/must-gather-z68zj" event={"ID":"be1e3ba9-db62-400e-8520-3a70da8705da","Type":"ContainerStarted","Data":"eca0a88e15df4fe4d5b93936bc81858e2558dec9fe8579b6bebe16db41292031"} Jul 28 15:44:43.312381 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:43.312349 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vfwwp/must-gather-z68zj" event={"ID":"be1e3ba9-db62-400e-8520-3a70da8705da","Type":"ContainerStarted","Data":"492d33ed441b200cb3a75683995e9cf8dc998bceab411d733e757b5427dabea4"} Jul 28 15:44:43.312381 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:43.312367 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vfwwp/must-gather-z68zj" event={"ID":"be1e3ba9-db62-400e-8520-3a70da8705da","Type":"ContainerStarted","Data":"0a172a9cf7acfac6cb1223111844e03fc06e79c6ed743672f8b4a2604c190870"} Jul 28 15:44:43.335087 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:43.333704 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vfwwp/must-gather-z68zj" podStartSLOduration=1.593527286 podStartE2EDuration="2.33368308s" totalImagesPullingTime="740.155794ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:44:43.332900167 +0000 UTC m=+1855.987593348" watchObservedRunningTime="2026-07-28 15:44:43.33368308 +0000 UTC m=+1855.988376264" Jul 28 15:44:44.356154 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:44.356128 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xvxzd_54dd096b-0a03-4d8c-b288-ec52295ad7fd/global-pull-secret-syncer/0.log" Jul 28 15:44:44.457853 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:44.457824 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t65bv_5ede988c-a5e0-4257-98a3-decea1014639/konnectivity-agent/0.log" Jul 28 15:44:44.502169 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:44.502132 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-160.ec2.internal_2d22f8252294a8bfd817cb3f869635a2/haproxy/0.log" Jul 28 15:44:48.127756 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:48.127729 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c7f6d91-4820-4618-9ecb-6a4f704b22cb/alertmanager/0.log" Jul 28 15:44:48.155454 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:48.155426 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c7f6d91-4820-4618-9ecb-6a4f704b22cb/config-reloader/0.log" Jul 28 15:44:48.182282 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:48.182249 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c7f6d91-4820-4618-9ecb-6a4f704b22cb/kube-rbac-proxy-web/0.log" Jul 28 15:44:48.214745 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:48.214712 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c7f6d91-4820-4618-9ecb-6a4f704b22cb/kube-rbac-proxy/0.log" Jul 28 15:44:48.243319 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:48.243285 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c7f6d91-4820-4618-9ecb-6a4f704b22cb/kube-rbac-proxy-metric/0.log" Jul 28 15:44:48.268556 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:48.268527 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c7f6d91-4820-4618-9ecb-6a4f704b22cb/prom-label-proxy/0.log" Jul 28 15:44:48.302159 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:48.302116 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0c7f6d91-4820-4618-9ecb-6a4f704b22cb/init-config-reloader/0.log" Jul 28 15:44:48.444603 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:48.444576 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6dbf99f75b-qw4x8_f8a33c49-8efa-4756-8503-dde78571a565/metrics-server/0.log" Jul 28 15:44:48.606940 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:48.606906 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rfgbp_c1741e78-8f3f-46c2-8afe-d861d4b931ab/node-exporter/0.log" Jul 28 15:44:48.638867 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:48.638778 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rfgbp_c1741e78-8f3f-46c2-8afe-d861d4b931ab/kube-rbac-proxy/0.log" Jul 28 15:44:48.667197 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:48.667168 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rfgbp_c1741e78-8f3f-46c2-8afe-d861d4b931ab/init-textfile/0.log" Jul 28 15:44:48.779191 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:48.779083 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-6s7qt_cb725a33-317a-474c-93a1-0848f57e9f38/kube-rbac-proxy-main/0.log" Jul 28 15:44:48.800123 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:48.800095 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-6s7qt_cb725a33-317a-474c-93a1-0848f57e9f38/kube-rbac-proxy-self/0.log" Jul 28 15:44:48.827143 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:48.827101 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-6s7qt_cb725a33-317a-474c-93a1-0848f57e9f38/openshift-state-metrics/0.log" Jul 28 15:44:48.866741 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:48.866707 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1cad35d5-9e3c-4be3-a6b1-f98548bbc73d/prometheus/0.log" Jul 28 15:44:48.890765 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:48.890742 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1cad35d5-9e3c-4be3-a6b1-f98548bbc73d/config-reloader/0.log" Jul 28 15:44:48.919754 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:48.919732 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1cad35d5-9e3c-4be3-a6b1-f98548bbc73d/thanos-sidecar/0.log" Jul 28 15:44:48.944031 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:48.944003 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1cad35d5-9e3c-4be3-a6b1-f98548bbc73d/kube-rbac-proxy-web/0.log" Jul 28 15:44:48.966083 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:48.966058 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1cad35d5-9e3c-4be3-a6b1-f98548bbc73d/kube-rbac-proxy/0.log" Jul 28 15:44:48.988018 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:48.987992 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1cad35d5-9e3c-4be3-a6b1-f98548bbc73d/kube-rbac-proxy-thanos/0.log" Jul 28 15:44:49.019194 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:49.019166 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1cad35d5-9e3c-4be3-a6b1-f98548bbc73d/init-config-reloader/0.log" Jul 28 15:44:49.093337 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:49.093256 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-428wh_457708ef-6fa0-4b52-9c9e-5dfc4745d456/prometheus-operator-admission-webhook/0.log" Jul 28 15:44:49.128642 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:49.128609 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b567d8f6-zjpls_8c837ef1-3620-44b6-973b-963ee1fe3d73/telemeter-client/0.log" Jul 28 15:44:49.155457 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:49.155417 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b567d8f6-zjpls_8c837ef1-3620-44b6-973b-963ee1fe3d73/reload/0.log" Jul 28 15:44:49.182338 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:49.182310 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b567d8f6-zjpls_8c837ef1-3620-44b6-973b-963ee1fe3d73/kube-rbac-proxy/0.log" Jul 28 15:44:49.214578 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:49.214540 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f4558d958-dj4gv_6f4d18c5-dccd-4a23-bee0-987e5aac5d93/thanos-query/0.log" Jul 28 15:44:49.237467 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:49.237393 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f4558d958-dj4gv_6f4d18c5-dccd-4a23-bee0-987e5aac5d93/kube-rbac-proxy-web/0.log" Jul 28 15:44:49.263541 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:49.263506 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f4558d958-dj4gv_6f4d18c5-dccd-4a23-bee0-987e5aac5d93/kube-rbac-proxy/0.log" Jul 28 15:44:49.297414 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:49.297374 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f4558d958-dj4gv_6f4d18c5-dccd-4a23-bee0-987e5aac5d93/prom-label-proxy/0.log" Jul 28 15:44:49.328040 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:49.328009 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f4558d958-dj4gv_6f4d18c5-dccd-4a23-bee0-987e5aac5d93/kube-rbac-proxy-rules/0.log" Jul 28 15:44:49.358355 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:49.358280 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f4558d958-dj4gv_6f4d18c5-dccd-4a23-bee0-987e5aac5d93/kube-rbac-proxy-metrics/0.log" Jul 28 15:44:50.668897 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:50.668864 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-9zv4c_0ff0e73c-9735-4325-a1d8-8f9278d5d279/networking-console-plugin/0.log" Jul 28 15:44:51.053633 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.053559 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/2.log" Jul 28 15:44:51.058896 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.058876 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-4xs9h_20a5b722-f707-4df1-af7e-c0d0b690bc29/console-operator/3.log" Jul 28 15:44:51.470797 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.470760 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n"] Jul 28 15:44:51.477081 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.477050 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" Jul 28 15:44:51.489029 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.489007 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n"] Jul 28 15:44:51.538709 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.538625 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/53fa7afe-c90c-4417-b57e-158ed3c8d6b1-proc\") pod \"perf-node-gather-daemonset-p4b6n\" (UID: \"53fa7afe-c90c-4417-b57e-158ed3c8d6b1\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" Jul 28 15:44:51.538709 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.538675 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ljz5\" (UniqueName: \"kubernetes.io/projected/53fa7afe-c90c-4417-b57e-158ed3c8d6b1-kube-api-access-8ljz5\") pod \"perf-node-gather-daemonset-p4b6n\" (UID: \"53fa7afe-c90c-4417-b57e-158ed3c8d6b1\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" Jul 28 15:44:51.538965 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.538777 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53fa7afe-c90c-4417-b57e-158ed3c8d6b1-lib-modules\") pod \"perf-node-gather-daemonset-p4b6n\" (UID: \"53fa7afe-c90c-4417-b57e-158ed3c8d6b1\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" Jul 28 15:44:51.538965 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.538821 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/53fa7afe-c90c-4417-b57e-158ed3c8d6b1-podres\") pod \"perf-node-gather-daemonset-p4b6n\" (UID: \"53fa7afe-c90c-4417-b57e-158ed3c8d6b1\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" Jul 28 15:44:51.538965 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.538847 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53fa7afe-c90c-4417-b57e-158ed3c8d6b1-sys\") pod \"perf-node-gather-daemonset-p4b6n\" (UID: \"53fa7afe-c90c-4417-b57e-158ed3c8d6b1\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" Jul 28 15:44:51.640428 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.639538 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/53fa7afe-c90c-4417-b57e-158ed3c8d6b1-proc\") pod \"perf-node-gather-daemonset-p4b6n\" (UID: \"53fa7afe-c90c-4417-b57e-158ed3c8d6b1\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" Jul 28 15:44:51.640428 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.639592 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ljz5\" (UniqueName: \"kubernetes.io/projected/53fa7afe-c90c-4417-b57e-158ed3c8d6b1-kube-api-access-8ljz5\") pod \"perf-node-gather-daemonset-p4b6n\" (UID: \"53fa7afe-c90c-4417-b57e-158ed3c8d6b1\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" Jul 28 15:44:51.640428 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.639666 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53fa7afe-c90c-4417-b57e-158ed3c8d6b1-lib-modules\") pod \"perf-node-gather-daemonset-p4b6n\" (UID: \"53fa7afe-c90c-4417-b57e-158ed3c8d6b1\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" Jul 28 15:44:51.640428 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.639709 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/53fa7afe-c90c-4417-b57e-158ed3c8d6b1-podres\") pod \"perf-node-gather-daemonset-p4b6n\" (UID: \"53fa7afe-c90c-4417-b57e-158ed3c8d6b1\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" Jul 28 15:44:51.640428 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.639737 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53fa7afe-c90c-4417-b57e-158ed3c8d6b1-sys\") pod \"perf-node-gather-daemonset-p4b6n\" (UID: \"53fa7afe-c90c-4417-b57e-158ed3c8d6b1\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" Jul 28 15:44:51.640428 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.639835 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53fa7afe-c90c-4417-b57e-158ed3c8d6b1-sys\") pod \"perf-node-gather-daemonset-p4b6n\" (UID: \"53fa7afe-c90c-4417-b57e-158ed3c8d6b1\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" Jul 28 15:44:51.640428 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.639895 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/53fa7afe-c90c-4417-b57e-158ed3c8d6b1-proc\") pod \"perf-node-gather-daemonset-p4b6n\" (UID: \"53fa7afe-c90c-4417-b57e-158ed3c8d6b1\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" Jul 28 15:44:51.640428 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.640320 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53fa7afe-c90c-4417-b57e-158ed3c8d6b1-lib-modules\") pod \"perf-node-gather-daemonset-p4b6n\" (UID: \"53fa7afe-c90c-4417-b57e-158ed3c8d6b1\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" Jul 28 15:44:51.640428 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.640399 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/53fa7afe-c90c-4417-b57e-158ed3c8d6b1-podres\") pod \"perf-node-gather-daemonset-p4b6n\" (UID: \"53fa7afe-c90c-4417-b57e-158ed3c8d6b1\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" Jul 28 15:44:51.649069 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.649041 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ljz5\" (UniqueName: \"kubernetes.io/projected/53fa7afe-c90c-4417-b57e-158ed3c8d6b1-kube-api-access-8ljz5\") pod \"perf-node-gather-daemonset-p4b6n\" (UID: \"53fa7afe-c90c-4417-b57e-158ed3c8d6b1\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" Jul 28 15:44:51.789292 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.789216 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" Jul 28 15:44:51.951838 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:51.951814 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n"] Jul 28 15:44:51.954210 ip-10-0-138-160 kubenswrapper[2560]: W0728 15:44:51.954183 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod53fa7afe_c90c_4417_b57e_158ed3c8d6b1.slice/crio-40f05a948b1661f32520f68d1d23b460b06830b6265ec67a167c3ef7d5134c2c WatchSource:0}: Error finding container 40f05a948b1661f32520f68d1d23b460b06830b6265ec67a167c3ef7d5134c2c: Status 404 returned error can't find the container with id 40f05a948b1661f32520f68d1d23b460b06830b6265ec67a167c3ef7d5134c2c Jul 28 15:44:52.369393 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:52.369342 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" event={"ID":"53fa7afe-c90c-4417-b57e-158ed3c8d6b1","Type":"ContainerStarted","Data":"0f54f1947fcced608533d52e568aea2257a0dc511a10d5b2b157809f2127c4cc"} Jul 28 15:44:52.369584 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:52.369453 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" event={"ID":"53fa7afe-c90c-4417-b57e-158ed3c8d6b1","Type":"ContainerStarted","Data":"40f05a948b1661f32520f68d1d23b460b06830b6265ec67a167c3ef7d5134c2c"} Jul 28 15:44:52.369584 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:52.369522 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" Jul 28 15:44:52.388632 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:52.388575 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" podStartSLOduration=1.38855726 podStartE2EDuration="1.38855726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:44:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:44:52.386026173 +0000 UTC m=+1865.040719340" watchObservedRunningTime="2026-07-28 15:44:52.38855726 +0000 UTC m=+1865.043250431" Jul 28 15:44:52.749903 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:52.749875 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jh24b_f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d/dns/0.log" Jul 28 15:44:52.770902 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:52.770872 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jh24b_f9d4f44f-6a4d-4f50-afb9-2d1c624a2a0d/kube-rbac-proxy/0.log" Jul 28 15:44:52.842687 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:52.842664 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mwv8g_01dca34b-58ab-41e7-8b93-9fc4558afda8/dns-node-resolver/0.log" Jul 28 15:44:53.223516 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:53.223489 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6l2z9_eea28fce-a95a-42f4-acbb-99526480c2d0/node-ca/0.log" Jul 28 15:44:54.274970 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:54.274940 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d574s_3d778963-6cf3-4bdb-9c24-7873936333a2/serve-healthcheck-canary/0.log" Jul 28 15:44:54.806604 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:54.806571 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w5z4f_74de8c67-c520-44ba-b6a5-f40a2ba9d402/kube-rbac-proxy/0.log" Jul 28 15:44:54.832237 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:54.832211 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w5z4f_74de8c67-c520-44ba-b6a5-f40a2ba9d402/exporter/0.log" Jul 28 15:44:54.858145 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:54.858117 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w5z4f_74de8c67-c520-44ba-b6a5-f40a2ba9d402/extractor/0.log" Jul 28 15:44:58.384364 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:58.384323 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-p4b6n" Jul 28 15:44:58.674896 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:58.674869 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-722xx_80322693-e6ad-4908-a881-d9a596e6846d/migrator/0.log" Jul 28 15:44:58.695435 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:58.695400 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-722xx_80322693-e6ad-4908-a881-d9a596e6846d/graceful-termination/0.log" Jul 28 15:44:58.944599 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:58.944528 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl_f19fccd4-56c7-40d9-8bbf-bf6bccbf7281/kube-storage-version-migrator-operator/1.log" Jul 28 15:44:58.945374 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:58.945347 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-s95hl_f19fccd4-56c7-40d9-8bbf-bf6bccbf7281/kube-storage-version-migrator-operator/0.log" Jul 28 15:44:59.933153 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:59.933119 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qxdtr_263c477a-d08f-4956-9c46-10365000b10a/kube-multus-additional-cni-plugins/0.log" Jul 28 15:44:59.964305 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:59.964277 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qxdtr_263c477a-d08f-4956-9c46-10365000b10a/egress-router-binary-copy/0.log" Jul 28 15:44:59.992323 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:44:59.992264 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qxdtr_263c477a-d08f-4956-9c46-10365000b10a/cni-plugins/0.log" Jul 28 15:45:00.020041 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:00.020004 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qxdtr_263c477a-d08f-4956-9c46-10365000b10a/bond-cni-plugin/0.log" Jul 28 15:45:00.042544 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:00.042511 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qxdtr_263c477a-d08f-4956-9c46-10365000b10a/routeoverride-cni/0.log" Jul 28 15:45:00.063755 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:00.063730 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qxdtr_263c477a-d08f-4956-9c46-10365000b10a/whereabouts-cni-bincopy/0.log" Jul 28 15:45:00.088329 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:00.088295 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qxdtr_263c477a-d08f-4956-9c46-10365000b10a/whereabouts-cni/0.log" Jul 28 15:45:00.414706 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:00.414680 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z5p5z_f31fdcf8-d74f-4307-a8b9-e4021d9c6e20/kube-multus/0.log" Jul 28 15:45:00.439896 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:00.439872 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hlzj8_4341eeac-de67-4bab-81c8-d2f8c62c677c/network-metrics-daemon/0.log" Jul 28 15:45:00.462917 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:00.462892 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hlzj8_4341eeac-de67-4bab-81c8-d2f8c62c677c/kube-rbac-proxy/0.log" Jul 28 15:45:01.295192 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:01.295160 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5vlpq_5809cf4f-2b29-4e6f-9f70-26f7a99709fe/ovn-controller/0.log" Jul 28 15:45:01.316047 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:01.316019 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5vlpq_5809cf4f-2b29-4e6f-9f70-26f7a99709fe/ovn-acl-logging/0.log" Jul 28 15:45:01.338717 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:01.338694 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5vlpq_5809cf4f-2b29-4e6f-9f70-26f7a99709fe/kube-rbac-proxy-node/0.log" Jul 28 15:45:01.359722 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:01.359699 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5vlpq_5809cf4f-2b29-4e6f-9f70-26f7a99709fe/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 15:45:01.378320 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:01.378292 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5vlpq_5809cf4f-2b29-4e6f-9f70-26f7a99709fe/northd/0.log" Jul 28 15:45:01.399535 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:01.399517 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5vlpq_5809cf4f-2b29-4e6f-9f70-26f7a99709fe/nbdb/0.log" Jul 28 15:45:01.423189 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:01.423169 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5vlpq_5809cf4f-2b29-4e6f-9f70-26f7a99709fe/sbdb/0.log" Jul 28 15:45:01.467309 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:01.467282 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5vlpq_5809cf4f-2b29-4e6f-9f70-26f7a99709fe/ovnkube-controller/0.log" Jul 28 15:45:02.865684 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:02.865604 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-vdlwj_aeecf212-beb1-4ab4-acd6-5ae64fbb4416/network-check-target-container/0.log" Jul 28 15:45:03.644701 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:03.644661 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-bqw8j_2228d284-b2b5-4711-955e-e2763f4a817c/iptables-alerter/0.log" Jul 28 15:45:04.298538 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:04.298510 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-cpt4r_795606e4-370a-41cf-a5ad-6c181a984efa/tuned/0.log" Jul 28 15:45:05.911688 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:05.911654 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-kb59w_bb3e2f63-5d00-485f-b4bb-56ae63e9f028/cluster-samples-operator/0.log" Jul 28 15:45:05.927165 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:05.927143 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-kb59w_bb3e2f63-5d00-485f-b4bb-56ae63e9f028/cluster-samples-operator-watch/0.log" Jul 28 15:45:07.483968 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:07.483939 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-fflf5_2974bc55-eff2-4e8a-bfd5-2faf993075a7/csi-driver/0.log" Jul 28 15:45:07.508563 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:07.508533 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-fflf5_2974bc55-eff2-4e8a-bfd5-2faf993075a7/csi-node-driver-registrar/0.log" Jul 28 15:45:07.529215 ip-10-0-138-160 kubenswrapper[2560]: I0728 15:45:07.529193 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-fflf5_2974bc55-eff2-4e8a-bfd5-2faf993075a7/csi-liveness-probe/0.log"